欢迎投稿

今日深度:

hbase入库速度测试,hbase速度测试

hbase入库速度测试,hbase速度测试


自己做的一个hbase性能测试。从测试结果来看,入大数据应该启动多个线程,多个线程间不要共用hbase连接,如果多个线程使用一个hbase连接,一个hbase连接的性能是有限的,多个线程共用一个hbase连接等于使用一个hbase入库程序。目前我使用1+2集群,每秒钟入库20W条记录,20W入库还没有达到入库瓶颈。




 scan 't1', ['c1', 'c2'], {LIMIT => 10, STARTROW => 'xyz'}

 scan 'test_201408280000_201408282359', {LIMIT => 10, STARTROW => '1000007285120140828115555019504'}

 scan 'test_201408280000_201408282359', {LIMIT => 10, STARTROW => '2000007285120140828115555019504'}

 scan 'test_201408280000_201408282359', {LIMIT => 10, STARTROW => '5000007285120140828115555019504'}

-Xloggc:./gc.log -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:-CMSConcurrentMTEnabled -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled

ps -ef |grep com.main.Main

16个进程。单个 处理 3W。

1个进程。单个 处理 5W。处理不了,丢数据


1个进程。单个 处理 3W。处理不了,丢数据


这次 咱们 测试 的 场景:
1、28往43入大数据。
2、单个进程入
3、java单个接收
4、其他入得都关了


8月30日测试

只起 1个线程  

|4|0|0|0||0|0|1348|257069|2|0|0|65535|iPhone6,2/7.1.2(11D257)|0
2014-08-30 15:01:19,826  INFO [main] (TestPutMain.java:174) - 10492ms:296997
2014-08-30 15:02:00,544  INFO [main] (TestPutMain.java:174) - 10001ms:265794
2014-08-30 15:02:10,545  INFO [main] (TestPutMain.java:174) - 10001ms:284958
2014-08-30 15:02:20,633  INFO [main] (TestPutMain.java:174) - 10088ms:254882



只起 2个线程  


2014-08-30 15:16:44,314  INFO [Thread-1] (ThreadPut.java:135) - 11040ms:148264
2014-08-30 15:16:44,815  INFO [Thread-0] (ThreadPut.java:135) - 10946ms:148264
2014-08-30 15:16:55,138  INFO [Thread-1] (ThreadPut.java:135) - 10823ms:148499
2014-08-30 15:16:55,755  INFO [Thread-0] (ThreadPut.java:135) - 10939ms:148499
2014-08-30 15:17:05,820  INFO [Thread-1] (ThreadPut.java:135) - 10681ms:148503
2014-08-30 15:17:06,352  INFO [Thread-0] (ThreadPut.java:135) - 10595ms:148503


2014-08-30 15:24:26,667  INFO [Thread-1] (ThreadPut.java:135) - 10150ms:130519
2014-08-30 15:24:35,191  INFO [Thread-0] (ThreadPut.java:135) - 10393ms:148499
2014-08-30 15:24:37,216  INFO [Thread-1] (ThreadPut.java:135) - 10548ms:148503
2014-08-30 15:24:45,592  INFO [Thread-0] (ThreadPut.java:135) - 10400ms:148503
2014-08-30 15:24:47,584  INFO [Thread-1] (ThreadPut.java:135) - 10367ms:148501
2014-08-30 15:24:56,225  INFO [Thread-0] (ThreadPut.java:135) - 10632ms:148504
2014-08-30 15:24:57,632  INFO [Thread-1] (ThreadPut.java:135) - 10047ms:148497
2014-08-30 15:25:06,411  INFO [Thread-0] (ThreadPut.java:135) - 10185ms:148505


只起 3个线程  



2014-08-30 15:26:34,545  INFO [Thread-1] (ThreadPut.java:135) - 11774ms:142208
2014-08-30 15:26:43,087  INFO [Thread-0] (ThreadPut.java:135) - 10237ms:97797
2014-08-30 15:26:43,594  INFO [Thread-2] (ThreadPut.java:135) - 10117ms:97797
2014-08-30 15:26:44,610  INFO [Thread-1] (ThreadPut.java:135) - 10065ms:99369
2014-08-30 15:26:53,496  INFO [Thread-0] (ThreadPut.java:135) - 10408ms:98960
2014-08-30 15:26:53,994  INFO [Thread-2] (ThreadPut.java:135) - 10399ms:98960
2014-08-30 15:26:54,889  INFO [Thread-1] (ThreadPut.java:135) - 10278ms:99002
2014-08-30 15:27:04,059  INFO [Thread-0] (ThreadPut.java:135) - 10563ms:99001
2014-08-30 15:27:04,583  INFO [Thread-2] (ThreadPut.java:135) - 10588ms:99001
2014-08-30 15:27:05,462  INFO [Thread-1] (ThreadPut.java:135) - 10573ms:98998
2014-08-30 15:27:14,348  INFO [Thread-0] (ThreadPut.java:135) - 10287ms:99001
2014-08-30 15:27:14,867  INFO [Thread-2] (ThreadPut.java:135) - 10284ms:99001
2014-08-30 15:27:15,941  INFO [Thread-1] (ThreadPut.java:135) - 10477ms:98999


2014-08-30 15:27:25,556  INFO [Thread-2] (ThreadPut.java:135) - 10687ms:99000
2014-08-30 15:27:26,522  INFO [Thread-1] (ThreadPut.java:135) - 10581ms:99000
2014-08-30 15:27:36,035  INFO [Thread-0] (ThreadPut.java:135) - 11096ms:99002
2014-08-30 15:27:36,624  INFO [Thread-2] (ThreadPut.java:135) - 11068ms:99002
2014-08-30 15:27:37,599  INFO [Thread-1] (ThreadPut.java:135) - 11075ms:99000
2014-08-30 15:27:46,938  INFO [Thread-0] (ThreadPut.java:135) - 10901ms:99004
2014-08-30 15:27:47,436  INFO [Thread-2] (ThreadPut.java:135) - 10811ms:99004
2014-08-30 15:27:48,370  INFO [Thread-1] (ThreadPut.java:135) - 10770ms:98998



2014-08-30 15:31:18,092  INFO [Thread-1] (ThreadPut.java:135) - 10152ms:124519
2014-08-30 15:31:18,802  INFO [Thread-2] (ThreadPut.java:135) - 10862ms:124519
2014-08-30 15:31:28,840  INFO [Thread-0] (ThreadPut.java:135) - 10831ms:97797
2014-08-30 15:31:29,483  INFO [Thread-1] (ThreadPut.java:135) - 11390ms:99190
2014-08-30 15:31:30,093  INFO [Thread-2] (ThreadPut.java:135) - 11290ms:99190
2014-08-30 15:31:39,419  INFO [Thread-0] (ThreadPut.java:135) - 10578ms:98960
2014-08-30 15:31:40,133  INFO [Thread-1] (ThreadPut.java:135) - 10649ms:99022
2014-08-30 15:31:40,756  INFO [Thread-2] (ThreadPut.java:135) - 10662ms:99022
2014-08-30 15:31:49,447  INFO [Thread-0] (ThreadPut.java:135) - 10027ms:99001
2014-08-30 15:31:50,135  INFO [Thread-1] (ThreadPut.java:135) - 10001ms:105204
2014-08-30 15:31:50,757  INFO [Thread-2] (ThreadPut.java:135) - 10001ms:113363
2014-08-30 15:32:00,534  INFO [Thread-0] (ThreadPut.java:135) - 11086ms:99001
2014-08-30 15:32:01,004  INFO [Thread-1] (ThreadPut.java:135) - 10868ms:92799
2014-08-30 15:32:01,726  INFO [Thread-2] (ThreadPut.java:135) - 10968ms:84640


2014-08-30 15:35:11,252  INFO [Thread-2] (ThreadPut.java:135) - 10401ms:99001
2014-08-30 15:35:12,518  INFO [Thread-0] (ThreadPut.java:135) - 10537ms:99001
2014-08-30 15:35:20,511  INFO [Thread-1] (ThreadPut.java:135) - 11004ms:99000
2014-08-30 15:35:22,043  INFO [Thread-2] (ThreadPut.java:135) - 10790ms:99000
2014-08-30 15:35:23,076  INFO [Thread-0] (ThreadPut.java:135) - 10557ms:99000
2014-08-30 15:35:30,714  INFO [Thread-1] (ThreadPut.java:135) - 10201ms:99002
2014-08-30 15:35:32,426  INFO [Thread-2] (ThreadPut.java:135) - 10383ms:99002
2014-08-30 15:35:33,702  INFO [Thread-0] (ThreadPut.java:135) - 10624ms:99002


-----------开2个 jvm
每个 jvm 起一个进程


top - 15:42:00 up 10 days, 22:16,  5 users,  load average: 3.81, 3.22, 2.68
Tasks: 490 total,   2 running, 483 sleeping,   5 stopped,   0 zombie
Cpu(s): 28.9%us,  1.7%sy,  0.0%ni, 69.0%id,  0.0%wa,  0.0%hi,  0.5%si,  0.0%st
Mem:  65926660k total, 65653428k used,   273232k free,   199280k buffers
Swap:        0k total,        0k used,        0k free, 38592996k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND                                                                
 5026 root      20   0 8120m 410m  15m S 160.9  0.6   5:27.02 java                                                                  
 5024 root      20   0 8120m 411m  15m S 155.3  0.6   5:30.08 java                                                                  
23737 hbase     20   0 22.3g  19g  22m S 149.0 30.6   5021:43 java     


2014-08-30 15:41:55,443  INFO [Thread-0] (ThreadPut.java:135) - 10507ms:279570
2014-08-30 15:41:55,467  INFO [Thread-0] (ThreadPut.java:135) - 10023ms:267660
2014-08-30 15:42:05,444  INFO [Thread-0] (ThreadPut.java:135) - 10001ms:279500
2014-08-30 15:42:05,564  INFO [Thread-0] (ThreadPut.java:135) - 10097ms:261253
2014-08-30 15:42:15,571  INFO [Thread-0] (ThreadPut.java:135) - 10126ms:249915
2014-08-30 15:42:15,707  INFO [Thread-0] (ThreadPut.java:135) - 10142ms:263076
2014-08-30 15:42:25,708  INFO [Thread-0] (ThreadPut.java:135) - 10001ms:253250
2014-08-30 15:42:25,935  INFO [Thread-0] (ThreadPut.java:135) - 10363ms:262583





开 1个jvm  

top - 15:46:43 up 10 days, 22:21,  5 users,  load average: 4.12, 3.66, 2.99
Tasks: 490 total,   1 running, 483 sleeping,   6 stopped,   0 zombie
Cpu(s): 16.9%us,  1.2%sy,  0.0%ni, 81.7%id,  0.0%wa,  0.0%hi,  0.2%si,  0.0%st
Mem:  65926660k total, 62788220k used,  3138440k free,   196972k buffers
Swap:        0k total,        0k used,        0k free, 36144432k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND                                                                
 6255 root      20   0 8120m 411m  15m S 145.5  0.6   5:02.43 java                                                                  
23737 hbase     20   0 22.3g  19g  22m S 135.6 30.6   5028:12 java                                                                  
23492 hdfs      20   0 6024m 1.4g  19m S  1.3  2.3 704:35.58 java                                                                   
 6377 root      20   0 15296 1564  952 R  1.0  0.0   0:00.96 top     
 
2014-08-30 15:46:16,030  INFO [Thread-0] (ThreadPut.java:135) - 10001ms:272390
2014-08-30 15:46:26,565  INFO [Thread-0] (ThreadPut.java:135) - 10534ms:290087
2014-08-30 15:46:36,674  INFO [Thread-0] (ThreadPut.java:135) - 10109ms:297009
2014-08-30 15:46:46,676  INFO [Thread-0] (ThreadPut.java:135) - 10001ms:278020
2014-08-30 15:46:56,763  INFO [Thread-0] (ThreadPut.java:135) - 10087ms:282034
2014-08-30 15:47:06,828  INFO [Thread-0] (ThreadPut.java:135) - 10064ms:263455
2014-08-30 15:47:17,006  INFO [Thread-0] (ThreadPut.java:135) - 10176ms:265487


开 0个 jvm

top - 15:48:24 up 10 days, 22:23,  5 users,  load average: 2.35, 3.22, 2.91
Tasks: 489 total,   2 running, 481 sleeping,   6 stopped,   0 zombie
Cpu(s):  7.8%us,  1.0%sy,  0.0%ni, 91.1%id,  0.0%wa,  0.0%hi,  0.2%si,  0.0%st
Mem:  65926660k total, 63409940k used,  2516720k free,   197664k buffers
Swap:        0k total,        0k used,        0k free, 37172400k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND                                                                
23737 hbase     20   0 22.3g  19g  22m S 126.8 30.6   5030:13 java                                                                  
23492 hdfs      20   0 6024m 1.4g  19m S  7.6  2.3 704:47.60 java                                                                   
29021 hbase     20   0 1601m 395m  21m S  4.6  0.6  45:19.14 java   





开2个jvm


top - 15:52:52 up 10 days, 22:27,  5 users,  load average: 3.68, 3.28, 2.96
Tasks: 492 total,   2 running, 483 sleeping,   7 stopped,   0 zombie
Cpu(s): 31.1%us,  1.5%sy,  0.0%ni, 66.9%id,  0.0%wa,  0.0%hi,  0.4%si,  0.0%st
Mem:  65926660k total, 65099348k used,   827312k free,   197864k buffers
Swap:        0k total,        0k used,        0k free, 38040052k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND                                                                
 7598 root      20   0 8120m 414m  15m S 176.0  0.6   4:48.12 java                                                                  
 7596 root      20   0 8120m 407m  15m S 170.3  0.6   4:45.23 java                                                                  
23737 hbase     20   0 22.3g  19g  22m S 160.7 30.6   5036:30 java    

2014-08-30 15:51:44,532  INFO [Thread-0] (ThreadPut.java:135) - 7878:10006ms:294060
2014-08-30 15:51:45,387  INFO [Thread-0] (ThreadPut.java:135) - 7879:10408ms:296992
2014-08-30 15:51:54,534  INFO [Thread-0] (ThreadPut.java:135) - 7878:10001ms:251994
2014-08-30 15:51:55,422  INFO [Thread-0] (ThreadPut.java:135) - 7879:10034ms:278158
2014-08-30 15:52:04,604  INFO [Thread-0] (ThreadPut.java:135) - 7878:10070ms:279886
2014-08-30 15:52:05,456  INFO [Thread-0] (ThreadPut.java:135) - 7879:10034ms:265560
2014-08-30 15:52:15,124  INFO [Thread-0] (ThreadPut.java:135) - 7878:10520ms:263063
2014-08-30 15:52:15,645  INFO [Thread-0] (ThreadPut.java:135) - 7879:10187ms:263057


2014-08-30 15:53:25,833  INFO [Thread-0] (ThreadPut.java:135) - 7878:10187ms:265159
2014-08-30 15:53:26,638  INFO [Thread-0] (ThreadPut.java:135) - 7879:10325ms:262640
2014-08-30 15:53:36,069  INFO [Thread-0] (ThreadPut.java:135) - 7878:10236ms:247339
2014-08-30 15:53:36,807  INFO [Thread-0] (ThreadPut.java:135) - 7879:10169ms:281384
2014-08-30 15:53:46,148  INFO [Thread-0] (ThreadPut.java:135) - 7878:10078ms:278179
2014-08-30 15:53:46,815  INFO [Thread-0] (ThreadPut.java:135) - 7879:10008ms:247521
2014-08-30 15:53:56,317  INFO [Thread-0] (ThreadPut.java:135) - 7878:10169ms:266367
2014-08-30 15:53:56,817  INFO [Thread-0] (ThreadPut.java:135) - 7879:10001ms:275942

gc 回收
360.842: [GC 208291K->146611K(274228K), 0.0348940 secs]
360.879: [GC 149128K(274228K), 0.0089390 secs]
361.147: [GC 216563K->155205K(274228K), 0.0310100 secs]
361.248: [GC 225157K->164342K(274228K), 0.0233880 secs]
361.306: [GC 198803K(274228K), 0.0062710 secs]
361.857: [GC 184986K->122513K(274228K), 0.0226400 secs]
362.063: [GC 192465K->130123K(274228K), 0.0352800 secs]
362.919: [GC 200075K->138543K(274228K), 0.0274970 secs]
363.016: [GC 208495K->146859K(274228K), 0.0244790 secs]
363.041: [GC 148139K(274228K), 0.0110730 secs]
363.263: [GC 216811K->155986K(274228K), 0.0260420 secs]
363.327: [GC 191255K(274228K), 0.0094660 secs]
363.372: [GC 208502K->147647K(274228K), 0.0357430 secs]
363.981: [GC 185824K->123962K(274228K), 0.0325520 secs]
364.103: [GC 193914K->132009K(274228K), 0.0310530 secs]
364.509: [GC 201961K->139882K(274228K), 0.0237750 secs]
364.616: [GC 209834K->149002K(274228K), 0.0305040 secs]
364.648: [GC 150395K(274228K), 0.0096100 secs]
365.000: [GC 218954K->157441K(274228K), 0.0213570 secs]
365.022: [GC 158718K(274228K), 0.0090680 secs]
365.103: [GC 187102K->126087K(274228K), 0.0239810 secs]
365.728: [GC 187199K->125341K(274228K), 0.0242090 secs]
365.823: [GC 195293K->132649K(274228K), 0.0234090 secs]
366.308: [GC 202601K->142020K(274228K), 0.0236230 secs]
366.405: [GC 211972K->150098K(274228K), 0.0265430 secs]
366.432: [GC 151386K(274228K), 0.0082950 secs]
366.833: [GC 220050K->157889K(274228K), 0.0238290 secs]
366.925: [GC 227841K->166794K(274228K), 0.0245700 secs]
366.982: [GC 184868K(274228K), 0.0081660 secs]
367.129: [GC 187553K->127943K(274228K), 0.0266090 secs]
367.274: [GC 197895K->137416K(274228K), 0.0250820 secs]
367.724: [GC 207368K->146069K(274228K), 0.0228850 secs]
367.748: [GC 147354K(274228K), 0.0075940 secs]
367.826: [GC 216021K->155062K(274228K), 0.0278530 secs]
368.374: [GC 225014K->163562K(274228K), 0.0256590 secs]
368.400: [GC 164943K(274228K), 0.0075990 secs]
368.536: [GC 189573K->126149K(274228K), 0.0216690 secs]
369.144: [GC 196101K->133938K(274228K), 0.0213220 secs]
369.241: [GC 203890K->141851K(274228K), 0.0222820 secs]
369.863: [GC 211803K->150161K(274228K), 0.0220300 secs]
369.885: [GC 151383K(274228K), 0.0082610 secs]
369.967: [GC 220113K->159137K(274228K), 0.0329540 secs]






开 3个 jvm

每个jvm 起一个进程


top - 16:04:26 up 10 days, 22:39,  5 users,  load average: 6.38, 4.59, 3.67
Tasks: 495 total,   2 running, 484 sleeping,   9 stopped,   0 zombie
Cpu(s): 36.1%us,  1.4%sy,  0.0%ni, 62.1%id,  0.0%wa,  0.0%hi,  0.4%si,  0.0%st
Mem:  65926660k total, 62463124k used,  3463536k free,   197192k buffers
Swap:        0k total,        0k used,        0k free, 35020104k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND                                                                
10215 root      20   0 8120m 415m  15m S 163.4  0.6   4:04.96 java                                                                  
10213 root      20   0 8120m 400m  15m S 152.5  0.6   4:08.95 java                                                                  
23737 hbase     20   0 22.3g  19g  22m S 136.3 30.6   5053:30 java                                                                  
10217 root      20   0 8120m 409m  15m S 135.6  0.6   4:00.89 java                                                                  
23492 hdfs      20   0 6024m 1.4g  19m S  3.0  2.3 706:21.07 java  


top - 16:04:56 up 10 days, 22:39,  5 users,  load average: 5.26, 4.47, 3.65
Tasks: 495 total,   1 running, 485 sleeping,   9 stopped,   0 zombie
Cpu(s): 37.2%us,  1.5%sy,  0.0%ni, 60.9%id,  0.0%wa,  0.0%hi,  0.4%si,  0.0%st
Mem:  65926660k total, 62760444k used,  3166216k free,   197424k buffers
Swap:        0k total,        0k used,        0k free, 35317244k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND                                                                
10217 root      20   0 8120m 409m  15m S 162.4  0.6   4:47.57 java                                                                  
23737 hbase     20   0 22.3g  19g  22m S 151.1 30.6   5054:15 java                                                                  
10213 root      20   0 8120m 400m  15m S 147.2  0.6   4:58.00 java                                                                  
10215 root      20   0 8120m 415m  15m S 144.2  0.6   4:49.06 java                                                                  
23492 hdfs      20   0 6024m 1.4g  19m S  6.6  2.3 706:23.91 java  



2014-08-30 16:05:08,934  INFO [Thread-0] (ThreadPut.java:135) - 7878:10342ms:266360
2014-08-30 16:05:17,995  INFO [Thread-0] (ThreadPut.java:135) - 7880:10074ms:250599
2014-08-30 16:05:18,725  INFO [Thread-0] (ThreadPut.java:135) - 7879:10236ms:278137
2014-08-30 16:05:19,010  INFO [Thread-0] (ThreadPut.java:135) - 7878:10074ms:263060
2014-08-30 16:05:27,996  INFO [Thread-0] (ThreadPut.java:135) - 7880:10001ms:281296
2014-08-30 16:05:29,103  INFO [Thread-0] (ThreadPut.java:135) - 7878:10092ms:296520
2014-08-30 16:05:29,122  INFO [Thread-0] (ThreadPut.java:135) - 7879:10397ms:281914
2014-08-30 16:05:37,997  INFO [Thread-0] (ThreadPut.java:135) - 7880:10001ms:255796
2014-08-30 16:05:39,123  INFO [Thread-0] (ThreadPut.java:135) - 7878:10020ms:260742
2014-08-30 16:05:39,431  INFO [Thread-0] (ThreadPut.java:135) - 7879:10307ms:262601
2014-08-30 16:05:48,295  INFO [Thread-0] (ThreadPut.java:135) - 7880:10297ms:272858
2014-08-30 16:05:49,182  INFO [Thread-0] (ThreadPut.java:135) - 7878:10059ms:252483
2014-08-30 16:05:49,756  INFO [Thread-0] (ThreadPut.java:135) - 7879:10325ms:265481
2014-08-30 16:05:58,464  INFO [Thread-0] (ThreadPut.java:135) - 7880:10168ms:263503
2014-08-30 16:05:59,388  INFO [Thread-0] (ThreadPut.java:135) - 7878:10204ms:263247
2014-08-30 16:05:59,877  INFO [Thread-0] (ThreadPut.java:135) - 7879:10120ms:248351




272.751: [GC 159402K(282532K), 0.0119200 secs]
273.540: [GC 186670K->125113K(282532K), 0.0260570 secs]
273.646: [GC 195065K->134716K(282532K), 0.0347910 secs]
274.169: [GC 204668K->142125K(282532K), 0.0281580 secs]
274.274: [GC 212077K->150084K(282532K), 0.0223270 secs]
274.967: [GC 220036K->157862K(282532K), 0.0240280 secs]
274.992: [GC 159078K(282532K), 0.0079050 secs]
275.074: [GC 227814K->166417K(282532K), 0.0472480 secs]
275.235: [GC 236369K->175938K(282532K), 0.0279730 secs]
275.537: [GC 245874K(282532K), 0.0163580 secs]
275.572: [GC 236467K->176190K(282532K), 0.0347960 secs]
275.899: [GC 190751K->128328K(282532K), 0.0268340 secs]
276.126: [GC 198280K->136686K(282532K), 0.0330030 secs]
276.935: [GC 206638K->144743K(282532K), 0.0240280 secs]
277.278: [GC 214695K->151545K(282532K), 0.0204090 secs]
277.299: [GC 152915K(282532K), 0.0073420 secs]
277.557: [GC 221497K->160110K(282532K), 0.0290340 secs]
277.720: [GC 230062K->169725K(282532K), 0.0333600 secs]
277.754: [GC 169738K(282532K), 0.0355030 secs]
278.212: [GC 177909K->115864K(282532K), 0.0239950 secs]
278.319: [GC 185816K->124037K(282532K), 0.0312900 secs]
279.151: [GC 193989K->131576K(282532K), 0.0230500 secs]
279.322: [GC 201528K->139661K(282532K), 0.0203690 secs]
279.425: [GC 209613K->149226K(282532K), 0.0250970 secs]
279.793: [GC 219178K->158524K(282532K), 0.0252410 secs]
279.819: [GC 159800K(282532K), 0.0066310 secs]
280.148: [GC 228476K->166747K(282532K), 0.0254630 secs]
280.393: [GC 230756K(282532K), 0.0309500 secs]
280.546: [GC 176140K->115098K(282532K), 0.0278680 secs]
280.981: [GC 185050K->122492K(282532K), 0.0230140 secs]
281.436: [GC 192444K->131250K(282532K), 0.0209190 secs]
281.533: [GC 201202K->139387K(282532K), 0.0224390 secs]
281.774: [GC 209339K->148281K(282532K), 0.0298900 secs]
282.251: [GC 218233K->155780K(282532K), 0.0325820 secs]
282.284: [GC 157021K(282532K), 0.0078330 secs]
282.535: [GC 225732K->163613K(282532K), 0.0271650 secs]
283.012: [GC 233565K->171528K(282532K), 0.0238330 secs]
283.065: [GC 200057K(282532K), 0.0055300 secs]
283.442: [GC 180857K->118519K(282532K), 0.0220240 secs]
283.573: [GC 188471K->127788K(282532K), 0.0256870 secs]
283.864: [GC 197740K->138015K(282532K), 0.0320150 secs]
284.428: [GC 207967K->145927K(282532K), 0.0323140 secs]
284.579: [GC 215879K->155218K(282532K), 0.0405020 secs]
284.621: [GC 156511K(282532K), 0.0091330 secs]
284.765: [GC 225170K->163948K(282532K), 0.0360960 secs]
285.801: [GC 233900K->171362K(282532K), 0.0430380 secs]
285.845: [GC 172564K(282532K), 0.0089780 secs]
285.939: [GC 193007K->129832K(282532K), 0.0295350 secs]
286.075: [GC 182192K->122402K(282532K), 0.0283230 secs]
286.174: [GC 192354K->131687K(282532K), 0.0430980 secs]
286.218: [GC 133002K(282532K), 0.0097760 secs]
286.722: [GC 201639K->139806K(282532K), 0.0301840 secs]
286.827: [GC 209758K->148626K(282532K), 0.0337670 secs]
286.882: [GC 167336K(282532K), 0.0093490 secs]
287.497: [GC 184827K->122681K(282532K), 0.0182150 secs]
287.592: [GC 192633K->132069K(282532K), 0.0610700 secs]
287.931: [GC 202021K->139509K(282532K), 0.0236920 secs]
288.019: [GC 209461K->148826K(282532K), 0.0245620 secs]
288.044: [GC 150135K(282532K), 0.0079720 secs]
288.368: [GC 218778K->157170K(282532K), 0.0256840 secs]
288.478: [GC 227122K->166311K(282532K), 0.0258790 secs]
288.536: [GC 172108K(282532K), 0.0117000 secs]
288.965: [GC 188046K->125784K(282532K), 0.0234150 secs]
289.059: [GC 195736K->135304K(282532K), 0.0295710 secs]
289.717: [GC 205256K->142115K(282532K), 0.0210770 secs]
289.812: [GC 212067K->150143K(282532K), 0.0214400 secs]
290.186: [GC 220095K->158342K(282532K), 0.0288360 secs]
290.216: [GC 159577K(282532K), 0.0082030 secs]
290.302: [GC 228294K->167255K(282532K), 0.0222650 secs]
290.819: [GC 237207K->175774K(282532K), 0.0309060 secs]
290.886: [GC 209988K(282532K), 0.0048460 secs]
290.930: [GC 218635K->157114K(282532K), 0.0233890 secs]








起 一个 jvm

开一个入库进程
command = 'java -Xms1024m -Xmx5120m -Xloggc:./gc.log -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:-CMSConcurrentMTEnabled -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -cp .:$CLASSPATH:' + env + " com.main.TestPutMain " + s_param + " &";

122.509: [GC 495468K->245572K(1013632K), 0.0654010 secs]
123.337: [GC 525188K->279619K(1013632K), 0.0486770 secs]
124.654: [GC 559235K->314461K(1013632K), 0.0533320 secs]
126.168: [GC 594077K->343933K(1013632K), 0.0468150 secs]
127.129: [GC 623549K->377371K(1013632K), 0.0598020 secs]
128.359: [GC 656987K->411954K(1013632K), 0.0678730 secs]
129.732: [GC 691570K->443666K(1013632K), 0.0668420 secs]
130.858: [GC 723282K->477671K(1013632K), 0.0546350 secs]
132.158: [GC 757287K->514165K(1013632K), 0.0495310 secs]
133.430: [GC 793781K->540617K(1013632K), 0.0466430 secs]
133.478: [GC 546115K(1013632K), 0.0265040 secs]
134.283: [GC 691138K(1013632K), 0.0760650 secs]
134.579: [GC 478230K->232536K(1013632K), 0.0555480 secs]
135.933: [GC 439229K->194536K(1013632K), 0.0554020 secs]
137.155: [GC 474152K->222950K(1013632K), 0.0473060 secs]
138.430: [GC 502566K->256417K(1013632K), 0.0539100 secs]
139.706: [GC 536033K->287629K(1013632K), 0.0497340 secs]
140.572: [GC 567245K->318712K(1013632K), 0.0498410 secs]
141.630: [GC 598328K->352544K(1013632K), 0.0532240 secs]
142.987: [GC 632160K->384808K(1013632K), 0.0479580 secs]
143.955: [GC 664424K->418814K(1013632K), 0.0933880 secs]
145.144: [GC 698430K->450266K(1013632K), 0.0517130 secs]
146.615: [GC 729882K->481881K(1013632K), 0.0414240 secs]
147.955: [GC 761497K->509892K(1013632K), 0.0375350 secs]
148.819: [GC 789508K->543849K(1013632K), 0.0499100 secs]
148.870: [GC 548979K(1013632K), 0.0224790 secs]
150.149: [GC 823465K->575364K(1013632K), 0.0453270 secs]
150.960: [GC 818165K(1013632K), 0.0682440 secs]
151.385: [GC 421750K->170734K(1013632K), 0.0462860 secs]
152.046: [GC 450350K->201031K(1013632K), 0.0599470 secs]
153.242: [GC 480647K->236879K(1013632K), 0.0507330 secs]
154.397: [GC 516495K->269104K(1013632K), 0.0423360 secs]
155.699: [GC 548720K->300056K(1013632K), 0.0448550 secs]
156.671: [GC 579672K->332670K(1013632K), 0.0548850 secs]
157.949: [GC 612286K->369062K(1013632K), 0.0587220 secs]
159.564: [GC 648678K->399603K(1013632K), 0.0430970 secs]
160.519: [GC 679219K->432294K(1013632K), 0.0518190 secs]
161.959: [GC 711910K->462947K(1013632K), 0.0888430 secs]
163.230: [GC 742563K->491268K(1013632K), 0.0536170 secs]
164.262: [GC 770884K->527907K(1013632K), 0.0509550 secs]
164.314: [GC 533036K(1013632K), 0.0252000 secs]






command = 'java -Xms1024m -Xmx5120m -Xloggc:./gc.log -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:-CMSConcurrentMTEnabled -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -cp .:$CLASSPATH:' + env + " com.main.TestPutMain " + s_param + " &";

23.388: [GC 1003540K->114172K(1986432K), 0.0438290 secs]
26.656: [GC 1000252K->117471K(1986432K), 0.0348760 secs]
30.616: [GC 1003551K->117471K(1986432K), 0.0334760 secs]
34.437: [GC 1003551K->121938K(1986432K), 0.0437030 secs]
38.387: [GC 1008018K->113442K(1986432K), 0.0323420 secs]
41.926: [GC 999522K->115551K(1986432K), 0.0427290 secs]
45.848: [GC 1001631K->95527K(1986432K), 0.0257540 secs]
48.891: [GC 981607K->124898K(1986432K), 0.0428480 secs]
52.680: [GC 1010978K->125348K(1986432K), 0.0394130 secs]
56.048: [GC 1011428K->113931K(1986432K), 0.0351500 secs]
59.192: [GC 1000011K->123285K(1986432K), 0.0390520 secs]
62.859: [GC 1009365K->126388K(1986432K), 0.0430510 secs]
66.115: [GC 1012468K->129628K(1986432K), 0.0436500 secs]
70.504: [GC 1015708K->105813K(1986432K), 0.0252260 secs]
73.592: [GC 991893K->133996K(1986432K), 0.0422810 secs]
77.012: [GC 1020076K->120549K(1986432K), 0.0350600 secs]
80.438: [GC 1006629K->136949K(1986432K), 0.0368480 secs]
84.186: [GC 1023029K->136939K(1986432K), 0.0420170 secs]
87.876: [GC 1023019K->137058K(1986432K), 0.0324600 secs]
91.342: [GC 1023138K->142103K(1986432K), 0.0413330 secs]
95.298: [GC 1028183K->142276K(1986432K), 0.0363870 secs]
98.344: [GC 1028356K->145632K(1986432K), 0.0430510 secs]
102.034: [GC 1031712K->145700K(1986432K), 0.0431160 secs]
105.967: [GC 1031780K->145847K(1986432K), 0.0338770 secs]
109.033: [GC 1031927K->147971K(1986432K), 0.0416740 secs]
112.837: [GC 1034051K->148044K(1986432K), 0.0329330 secs]
117.054: [GC 1034124K->148045K(1986432K), 0.0362600 secs]
120.196: [GC 1034125K->149432K(1986432K), 0.0321850 secs]
123.391: [GC 1035512K->152552K(1986432K), 0.0374780 secs]
127.345: [GC 1038632K->155163K(1986432K), 0.0381490 secs]
130.790: [GC 1041243K->139197K(1986432K), 0.0390930 secs]
134.013: [GC 1025277K->155167K(1986432K), 0.0347510 secs]
138.301: [GC 1041247K->155437K(1986432K), 0.0337200 secs]
142.064: [GC 1041517K->155944K(1986432K), 0.0348150 secs]
145.773: [GC 1042024K->134984K(1986432K), 0.0271810 secs]
148.769: [GC 1021064K->155955K(1986432K), 0.0348990 secs]
152.167: [GC 1042035K->155974K(1986432K), 0.0390290 secs]
156.066: [GC 1042054K->156527K(1986432K), 0.0402920 secs]
159.344: [GC 1042607K->159278K(1986432K), 0.0456040 secs]
163.329: [GC 1045358K->159351K(1986432K), 0.0416740 secs]
166.767: [GC 1045431K->159587K(1986432K), 0.0388270 secs]
170.792: [GC 1045667K->160499K(1986432K), 0.0432570 secs]
174.255: [GC 1046579K->163091K(1986432K), 0.0379440 secs]
177.958: [GC 1049171K->163356K(1986432K), 0.0414280 secs]

2014-08-30 16:26:00,971  INFO [Thread-0] (ThreadPut.java:135) - 7878:10068ms:296995
2014-08-30 16:26:11,313  INFO [Thread-0] (ThreadPut.java:135) - 7878:10342ms:297001
2014-08-30 16:26:21,663  INFO [Thread-0] (ThreadPut.java:135) - 7878:10350ms:312575
2014-08-30 16:26:32,039  INFO [Thread-0] (ThreadPut.java:135) - 7878:10375ms:312941
2014-08-30 16:26:42,189  INFO [Thread-0] (ThreadPut.java:135) - 7878:10149ms:296997
2014-08-30 16:26:52,306  INFO [Thread-0] (ThreadPut.java:135) - 7878:10117ms:297012
2014-08-30 16:27:02,363  INFO [Thread-0] (ThreadPut.java:135) - 7878:10056ms:314533
2014-08-30 16:27:12,776  INFO [Thread-0] (ThreadPut.java:135) - 7878:10413ms:327593



command = 'java -Xms3072m -Xmx5120m -Xloggc:./gc.log -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:-CMSConcurrentMTEnabled -XX:CMSInitiatingOccupancyFraction=70 -XX:+CMSParallelRemarkEnabled -cp .:$CLASSPATH:' + env + " com.main.TestPutMain " + s_param + " &";


19.554: [GC 1004478K->118655K(1986432K), 0.0444130 secs]
23.008: [GC 1004735K->119577K(1986432K), 0.0359100 secs]
26.402: [GC 1005657K->123043K(1986432K), 0.0382160 secs]
30.078: [GC 1009123K->123059K(1986432K), 0.0334940 secs]
33.359: [GC 1009139K->123805K(1986432K), 0.0387100 secs]
37.264: [GC 1009885K->123834K(1986432K), 0.0494910 secs]
40.490: [GC 1009914K->107235K(1986432K), 0.0333450 secs]
44.039: [GC 993315K->124004K(1986432K), 0.0407870 secs]
47.589: [GC 1010084K->124658K(1986432K), 0.0476830 secs]
50.711: [GC 1010738K->129905K(1986432K), 0.0459380 secs]
55.213: [GC 1015985K->129991K(1986432K), 0.0313560 secs]
58.019: [GC 1016071K->133658K(1986432K), 0.0426260 secs]
62.103: [GC 1019738K->133717K(1986432K), 0.0306300 secs]
65.430: [GC 1019797K->136887K(1986432K), 0.0472240 secs]
68.938: [GC 1022967K->137439K(1986432K), 0.0404120 secs]
72.205: [GC 1023519K->139052K(1986432K), 0.0405220 secs]
75.943: [GC 1025132K->128005K(1986432K), 0.0405070 secs]
79.601: [GC 1014085K->140322K(1986432K), 0.0354120 secs]
83.389: [GC 1026402K->143230K(1986432K), 0.0423890 secs]
87.289: [GC 1029310K->143347K(1986432K), 0.0409320 secs]
90.746: [GC 1029427K->145106K(1986432K), 0.0371880 secs]
94.601: [GC 1031186K->145933K(1986432K), 0.0337910 secs]
97.912: [GC 1032013K->154233K(1986432K), 0.0486640 secs]
101.378: [GC 1040313K->159559K(1986432K), 0.0450200 secs]
105.137: [GC 1045639K->159647K(1986432K), 0.0373200 secs]
108.639: [GC 1045727K->162895K(1986432K), 0.0513160 secs]
112.605: [GC 1048975K->162951K(1986432K), 0.0319100 secs]
115.859: [GC 1049031K->165317K(1986432K), 0.0460230 secs]
119.758: [GC 1051397K->165629K(1986432K), 0.0343490 secs]
123.198: [GC 1051709K->167882K(1986432K), 0.0399640 secs]
126.461: [GC 1053962K->173100K(1986432K), 0.0434360 secs]
130.446: [GC 1059180K->173352K(1986432K), 0.0425300 secs]
133.434: [GC 1059432K->176941K(1986432K), 0.0451540 secs]
137.403: [GC 1063021K->176962K(1986432K), 0.0338310 secs]
140.807: [GC 1063042K->176651K(1986432K), 0.0364650 secs]


2014-08-30 16:35:38,269  INFO [Thread-0] (ThreadPut.java:135) - 7878:10003ms:296548
2014-08-30 16:35:48,368  INFO [Thread-0] (ThreadPut.java:135) - 7878:10099ms:296985
2014-08-30 16:35:58,369  INFO [Thread-0] (ThreadPut.java:135) - 7878:10001ms:288646
2014-08-30 16:36:08,388  INFO [Thread-0] (ThreadPut.java:135) - 7878:10019ms:305363
2014-08-30 16:36:18,396  INFO [Thread-0] (ThreadPut.java:135) - 7878:10006ms:281016
2014-08-30 16:36:28,872  INFO [Thread-0] (ThreadPut.java:135) - 7878:10476ms:312566
2014-08-30 16:36:39,054  INFO [Thread-0] (ThreadPut.java:135) - 7878:10180ms:312097
2014-08-30 16:36:49,093  INFO [Thread-0] (ThreadPut.java:135) - 7878:10038ms:315854

top - 16:37:22 up 10 days, 23:12,  5 users,  load average: 1.47, 1.90, 2.36
Tasks: 495 total,   1 running, 483 sleeping,  11 stopped,   0 zombie
Cpu(s): 12.2%us,  1.0%sy,  0.0%ni, 86.6%id,  0.0%wa,  0.0%hi,  0.2%si,  0.0%st
Mem:  65926660k total, 65091920k used,   834740k free,   199984k buffers
Swap:        0k total,        0k used,        0k free, 37557340k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND                                                                
23737 hbase     20   0 22.3g  19g  22m S 118.6 30.6   5096:30 java                                                                  
17020 root      20   0 8120m 1.2g  15m S 85.5  1.9   2:34.87 java                                                                   
23492 hdfs      20   0 6024m 1.4g  19m S  4.6  2.3 709:30.69 java                                                                   
15465 root      20   0 15296 1572  952 R  1.0  0.0   0:03.70 top                                                                    
24430 yarn      20   0 1729m 477m  18m S  1.0  0.7  27:32.52 java     



table.setWriteBufferSize  改为  10MB   10* 1024 * 1024

109.424: [GC 937241K->40830K(1986432K), 0.0154220 secs]
113.938: [GC 926910K->39815K(1986432K), 0.0134180 secs]
119.268: [GC 925895K->39760K(1986432K), 0.0149480 secs]
124.086: [GC 925840K->45609K(1986432K), 0.0183260 secs]
128.853: [GC 931689K->45776K(1986432K), 0.0127020 secs]
133.640: [GC 931856K->36666K(1986432K), 0.0149960 secs]
138.331: [GC 922746K->37925K(1986432K), 0.0184240 secs]
142.598: [GC 924005K->42044K(1986432K), 0.0204340 secs]
147.370: [GC 928124K->40247K(1986432K), 0.0184170 secs]
151.461: [GC 926327K->42263K(1986432K), 0.0158710 secs]
156.479: [GC 928343K->46986K(1986432K), 0.0215970 secs]
161.474: [GC 933063K->41421K(1986432K), 0.0185010 secs]
166.394: [GC 927501K->45286K(1986432K), 0.0154440 secs]
171.639: [GC 931366K->45894K(1986432K), 0.0138260 secs]
176.091: [GC 931974K->39625K(1986432K), 0.0196470 secs]
180.941: [GC 925705K->41005K(1986432K), 0.0205000 secs]
185.594: [GC 927085K->42363K(1986432K), 0.0207690 secs]
190.481: [GC 928443K->37955K(1986432K), 0.0195460 secs]
195.037: [GC 924035K->37387K(1986432K), 0.0185880 secs]
199.691: [GC 923467K->40540K(1986432K), 0.0137120 secs]
203.786: [GC 926620K->38058K(1986432K), 0.0133160 secs]
207.863: [GC 924138K->46795K(1986432K), 0.0172600 secs]
212.958: [GC 932875K->41202K(1986432K), 0.0140770 secs]
217.372: [GC 927282K->35125K(1986432K), 0.0194950 secs]
222.683: [GC 921205K->36588K(1986432K), 0.0127680 secs]
227.150: [GC 922668K->34897K(1986432K), 0.0212340 secs]
231.682: [GC 920977K->38054K(1986432K), 0.0251250 secs]
236.288: [GC 924134K->37814K(1986432K), 0.0206210 secs]
240.789: [GC 923894K->42021K(1986432K), 0.0169380 secs]
245.509: [GC 928101K->46977K(1986432K), 0.0172770 secs]
250.168: [GC 933057K->41194K(1986432K), 0.0156850 secs]
255.213: [GC 927274K->37622K(1986432K), 0.0258120 secs]
259.830: [GC 923702K->46222K(1986432K), 0.0137870 secs]


2014-08-30 16:52:50,591  INFO [Thread-0] (ThreadPut.java:141) - 7878:2 time=10009ms,second:326,num:236954
2014-08-30 16:53:00,630  INFO [Thread-0] (ThreadPut.java:141) - 7878:2 time=10038ms,second:124,num:227294
2014-08-30 16:53:10,711  INFO [Thread-0] (ThreadPut.java:141) - 7878:2 time=10081ms,second:191,num:216463
2014-08-30 16:53:20,712  INFO [Thread-0] (ThreadPut.java:141) - 7878:2 time=10001ms,second:0,num:227860
2014-08-30 16:53:30,952  INFO [Thread-0] (ThreadPut.java:141) - 7878:2 time=10239ms,second:320,num:236238
2014-08-30 16:53:41,007  INFO [Thread-0] (ThreadPut.java:141) - 7878:2 time=10054ms,second:120,num:216495
2014-08-30 16:53:51,113  INFO [Thread-0] (ThreadPut.java:141) - 7878:2 time=10105ms,second:245,num:231416


2014-08-30 16:53:51,113  INFO [Thread-0] (ThreadPut.java:141) - 7878:2 time=10105ms,second:245,num:231416
2014-08-30 16:54:01,198  INFO [Thread-0] (ThreadPut.java:141) - 7878:2 time=10085ms,second:151,num:247236
2014-08-30 16:54:11,241  INFO [Thread-0] (ThreadPut.java:141) - 7878:2 time=10043ms,second:142,num:232325
2014-08-30 16:54:21,242  INFO [Thread-0] (ThreadPut.java:141) - 7878:2 time=10001ms,second:0,num:223376
2014-08-30 16:54:31,273  INFO [Thread-0] (ThreadPut.java:141) - 7878:2 time=10030ms,second:172,num:214496







一个 jvm  中 起 2个 入库 的线程  

2014-08-30 17:45:36,646  INFO [Thread-1] (ThreadPut2.java:171) - 7878:2 time=10040ms,second:440,num:180632
2014-08-30 17:45:36,827  INFO [Thread-0] (ThreadPut2.java:171) - 7878:2 time=10219ms,second:262,num:180956
2014-08-30 17:45:46,716  INFO [Thread-1] (ThreadPut2.java:171) - 7878:2 time=10069ms,second:156,num:259287
2014-08-30 17:45:47,024  INFO [Thread-0] (ThreadPut2.java:171) - 7878:2 time=10195ms,second:268,num:258756
2014-08-30 17:45:56,891  INFO [Thread-1] (ThreadPut2.java:171) - 7878:2 time=10174ms,second:631,num:266657
2014-08-30 17:45:57,105  INFO [Thread-0] (ThreadPut2.java:171) - 7878:2 time=10081ms,second:432,num:257180
2014-08-30 17:46:06,967  INFO [Thread-1] (ThreadPut2.java:171) - 7878:2 time=10075ms,second:305,num:259286


2014-08-30 17:49:09,167  INFO [Thread-1] (ThreadPut2.java:171) - 7878:2 time=10001ms,second:0,num:249693
2014-08-30 17:49:09,383  INFO [Thread-0] (ThreadPut2.java:171) - 7878:2 time=10068ms,second:579,num:260063
2014-08-30 17:49:19,208  INFO [Thread-1] (ThreadPut2.java:171) - 7878:2 time=10040ms,second:206,num:235876
2014-08-30 17:49:19,384  INFO [Thread-0] (ThreadPut2.java:171) - 7878:2 time=10001ms,second:0,num:262998
2014-08-30 17:49:29,398  INFO [Thread-1] (ThreadPut2.java:171) - 7878:2 time=10189ms,second:501,num:247520
2014-08-30 17:49:29,413  INFO [Thread-0] (ThreadPut2.java:171) - 7878:2 time=10029ms,second:119,num:262951
2014-08-30 17:49:39,400  INFO [Thread-1] (ThreadPut2.java:171) - 7878:2 time=10001ms,second:0,num:238278
2014-08-30 17:49:39,510  INFO [Thread-0] (ThreadPut2.java:171) - 7878:2 time=10095ms,second:372,num:247242


开启 3个 入库 线程

2014-08-30 17:57:47,908  INFO [Thread-1] (ThreadPut2.java:171) - 7878:14000701070,2 time=10001ms,second:1,num:251387
2014-08-30 17:57:48,093  INFO [Thread-2] (ThreadPut2.java:171) - 7878:16000661867,2 time=10070ms,second:0,num:222155
2014-08-30 17:57:57,813  INFO [Thread-0] (ThreadPut2.java:171) - 7878:10000904037,2 time=10130ms,second:321,num:216572
2014-08-30 17:57:57,991  INFO [Thread-1] (ThreadPut2.java:171) - 7878:14000934971,2 time=10082ms,second:348,num:233901
2014-08-30 17:57:58,275  INFO [Thread-2] (ThreadPut2.java:171) - 7878:16000892255,2 time=10181ms,second:469,num:230388
2014-08-30 17:58:07,933  INFO [Thread-0] (ThreadPut2.java:171) - 7878:10001151522,2 time=10119ms,second:229,num:247485
2014-08-30 17:58:08,120  INFO [Thread-1] (ThreadPut2.java:171) - 7878:14001191896,2 time=10127ms,second:395,num:256925


2014-08-30 18:01:00,540  INFO [Thread-2] (ThreadPut2.java:171) - 7878:16005151951,2 time=10091ms,second:550,num:224203
2014-08-30 18:01:00,672  INFO [Thread-1] (ThreadPut2.java:171) - 7878:14005119427,2 time=10240ms,second:262,num:206288
2014-08-30 18:01:10,525  INFO [Thread-0] (ThreadPut2.java:171) - 7878:10005327926,2 time=10019ms,second:139,num:247511
2014-08-30 18:01:10,687  INFO [Thread-1] (ThreadPut2.java:171) - 7878:14005346278,2 time=10015ms,second:148,num:226851
2014-08-30 18:01:10,995  INFO [Thread-2] (ThreadPut2.java:171) - 7878:16005390055,2 time=10454ms,second:578,num:238104
2014-08-30 18:01:20,526  INFO [Thread-0] (ThreadPut2.java:171) - 7878:10005546819,2 time=10001ms,second:0,num:218893
2014-08-30 18:01:21,034  INFO [Thread-1] (ThreadPut2.java:171) - 7878:14005584055,2 time=10346ms,second:421,num:237777
2014-08-30 18:01:21,107  INFO [Thread-2] (ThreadPut2.java:171) - 7878:16005616022,2 time=10111ms,second:304,num:225967
2014-08-30 18:01:30,734  INFO [Thread-0] (ThreadPut2.java:171) - 7878:10005780227,2 time=10206ms,second:337,num:233408
2014-08-30 18:01:31,109  INFO [Thread-2] (ThreadPut2.java:171) - 7878:16005842872,2 time=10001ms,second:1,num:226850
2014-08-30 18:01:31,171  INFO [Thread-1] (ThreadPut2.java:171) - 7878:14005800617,2 time=10137ms,second:355,num:216562
2014-08-30 18:01:40,735  INFO [Thread-0] (ThreadPut2.java:171) - 7878:10006027264,2 time=10001ms,second:0,num:247037
2014-08-30 18:01:41,175  INFO [Thread-2] (ThreadPut2.java:171) - 7878:16006070109,2 time=10065ms,second:237,num:227237
2014-08-30 18:01:41,364  INFO [Thread-1] (ThreadPut2.java:171) - 7878:14006038160,2 time=10193ms,second:660,num:237543
2014-08-30 18:01:50,745  INFO [Thread-0] (ThreadPut2.java:171) - 7878:10006265502,2 time=10008ms,second:442,num:238238
2014-08-30 18:01:51,265  INFO [Thread-2] (ThreadPut2.java:171) - 7878:16006306395,2 time=10089ms,second:576,num:236286






---------------2个进程   (每个进程 2.4W/S )
02:26:36 PM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s
02:26:38 PM        lo   1261.26   1261.26  11818.91  11818.91      0.00      0.00      0.00
02:26:38 PM      eth0      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:26:38 PM      eth1      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:26:38 PM      eth2  20286.91   3398.95  30031.53    232.35      0.00      0.00      8.90
02:26:38 PM      eth3  29440.31  28051.83  34706.40  35262.28      0.00      0.00      5.24

02:26:38 PM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s
02:26:40 PM        lo   2181.87   2181.87  22947.38  22947.38      0.00      0.00      0.00
02:26:40 PM      eth0      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:26:40 PM      eth1      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:26:40 PM      eth2  16481.35   2711.40  24402.29    185.35      0.00      0.00      5.70
02:26:40 PM      eth3  22922.80  33722.80  22687.43  44886.70      0.00      0.00     22.80

02:26:40 PM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s
02:26:42 PM        lo   1047.64   1047.64   6449.73   6449.73      0.00      0.00      0.00
02:26:42 PM      eth0      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:26:42 PM      eth1      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:26:42 PM      eth2  26795.29   4627.23  39644.70    316.32      0.00      0.00     26.18
02:26:42 PM      eth3  17359.16  23874.35  18106.30  31855.28      0.00      0.00      9.42

02:26:42 PM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s
02:26:44 PM        lo   1050.00   1050.00   5593.87   5593.87      0.00      0.00      0.00
02:26:44 PM      eth0      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:26:44 PM      eth1      0.00      0.00      0.00      0.00      0.00      0.00      0.00
02:26:44 PM      eth2  23649.47   3907.89  35021.17    267.14      0.00      0.00      6.32
02:26:44 PM      eth3  22953.16  30391.58  23208.92  39370.30      0.00      0.00      5.79

www.htsjk.Com true http://www.htsjk.com/hbase/35939.html NewsArticle hbase入库速度测试,hbase速度测试 自己做的一个hbase性能测试。从测试结果来看,入大数据应该启动多个线程,多个线程间不要共用hbase连接,如果多个线程使用一个hbase连接,一个hbas...
相关文章
    暂无相关文章
评论暂时关闭