HBase sink connector

The HBase sink connector pulls the messages from Pulsar topics and persists the messages to HBase tables

Configuration

The configuration of the HBase sink connector has the following properties.

Property

| Name | Type|Default | Required | Description | |------|---------|----------|-------------| | hbaseConfigResources | String|None | false | HBase system configuration hbase-site.xml file. | | zookeeperQuorum | String|None | true | HBase system configuration about hbase.zookeeper.quorum value. | | zookeeperClientPort | String|2181 | false | HBase system configuration about hbase.zookeeper.property.clientPort value. | | zookeeperZnodeParent | String|/hbase | false | HBase system configuration about zookeeper.znode.parent value. | | tableName | None |String | true | HBase table, the value is namespace:tableName. | | rowKeyName | String|None | true | HBase table rowkey name. | | familyName | String|None | true | HBase table column family name. | | qualifierNames |String| None | true | HBase table column qualifier names. | | batchTimeMs | Long|1000l| false | HBase table operation timeout in milliseconds. | | batchSize | int|200| false | Batch size of updates made to the HBase table. |

Example

Before using the HBase sink connector, you need to create a configuration file through one of the following methods.

• JSON

  
  {
      "hbaseConfigResources": "hbase-site.xml",
      "zookeeperQuorum": "localhost",
      "zookeeperClientPort": "2181",
      "zookeeperZnodeParent": "/hbase",
      "tableName": "pulsar_hbase",
      "rowKeyName": "rowKey",
      "familyName": "info",
      "qualifierNames": [ 'name', 'address', 'age']
  }
  

• YAML

  
  configs:
      hbaseConfigResources: "hbase-site.xml"
      zookeeperQuorum: "localhost"
      zookeeperClientPort: "2181"
      zookeeperZnodeParent: "/hbase"
      tableName: "pulsar_hbase"
      rowKeyName: "rowKey"
      familyName: "info"
      qualifierNames: [ 'name', 'address', 'age']