HBase sink connector

note

You can download all the Pulsar connectors on download page.

The HBase sink connector pulls the messages from Pulsar topics and persists the messages to HBase tables

Configuration

The configuration of the HBase sink connector has the following properties.

Property

Name	Type	Default	Required	Description
hbaseConfigResources	String	None	false	HBase system configuration hbase-site.xml file.
zookeeperQuorum	String	None	true	HBase system configuration about hbase.zookeeper.quorum value.
zookeeperClientPort	String	2181	false	HBase system configuration about hbase.zookeeper.property.clientPort value.
zookeeperZnodeParent	String	/hbase	false	HBase system configuration about zookeeper.znode.parent value.
tableName	None	String	true	HBase table, the value is namespace:tableName.
rowKeyName	String	None	true	HBase table rowkey name.
familyName	String	None	true	HBase table column family name.
qualifierNames	String	None	true	HBase table column qualifier names.
batchTimeMs	Long	1000l	false	HBase table operation timeout in milliseconds.
batchSize	int	200	false	Batch size of updates made to the HBase table.

Example

Before using the HBase sink connector, you need to create a configuration file through one of the following methods.

• JSON

  {
     "configs": {
        "hbaseConfigResources": "hbase-site.xml",
        "zookeeperQuorum": "localhost",
        "zookeeperClientPort": "2181",
        "zookeeperZnodeParent": "/hbase",
        "tableName": "pulsar_hbase",
        "rowKeyName": "rowKey",
        "familyName": "info",
        "qualifierNames": [ 'name', 'address', 'age']
     }
  }

• YAML

  configs:
      hbaseConfigResources: "hbase-site.xml"
      zookeeperQuorum: "localhost"
      zookeeperClientPort: "2181"
      zookeeperZnodeParent: "/hbase"
      tableName: "pulsar_hbase"
      rowKeyName: "rowKey"
      familyName: "info"
      qualifierNames: [ 'name', 'address', 'age']