Skip to main content

HBase sink connector

note

You can download all the Pulsar connectors on download page.

The HBase sink connector pulls the messages from Pulsar topics and persists the messages to HBase tables

Configuration​

The configuration of the HBase sink connector has the following properties.

Property​

NameTypeDefaultRequiredDescription
hbaseConfigResourcesStringNonefalseHBase system configuration hbase-site.xml file.
zookeeperQuorumStringNonetrueHBase system configuration about hbase.zookeeper.quorum value.
zookeeperClientPortString2181falseHBase system configuration about hbase.zookeeper.property.clientPort value.
zookeeperZnodeParentString/hbasefalseHBase system configuration about zookeeper.znode.parent value.
tableNameNoneStringtrueHBase table, the value is namespace:tableName.
rowKeyNameStringNonetrueHBase table rowkey name.
familyNameStringNonetrueHBase table column family name.
qualifierNamesStringNonetrueHBase table column qualifier names.
batchTimeMsLong1000lfalseHBase table operation timeout in milliseconds.
batchSizeint200falseBatch size of updates made to the HBase table.

Example​

Before using the HBase sink connector, you need to create a configuration file through one of the following methods.

  • JSON

    {
    "configs": {
    "hbaseConfigResources": "hbase-site.xml",
    "zookeeperQuorum": "localhost",
    "zookeeperClientPort": "2181",
    "zookeeperZnodeParent": "/hbase",
    "tableName": "pulsar_hbase",
    "rowKeyName": "rowKey",
    "familyName": "info",
    "qualifierNames": [ 'name', 'address', 'age']
    }
    }
  • YAML

    configs:
    hbaseConfigResources: "hbase-site.xml"
    zookeeperQuorum: "localhost"
    zookeeperClientPort: "2181"
    zookeeperZnodeParent: "/hbase"
    tableName: "pulsar_hbase"
    rowKeyName: "rowKey"
    familyName: "info"
    qualifierNames: [ 'name', 'address', 'age']