Skip to main content

Flume source connector

note

You can download all the Pulsar connectors on download page.

The Flume source connector pulls messages from logs to Pulsar topics.

Configuration

The configuration of the Flume source connector has the following properties.

Property

NameTypeRequiredDefaultDescription
nameStringtrue"" (empty string)The name of the agent.
confFileStringtrue"" (empty string)The configuration file.
noReloadConfBooleanfalsefalseWhether to reload configuration file if changed.
zkConnStringStringtrue"" (empty string)The ZooKeeper connection.
zkBasePathStringtrue"" (empty string)The base path in ZooKeeper for agent configuration.

Example

Before using the Flume source connector, you need to create a configuration file through one of the following methods.

For more information about the source.conf in the example below, see here.

  • JSON

    {
    "configs": {
    "name": "a1",
    "confFile": "source.conf",
    "noReloadConf": "false",
    "zkConnString": "",
    "zkBasePath": ""
    }
    }
  • YAML

    configs:
    name: a1
    confFile: source.conf
    noReloadConf: false
    zkConnString: ""
    zkBasePath: ""