Skip to main content
Version: 3.2.x

Twitter Firehose source connector

note

You can download all the Pulsar connectors on download page.

The Twitter Firehose source connector receives tweets from Twitter Firehose and writes the tweets to Pulsar topics.

Configuration

The configuration of the Twitter Firehose source connector has the following properties.

Property

NameTypeRequiredDefaultDescription
consumerKeyStringtrue" " (empty string)The twitter OAuth consumer key.

For more information, see Access tokens.
consumerSecretStringtrue" " (empty string)The twitter OAuth consumer secret.
tokenStringtrue" " (empty string)The twitter OAuth token.
tokenSecretStringtrue" " (empty string)The twitter OAuth secret.
guestimateTweetTimeBooleanfalsefalseMost firehose events have null createdAt time.

If guestimateTweetTime set to true, the connector estimates the createdTime of each firehose event to be current time.
clientNameStringfalseopenconnector-twitter-sourceThe twitter firehose client name.
clientHostsStringfalseConstants.STREAM_HOSTThe twitter firehose hosts to which client connects.
clientBufferSizeintfalse50000The buffer size for buffering tweets fetched from twitter firehose.

For more information about OAuth credentials, see Twitter developers portal.