Skip to main content

Twitter Firehose source connector

The Twitter Firehose source connector receives tweets from Twitter Firehose and writes the tweets to Pulsar topics.

Configuration​

The configuration of the Twitter Firehose source connector has the following properties.

Property​

NameTypeRequiredDefaultDescription
consumerKeyStringtrue" " (empty string)The twitter OAuth consumer key.

For more information, see Access tokens.
consumerSecretStringtrue" " (empty string)The twitter OAuth consumer secret.
tokenStringtrue" " (empty string)The twitter OAuth token.
tokenSecretStringtrue" " (empty string)The twitter OAuth secret.
guestimateTweetTimeBooleanfalsefalseMost firehose events have null createdAt time.

If guestimateTweetTime set to true, the connector estimates the createdTime of each firehose event to be current time.
clientNameStringfalseopenconnector-twitter-sourceThe twitter firehose client name.
clientHostsStringfalseConstants.STREAM_HOSTThe twitter firehose hosts to which client connects.
clientBufferSizeintfalse50000The buffer size for buffering tweets fetched from twitter firehose.

For more information about OAuth credentials, see Twitter developers portal.