The tap-feed Meltano extractor pulls data from Feed that can then be sent to a destination using a loader.

Getting Started #

Prerequisites #

If you haven't already, follow the initial steps of the Getting Started guide:

  1. Install Meltano
  2. Create your Meltano project

Installation and configuration #

Using the Command Line Interface #

  1. Add the tap-feed extractor to your project using meltano add : 

    meltano add extractor tap-feed
  2. Configure the settings below using meltano config .

Next steps #

Follow the remaining steps of the Getting Started guide:

  1. Select entities and attributes to extract
  2. Add a loader to send data to a destination
  3. Run a data integration (EL) pipeline

If you run into any issues, learn how to get help.

Capabilities #

Settings #

tap-feed requires the configuration of the following settings:

These and other supported settings are documented below. To quickly find the setting you're looking for, use the Table of Contents at the top of the page.

Feed Urls (feed_urls) #

A list of one or more feed paths.

How to use #

Manage this setting using meltano config or an environment variable: 

meltano config tap-feed set feed_urls '[...]'

export TAP_FEED_FEED_URLS='[...]'

Feed Fields (feed_fields) #

A list of feed level data fields to capture.

How to use #

Manage this setting using meltano config or an environment variable: 

meltano config tap-feed set feed_fields '[...]'

export TAP_FEED_FEED_FIELDS='[...]'

Feed Entry Fields (feed_entry_fields) #

A list of entry level data fields to capture.

How to use #

Manage this setting using meltano config or an environment variable: 

meltano config tap-feed set feed_entry_fields '[...]'

export TAP_FEED_FEED_ENTRY_FIELDS='[...]'

Feed Entry Replication Key (feed_entry_replication_key) #

The field used to determine new records, typically ‘published’ or ‘updated’.

How to use #

Manage this setting using meltano config or an environment variable: 

meltano config tap-feed set feed_entry_replication_key <feed_entry_replication_key>

export TAP_FEED_FEED_ENTRY_REPLICATION_KEY=<feed_entry_replication_key>

Start Date (start_date) #

The earliest record date to sync.

How to use #

Manage this setting using meltano config or an environment variable: 

meltano config tap-feed set start_date YYYY-MM-DDTHH:MM:SSZ

export TAP_FEED_START_DATE=YYYY-MM-DDTHH:MM:SSZ

Looking for help? #

If you're having trouble getting the tap-feed extractor to work, look for an existing issue in its repository, file a new issue, or join the Meltano Slack community and ask for help in the #plugins-general channel.

Found an issue on this page? #

This page is generated from a YAML file that you can contribute changes to. Edit it on GitHub!