The target-postgres Singer target sends data into PostgreSQL after it was pulled from a source using a Singer tap.

Alternative variants #

Multiple variants of target-postgres are available. This document describes the meltano variant.

Alternative variants are:

Standalone usage #

Install the package using pip: 

pip install git+https://github.com/meltano/target-postgres.git

For additional instructions, refer to the README in the repository.

Usage with Meltano #

Meltano helps you manage your configuration, incremental replication, and scheduled pipelines.

View the Meltano-specific target-postgres instructions to learn more.

Capabilities #

Settings #

target-postgres requires the configuration of one of the following groups of settings:

These and other supported settings are documented below. To quickly find the setting you're looking for, use the Table of Contents at the top of the page.

User (user) #

  • Default: warehouse

Password (password) #

  • Default: warehouse

Host (host) #

  • Default: localhost

Port (port) #

  • Default: 5502

Database Name (dbname) #

  • Default: warehouse

URL (url) #

Lets you set user, password, host, port, and dbname in one go using a postgresql:// URI.

Takes precedence over the other settings when set.

Schema (schema) #

  • Default: $MELTANO_EXTRACT__LOAD_SCHEMA

Note that $MELTANO_EXTRACT__LOAD_SCHEMA will expand to the value of the load_schema extra for the extractor used in the pipeline, which defaults to the extractor’s namespace, e.g. tap_gitlab for tap-gitlab.

Name of the schema where the tables will be created. If schema_mapping is not defined then every stream sent by the tap is loaded into this schema.

Troubleshooting #

ld, clang, lssl, or linker Errors #

If you have an error message like:

  • ld: library not found for -lssl
  • clang: error: linker command failed with exit code 1
  • error: command 'clang' failed with exit status 1

These error messages indicates that there is a problem installing OpenSSL.

This Stack Overflow answer has specific recommendations on setting the LDFLAGS and/or CPPFLAGS environment variables. Set those prior to running meltano add loader target-postgres.

Looking for help? #

If you're having trouble getting the target-postgres target to work, look for an existing issue in its repository, file a new issue, or join the Meltano Slack community and ask for help in the #plugins-general channel.

Found an issue on this page? #

This page is generated from a YAML file that you can contribute changes to. Edit it on GitHub!