AWS SSO integrates with AWS Organizations to manage access to all the AWS accounts under the organization. Amazon Redshift, a fast, fully managed cloud data warehouse, provides browser-based plugins for JDBC/ODBC drivers, which helps you easily implement identity federation capabilities added with multi-factor authentication (MFA) to secure your data warehouse, and also helps automation and enforcement of data access policies across the organization.ĪWS Single Sign-On (AWS SSO) provides tools to federate access to users to the AWS environment. ![]() Managing database users through identity federation allows you to manage authentication and authorization procedures centrally. autocommit is off by default in redshift_connector, but we've changed this default to True to ensure certain macros run successfully in your dbt project.July 2023: This post was reviewed for accuracy. Connection objects used in Python must have autocommit = True to run operations such as CREATE DATABASE, and VACUUM. The autocommit mode is useful to execute commands that run outside a transaction. When a connection is made using verify-ca, will look for the CA certificate in ~/redshift-ca-bundle.crt.įor more details on sslmode changes, our design choices, and reasoning - please refer to the PR pertaining to this change. The table below details accepted sslmode parameters and how the connection will be made according to each option: sslmode parameterĬonnection will be made without using sslĬonnection will be made using verify-full We've added conversion logic mapping each of psycopg2's accepted sslmode values to the corresponding ssl and sslmode parameters in redshift_connector. In dbt-redshift 1.5, we switched to using redshift_connector, which accepts verify-ca, and verify-full as valid sslmode inputs, and has a ssl parameter of True or False, according to redshift doc.įor backward compatibility, dbt-redshift now supports valid inputs for sslmode in psycopg2. psycopg2 accepts disable, prefer, allow, require, verify-ca, verify-full as valid inputs of sslmode, and does not have an ssl parameter, as indicated in PostgreSQL doc. When the iam_profile configuration is set, dbt will use the specified profile from your ~/.aws/config file instead of using the profile name default Redshift notes sslmode change īefore to dbt-redshift 1.5, psycopg2 was used as the driver. Profile fieldĭbt will use the specified profile from your ~/.aws/config file Please refer to the official AWS documentation on Configuration and credential file settings. Try runningĪws configure to set up AWS access keys, and pick a default region. If you receive the "You must specify a region" error when using IAMĪuthentication, then your aws credentials are likely misconfigured. ![]() On generating user credentials with IAM Auth. For more information on this type of authentication, Note that a password is not required when using IAM Authentication. To set up a Redshift profile using IAM Authentication, set the method parameter to iam as shown below. The following table lists the authentication parameters to use IAM authentication. Each tab also includes an example profiles.yml configuration file for you to review. database - Password-based authentication (default, will be used if method is not provided)Ĭlick on one of these authentication methods for further details on how to configure your connection profile.The authentication methods that dbt Core supports are: A list of existing database group names that the DbUser joins for the current session Optional, user identifier of the current session For more information on sslmode, see Redshift note below ![]() Default prefer, which will use 'verify-ca' to connect. Optional, set the sslmode to connect to the database. ![]() Number of seconds before connection times out The type of data warehouse you are connecting to Configuring dbt-redshiftįor Redshift-specific configuration, refer to Redshift Configuration.įor further info, refer to the GitHub repository: dbt-labs/dbt-redshift. Installing dbt-redshift will also install dbt-core and any other dependencies. Pip is the easiest way to install the adapter: pip install dbt-redshift Supported dbt Core version: v0.10.0 and newer.To connect your data platform to dbt Cloud, refer to About data platforms. If you're using dbt Cloud, you don't need to create a profiles.yml file.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |