The models within this folder (barring those in models/audit_schema_tests) represent a dbt project with poor DAG modeling. Error detection tools within this package are tested on this dbt project.

Adding an Integration Test

Create a seed which matches the intended output of your model and add equality tests comparing the output to your seed to the output of your model.

Local tests

AWS Athena

To run tests locally, please follow instructions:

Set up environment variables:

ATHENA_S3_STAGING_DIR=
ATHENA_S3_DATA_DIR=
ATHENA_REGION=
ATHENA_SCHEMA=
ATHENA_WORKGROUP=

Add profiles.yml file based on sample:

    athena: # for local tests only
      type: athena
      s3_staging_dir: {{ env_var('ATHENA_S3_STAGING_DIR') }}
      s3_data_dir: {{ env_var('ATHENA_S3_DATA_DIR') }}
      s3_data_naming: schema_table_unique
      region_name: {{ env_var('ATHENA_REGION') }}
      schema: {{ env_var('ATHENA_SCHEMA') }}
      database: awsdatacatalog
      work_group: {{ env_var('ATHENA_WORKGROUP') }}
      num_retries: 2
      threads: 4

Now you can run integration tests, see details here with --target athena flag for dbt commands.