Selly-Modules
/
dbt-selly
8
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10 Commits 6 Branches 0 Tags 26 MiB
Makefile 100%
Go to file
Ubuntu 1604aa8c9c updat 2022-04-20 06:50:28 +07:00
macros update 2022-04-13 14:06:23 +07:00
models/generated updat 2022-04-20 06:50:28 +07:00
README.md init 2022-03-22 11:03:52 +07:00
dbt_project.yml update 2022-04-13 14:06:23 +07:00
destination_catalog.json update 2022-04-19 17:27:57 +07:00
destination_config.json update 2022-04-13 14:06:23 +07:00
packages.yml update 2022-04-13 14:06:23 +07:00
profiles.yml update 2022-04-13 14:06:23 +07:00

README.md

Installing dbt

  1. Activate your venv and run pip3 install dbt
  2. Copy airbyte-normalization/sample_files/profiles.yml over to ~/.dbt/profiles.yml
  3. Edit to configure your profiles accordingly

Running dbt

  1. cd airbyte-normalization
  2. You can now run dbt commands, to check the setup is fine: dbt debug
  3. To build the dbt tables in your warehouse: dbt run

Running dbt from Airbyte generated config

  1. You can also change directory (cd /tmp/dev_root/workspace/1/0/normalize for example) to one of the workspace generated by Airbyte within one of the normalize folder.
  2. You should find profiles.yml and a bunch of other dbt files/folders created there.
  3. To check everything is setup properly: dbt debug --profiles-dir=$(pwd) --project-dir=$(pwd)
  4. You can modify the .sql files and run dbt run --profiles-dir=$(pwd) --project-dir=$(pwd) too
  5. You can inspect compiled dbt .sql files before they are run in the destination engine in normalize/build/compiled or normalize/build/run folders