Selly-Modules
/
dbt-selly-express
8
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
6 Commits 1 Branch 0 Tags 47 KiB
Makefile 100%
Go to file
Ubuntu 4888638b16 update 2022-05-30 10:25:32 +07:00
macros update 2022-05-12 10:27:31 +07:00
models/generated remove field 'to' and 'courier' 2022-03-21 21:12:40 +07:00
Makefile init 2022-03-21 21:00:47 +07:00
README.md init 2022-03-21 21:00:47 +07:00
dbt_project.yml update 2022-05-30 10:25:32 +07:00
destination_catalog.json update 2022-05-12 10:27:31 +07:00
destination_config.json init 2022-03-21 21:00:47 +07:00
packages.yml update 2022-05-12 10:27:31 +07:00
profiles.yml init 2022-03-21 21:00:47 +07:00

README.md

Installing dbt

  1. Activate your venv and run pip3 install dbt
  2. Copy airbyte-normalization/sample_files/profiles.yml over to ~/.dbt/profiles.yml
  3. Edit to configure your profiles accordingly

Running dbt

  1. cd airbyte-normalization
  2. You can now run dbt commands, to check the setup is fine: dbt debug
  3. To build the dbt tables in your warehouse: dbt run

Running dbt from Airbyte generated config

  1. You can also change directory (cd /tmp/dev_root/workspace/1/0/normalize for example) to one of the workspace generated by Airbyte within one of the normalize folder.
  2. You should find profiles.yml and a bunch of other dbt files/folders created there.
  3. To check everything is setup properly: dbt debug --profiles-dir=$(pwd) --project-dir=$(pwd)
  4. You can modify the .sql files and run dbt run --profiles-dir=$(pwd) --project-dir=$(pwd) too
  5. You can inspect compiled dbt .sql files before they are run in the destination engine in normalize/build/compiled or normalize/build/run folders