Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dev: reflekt 0.6.0 #105

Merged
merged 63 commits into from
Mar 3, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
63 commits
Select commit Hold shift + click to select a range
fcb0913
add --registry arg to reflekt pull
GClunies Jan 20, 2024
8435e31
update args for CLI report, lint, build commands
GClunies Jan 20, 2024
007e424
cleanup constants.py
GClunies Jan 20, 2024
19f318d
Use `Annotated[...]` CLI options. Handle `reflekt pull --registry seg…
GClunies Jan 31, 2024
2826de5
cleanup comment and error msg
GClunies Feb 4, 2024
1ea6580
Add segment CDP logic to send_events.py
GClunies Feb 10, 2024
30f79e7
schemas/jaffle_shop
GClunies Feb 10, 2024
6c5558d
update meta-schema description
GClunies Feb 10, 2024
0d5118d
update jaffle_shop schemas
GClunies Feb 16, 2024
99b866f
update checkout step data type
GClunies Feb 16, 2024
7e6f1ed
add cart_id to `page Viewed` schema
GClunies Feb 16, 2024
8d243fd
rename project to jaffle_shop for demo. run reflekt build
GClunies Feb 19, 2024
e98eb70
getdate(), not get_date()
GClunies Feb 19, 2024
aa0838b
remove main() docstring so it does not show when running `reflekt --h…
GClunies Feb 19, 2024
5d5c719
Removed Annotated from Typer CLI options (has bug)
GClunies Feb 19, 2024
28d5dd9
update default profile
GClunies Feb 19, 2024
0e22d5e
add BigQuery warehouse support
GClunies Feb 19, 2024
e4199a2
repo cleanup for 0.6.0
GClunies Feb 19, 2024
004e02c
delete .flake8 (not used)
GClunies Feb 19, 2024
6ccf00d
fix: `reflekt report` setting optional properties as required
GClunies Feb 20, 2024
1bf02ac
remove .md reports (not needed)
GClunies Feb 20, 2024
d37d6bc
bump version
GClunies Feb 20, 2024
fb98c30
cleanup report docs and error msg
GClunies Feb 20, 2024
70ee023
reflekt build
GClunies Feb 20, 2024
3900d55
update Makefile and CHANGELOG
GClunies Feb 20, 2024
c64455d
update CHANGELOG
GClunies Feb 20, 2024
70385ce
add pyarrow as dep
GClunies Feb 20, 2024
a3971ed
update workflow
GClunies Feb 20, 2024
86ab583
update venv
GClunies Feb 20, 2024
5c3ff9f
update workflow
GClunies Feb 20, 2024
cbd38c9
update workflow
GClunies Feb 20, 2024
cd55cfc
update poetry venv
GClunies Feb 20, 2024
6790c9e
update workflow
GClunies Feb 20, 2024
7dccfd2
add pyarrow dep
GClunies Feb 20, 2024
aab9878
update workflow
GClunies Feb 20, 2024
1e7fca9
update workflow
GClunies Feb 20, 2024
904c9ed
update workflow
GClunies Feb 20, 2024
a1ec226
update workflow
GClunies Feb 20, 2024
dc5f3ce
update workflow
GClunies Feb 20, 2024
da6a2af
update workflow
GClunies Feb 20, 2024
a527de1
update poetry venv
GClunies Feb 20, 2024
2769b7a
update tests, CI debugging
GClunies Feb 20, 2024
bea8bb8
clean pyproject.toml
GClunies Feb 20, 2024
a45ed64
clean pyproject.toml
GClunies Feb 20, 2024
83aa959
clean workflow
GClunies Feb 20, 2024
7cb5081
update internal profile validation JSON
GClunies Feb 20, 2024
d9effab
update dev dependencies
GClunies Feb 20, 2024
806ae6b
removed whitespace when logging to terminal. Update docs
GClunies Feb 20, 2024
bf8e77e
update README
GClunies Feb 20, 2024
4efc935
update README
GClunies Feb 20, 2024
3d8d66b
remove unused import
GClunies Feb 20, 2024
cb20176
add reuse as dev dep
GClunies Feb 20, 2024
da33b79
WIP - new README
GClunies Feb 21, 2024
12fec27
update README
GClunies Feb 21, 2024
63c7ea2
update README
GClunies Feb 21, 2024
fe2a230
update README
GClunies Feb 21, 2024
f81fedf
add reflekt build GIF to README
GClunies Feb 22, 2024
4e9030c
update README
GClunies Feb 22, 2024
8a9be6d
update README
GClunies Feb 22, 2024
e86b08e
update README
GClunies Feb 22, 2024
027072d
add docs/ to .reuse/dep5
GClunies Feb 22, 2024
20e2f61
update README
GClunies Feb 22, 2024
ecb5f37
update README
GClunies Feb 22, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 0 additions & 7 deletions .flake8

This file was deleted.

101 changes: 101 additions & 0 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,101 @@
# SPDX-FileCopyrightText: 2022 Gregory Clunies <[email protected]>
#
# SPDX-License-Identifier: Apache-2.0

name: CI

on:
push:
branches: ["main"]
tags: ["*"]
pull_request:
branches: ["main"]

jobs:

lint:
name: Lint (${{ matrix.python-version }}, ${{ matrix.os }})
strategy:
fail-fast: true
matrix:
os: ['ubuntu-latest']
python-version: ['3.11'] # Lint only needs to run once
runs-on: ${{ matrix.os }}
steps:
- name: Checkout Repo
uses: actions/checkout@v4

- name: Install Python
uses: actions/setup-python@v4
id: setup-python
with:
python-version: ${{ matrix.python-version }}

# NOTE: If `Install Poetry` is run before `Install Python`, poetry will be
# installed in the wrong python version and fails. Unfortunately, the,
# this means we cannot cache the poetry venv between jobs ... but it does not take
# long to install poetry and the dependencies, so it's not a big deal.
- name: Install Poetry
run: pipx install poetry

- name: Poetry Install Dependencies
run: poetry install

- name: Lint
run: poetry run ruff check ./reflekt ./tests

check-license:
needs: lint
name: Lint (${{ matrix.python-version }}, ${{ matrix.os }})
strategy:
fail-fast: true
matrix:
os: ['ubuntu-latest']
python-version: ['3.11'] # Lint only needs to run once
runs-on: ${{ matrix.os }}
steps:
- name: Checkout Repo
uses: actions/checkout@v4

- name: Install Python
uses: actions/setup-python@v4
id: setup-python
with:
python-version: ${{ matrix.python-version }}

- name: Install Poetry
run: pipx install poetry

- name: Install Poetry
run: poetry install

- name: Check License
run: poetry run reuse lint

test:
needs: check-license
name: Test (${{ matrix.python-version }}, ${{ matrix.os }})
strategy:
fail-fast: true
matrix:
os: ['ubuntu-latest']
python-version: ['3.9', '3.10', '3.11']
runs-on: ${{ matrix.os }}
steps:
- name: Checkout Repo
uses: actions/checkout@v4

- name: Install Python
uses: actions/setup-python@v4
id: setup-python
with:
python-version: ${{ matrix.python-version }}

- name: Install Poetry
run: pipx install poetry

- name: Install Poetry
run: poetry install

- name: Run Tests
run: poetry run pytest --cov=reflekt tests/
88 changes: 0 additions & 88 deletions .github/workflows/pull_request.yml

This file was deleted.

6 changes: 1 addition & 5 deletions .reuse/dep5
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ Files: artifacts/*
Copyright: 2022 Gregory Clunies <[email protected]>
License: Apache-2.0

Files: data/*
Files: docs/*
Copyright: 2022 Gregory Clunies <[email protected]>
License: Apache-2.0

Expand All @@ -31,10 +31,6 @@ Files: schemas/*
Copyright: 2022 Gregory Clunies <[email protected]>
License: Apache-2.0

Files: scripts/*
Copyright: 2022 Gregory Clunies <[email protected]>
License: Apache-2.0

Files: tests/fixtures/*
Copyright: 2022 Gregory Clunies <[email protected]>
License: Apache-2.0
Expand Down
2 changes: 1 addition & 1 deletion .vscode/launch.json
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@
"configurations": [
{
"name": "Python: Debug Tests",
"type": "python",
"type": "debugpy",
"request": "launch",
"program": "${file}",
"purpose": ["debug-test"],
Expand Down
16 changes: 16 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,22 @@ SPDX-License-Identifier: Apache-2.0

# Reflekt Changelog

## [0.6.0] - 2024-02-19
### Breaking
- Only support python versions `>=3.9,<3.12`.

### Added
- Add support for event data stored in BigQuery.
- Add required `--registry` option to `reflekt push` and `reflekt pull` commands, specifying a schema registry defined in `reflekt_profiles.yml`.
- Add `--artifact` option to `reflekt build` command, specifying the type of artifact to build (e.g. `dbt`).

### Fixed
- CLI `--help` documentation.
- Updated `README.md` docs to reflect changes in this release.
- Remove `jaffle_shop_sessions.py`, this now lives in [reflekt-jaffle-shop](https://github.com/GClunies/reflekt-jaffle-shop)
- Fix `reflekt push/pull` bug that fails when `--select`ing a single schema.
- Fix `reflekt report` bug that labeled all properties as required, even if they were not in the schema.

## [0.5.0] - 2023-12-31
### Breaking
- Only support python versions `>=3.9,<3.13`. Support for python `3.8` is DEPRECATED.
Expand Down
4 changes: 4 additions & 0 deletions Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -14,3 +14,7 @@ lint:
.PHONY: type-check
type-check:
@mypy .

.PHONY: check-license
check-license:
@reuse lint
Loading
Loading