Skip to content

feat(policy): stored enhanced actions database migration, CRUD queries, SM updates #2040

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 132 commits into from
Apr 22, 2025
Merged
Show file tree
Hide file tree
Changes from 54 commits
Commits
Show all changes
132 commits
Select commit Hold shift + click to select a range
48d8987
feat(policy): add enhanced standard/custom actions protos
jakedoublev Mar 31, 2025
05334f2
reserve field names as well
jakedoublev Mar 31, 2025
3751250
rm deprecated actions
jakedoublev Mar 31, 2025
b91a1d9
Merge branch 'main' into feat/actions-protos
jakedoublev Mar 31, 2025
824f876
allow migration before hard deprecation
jakedoublev Mar 31, 2025
d83783e
access pdp todo comment
jakedoublev Mar 31, 2025
ad9512c
list should specify stand/cust in response, and proactively prevent f…
jakedoublev Apr 1, 2025
bf28fcf
Merge branch 'main' into feat/actions-protos
jakedoublev Apr 1, 2025
809b956
Merge branch 'main' into feat/actions-svc
jakedoublev Apr 1, 2025
f39adac
actions svc
jakedoublev Apr 1, 2025
857f493
Merge branch 'main' into feat/actions-protos
jakedoublev Apr 1, 2025
5e3374f
Merge branch 'feat/actions-protos' into feat/actions-svc
jakedoublev Apr 1, 2025
1fe24f5
proto validation
jakedoublev Apr 1, 2025
03fcd4c
actions mermaid ERD for the migration
jakedoublev Apr 1, 2025
b800517
migrate up and down
jakedoublev Apr 1, 2025
f5592b1
wip
jakedoublev Apr 1, 2025
021d2c7
update overall erd
jakedoublev Apr 1, 2025
4ad71a2
update migrations with relation table
jakedoublev Apr 1, 2025
fb3fd22
global policy erd styling
jakedoublev Apr 1, 2025
3c48cba
fix migration markdown notes
jakedoublev Apr 1, 2025
85938a4
timestamp with time zone
jakedoublev Apr 2, 2025
38068ab
list actions query
jakedoublev Apr 2, 2025
9fa0396
add subject mappings to get action response
jakedoublev Apr 2, 2025
74d4fd7
Merge branch 'feat/actions-protos' into feat/actions-svc
jakedoublev Apr 2, 2025
76c664b
Merge branch 'feat/actions-svc' into feat/actions-db
jakedoublev Apr 2, 2025
1ddc082
CRUD of actions (not including subject mappings yet
jakedoublev Apr 2, 2025
445ff05
wip
jakedoublev Apr 2, 2025
dcd40c4
mini ADR for storing standard actions
jakedoublev Apr 2, 2025
a67018f
rework protos according to mini-ADR and how we'll store standard actions
jakedoublev Apr 2, 2025
2307646
Merge branch 'feat/actions-protos' into feat/actions-svc
jakedoublev Apr 2, 2025
b2b720b
Merge branch 'feat/actions-svc' into feat/actions-db
jakedoublev Apr 2, 2025
02fc6d1
wip
jakedoublev Apr 3, 2025
406aa4d
fix and gencode
jakedoublev Apr 3, 2025
82a5df7
fix
jakedoublev Apr 3, 2025
ff78374
lower case sm db queries in sqlc gencode
jakedoublev Apr 3, 2025
ae486bb
wip
jakedoublev Apr 3, 2025
86537a6
wip
jakedoublev Apr 3, 2025
b1aaa0a
fix
jakedoublev Apr 3, 2025
b1a973b
fix
jakedoublev Apr 3, 2025
63a1806
fix
jakedoublev Apr 4, 2025
c518f45
run suites again
jakedoublev Apr 4, 2025
b91046a
fix subject mapping retrieval in lookup by fqn
jakedoublev Apr 4, 2025
9b26484
improve test
jakedoublev Apr 4, 2025
098c75f
lint fixes
jakedoublev Apr 4, 2025
b038163
Merge branch 'main' into feat/actions-protos
jakedoublev Apr 8, 2025
5b83f99
Merge branch 'feat/actions-protos' into feat/actions-svc
jakedoublev Apr 8, 2025
f1a7012
Merge branch 'feat/actions-svc' into feat/actions-db
jakedoublev Apr 8, 2025
1e831d3
spelling
jakedoublev Apr 9, 2025
13ef076
make action update name optional
jakedoublev Apr 9, 2025
8273cd1
Merge branch 'feat/actions-protos' into feat/actions-svc
jakedoublev Apr 9, 2025
0419fba
Merge branch 'feat/actions-svc' into feat/actions-db
jakedoublev Apr 9, 2025
15a7e85
Merge branch 'main' into feat/actions-protos
jakedoublev Apr 10, 2025
ef5500a
Merge branch 'feat/actions-protos' into feat/actions-svc
jakedoublev Apr 10, 2025
3a3dddc
Merge branch 'feat/actions-svc' into feat/actions-db
jakedoublev Apr 10, 2025
e196a86
lint fixes
jakedoublev Apr 11, 2025
78e1d1d
lint fixes
jakedoublev Apr 11, 2025
9551f71
Merge branch 'feat/actions-svc' into feat/actions-db
jakedoublev Apr 11, 2025
8c7f6bb
lint fix
jakedoublev Apr 11, 2025
973d877
Merge remote-tracking branch 'origin' into feat/actions-protos
jakedoublev Apr 11, 2025
e94278c
bump migration timestamp
jakedoublev Apr 11, 2025
4873b73
test custom rules
jakedoublev Apr 11, 2025
b37bb13
Merge branch 'feat/actions-protos' into feat/actions-svc
jakedoublev Apr 11, 2025
8a37484
bump proto-generating deps
jakedoublev Apr 11, 2025
748fdb4
validator is no longer a pointer
jakedoublev Apr 11, 2025
8df00e0
consume latest proto rules
jakedoublev Apr 11, 2025
f62fb0d
test common rule protos
jakedoublev Apr 11, 2025
23a6ab7
rules proto file rename and regeneration with improved CEL
jakedoublev Apr 11, 2025
b3d8ecc
Merge branch 'feat/actions-protos' into feat/actions-svc
jakedoublev Apr 11, 2025
c4ffbc5
rename string extension rules
jakedoublev Apr 11, 2025
d0dd460
defunct test case
jakedoublev Apr 11, 2025
22eedab
Merge branch 'main' into feat/actions-protos
jakedoublev Apr 11, 2025
98df67c
rm extraneous comment
jakedoublev Apr 11, 2025
279aa1e
put back authz service logic
jakedoublev Apr 11, 2025
ce7928e
Merge branch 'feat/actions-protos' into feat/actions-svc
jakedoublev Apr 11, 2025
6d992f4
bump protovalidate
jakedoublev Apr 11, 2025
2cc0784
go mod tidy
jakedoublev Apr 11, 2025
002795f
Merge branch 'feat/actions-protos' into feat/actions-svc
jakedoublev Apr 11, 2025
486f9e0
bump to 1.23.4
jakedoublev Apr 11, 2025
b56eb55
Merge branch 'feat/actions-protos' into feat/actions-svc
jakedoublev Apr 11, 2025
892f115
put back protocol/go bump
jakedoublev Apr 11, 2025
894455b
fix unit tests
jakedoublev Apr 11, 2025
03a9a0d
bump proto-validate in service package to be compatible with CI
jakedoublev Apr 11, 2025
c38d722
go mod tidy
jakedoublev Apr 11, 2025
c9a0eef
bump connect dep as well
jakedoublev Apr 11, 2025
48121d2
trigger CI
jakedoublev Apr 11, 2025
aa99448
Merge branch 'main' into feat/actions-protos
jakedoublev Apr 14, 2025
158604a
Merge branch 'feat/actions-protos' into feat/actions-svc
jakedoublev Apr 14, 2025
7a55a40
test replacement with protocol/go containing proto validations
jakedoublev Apr 14, 2025
18a5f98
service should follow policy patterns with config update hooks
jakedoublev Apr 14, 2025
bbba5d0
Merge branch 'main' into feat/actions-svc
jakedoublev Apr 14, 2025
a598989
fix(policy): remove predefined rules in actions protos
jakedoublev Apr 14, 2025
7f14f6f
fix
jakedoublev Apr 14, 2025
ae9f697
test rm predefined proto rules
jakedoublev Apr 14, 2025
fd854f5
Merge branch 'fix/rm-predefined' into feat/actions-svc
jakedoublev Apr 14, 2025
5498a27
fix proto validation failure names
jakedoublev Apr 14, 2025
2551747
fix proto validation failure names
jakedoublev Apr 14, 2025
61bfcb4
fix tests
jakedoublev Apr 14, 2025
d97099d
downgrade protovalidate/protocolbuffers/go
jakedoublev Apr 14, 2025
488d655
Merge branch 'fix/rm-predefined' into feat/actions-svc
jakedoublev Apr 14, 2025
9077368
update replacement directive pin commit
jakedoublev Apr 14, 2025
0dd18ae
fix optional updation
jakedoublev Apr 14, 2025
c6a2040
codegen
jakedoublev Apr 14, 2025
428133a
Merge branch 'fix/rm-predefined' into feat/actions-svc
jakedoublev Apr 14, 2025
2a85aeb
fix actions_test
jakedoublev Apr 14, 2025
8e7b771
update pinned commit
jakedoublev Apr 14, 2025
d67cdf7
Merge branch 'main' into feat/actions-svc
jakedoublev Apr 17, 2025
06426f3
bump sdk
jakedoublev Apr 17, 2025
2c673b1
Merge branch 'feat/actions-svc' into feat/actions-db
jakedoublev Apr 17, 2025
13d0a0f
Merge branch 'main' into feat/actions-db
jakedoublev Apr 17, 2025
d01b524
typo
jakedoublev Apr 17, 2025
c53f359
lint fix
jakedoublev Apr 17, 2025
c82aaca
Merge branch 'main' into feat/actions-db
jakedoublev Apr 17, 2025
c8643d3
feat(policy): actions db CRUD handlers and integration tests (db part…
jakedoublev Apr 17, 2025
e839876
lint fixes
jakedoublev Apr 17, 2025
b84dade
fix test
jakedoublev Apr 17, 2025
b5cfc1d
improve migration
jakedoublev Apr 21, 2025
cdc32c0
re-export standard CRUDable action names and update roundtrip CI tests
jakedoublev Apr 21, 2025
c117675
Merge branch 'main' into feat/actions-db
jakedoublev Apr 21, 2025
3e15cbe
Merge branch 'main' into feat/actions-db
jakedoublev Apr 21, 2025
52e975b
copilot suggestions
jakedoublev Apr 21, 2025
4003eff
test resolving circular CI issues
jakedoublev Apr 21, 2025
53697e3
different tweak to map subject mapping create/update with deprecated …
jakedoublev Apr 21, 2025
91e280d
tweak
jakedoublev Apr 21, 2025
5c05080
add skipped create/udpate tests to be removed when create/update SM w…
jakedoublev Apr 21, 2025
0a4dbcd
typo
jakedoublev Apr 21, 2025
7a14e5a
Merge branch 'main' into feat/actions-db
jakedoublev Apr 22, 2025
48a1b66
updated ERD
jakedoublev Apr 22, 2025
5cbfca9
remove duplicate index
jakedoublev Apr 22, 2025
081b69b
remove extraneous nil check
jakedoublev Apr 22, 2025
a8cf74e
fix extraneous nil checks in action update
jakedoublev Apr 22, 2025
b1ec977
improve SQL when querying actions in lists of subject mappings
jakedoublev Apr 22, 2025
1648e69
remove extraneous SQL RETURNING statements
jakedoublev Apr 22, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -79,6 +79,8 @@ policy-erd-gen:
@which mermerd > /dev/null || { echo "mermerd not found, please install it: https://github.com/KarnerTh/mermerd#installation"; exit 1; }
# Docs: https://github.com/KarnerTh/mermerd#parametersflags
mermerd -c 'postgresql://postgres:changeme@localhost:5432/opentdf' -e -o service/policy/db/schema_erd.md -s opentdf_policy --useAllTables --showDescriptions enumValues,columnComments
# Add mermaid CSS to the end of the generated file
@echo '\n<style>div.mermaid{overflow-x:scroll;}div.mermaid>svg{width:250rem;}</style>' >> service/policy/db/schema_erd.md

test:
for m in $(HAND_MODS); do (cd $$m && go test ./... -race) || exit 1; done
Expand Down
Loading
Loading