Skip to content

[ODP-453] Teams Implementation - Edit sub team (private or public) #675

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 6 commits into from
Apr 28, 2025

Conversation

mpolidori
Copy link
Collaborator

Pull request checklist

Please check if your PR fulfills the following requirements:

  • Make sure you are requesting to pull a topic/feature/bugfix branch (right side). Don't request your master!
  • Make sure you are making a pull request against the develop branch (left side). Also you should start your branch off our develop.
  • Check the commit's or even all commits' message styles matches our requested structure.
  • Check your code additions will fail neither code linting checks nor unit test.

Pull request type

Please check the type of change your PR introduces:

  • Bugfix
  • Feature
  • Code style update (formatting, renaming)
  • Refactoring (no functional changes, no api changes)
  • Build related changes
  • Documentation content changes
  • Other (please describe):

What is the current behavior?

Issue Number: N/A

What is the new behavior?

Does this introduce a breaking change?

  • Yes
  • No

Other information

@mpolidori mpolidori requested a review from steveoni April 22, 2025 19:48
@mpolidori mpolidori changed the title Add integration tests [ODP-453] Teams Implementation - Edit sub team (private or public) Apr 22, 2025
Copy link
Collaborator

@steveoni steveoni left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lgtm

@mpolidori mpolidori requested a review from steveoni April 28, 2025 19:47
@steveoni steveoni merged commit e56b2eb into dev Apr 28, 2025
7 checks passed
mpolidori added a commit that referenced this pull request May 12, 2025
* Harvest dynamic configs pt. 2 (#635)

* Update ckanext-s3filestore branch

* Fix typo

* Update layer manager to use wri release

* Fix Dockerfile

* [ODP-235] Allow private and hidden teams (#537)

* update teams create and edit form

* update organization list api

* update schema

* update api

* remove extras

* fix type errors

* update user_list_wri to support private teams

* fix api call

* remove chained action

* add visibility

* fix breaking changes

* update env

* update env plugin

* fix test

* update test

* add visibility to org during dataset edit

* add test for private teams

* remove logs

* update private team functionality

* Merge branch 'priveateams' of https://github.com/wri/wri-odp into priveateams

* Merge branch 'priveateams' of https://github.com/wri/wri-odp into priveateams

* resolve conflict

* undo changes

* update organization patch and create

* add private attribute to fetched orgs

* update organization_list sql logic

* improve team visbility

* improve error message

* update private team test

* update failing test

* update test

* update settings

* update test

* update test

* update test

* update test

* update test

* update test

* update test

* update docker compose

* add tooltip

* update test

* add padlock to private teams

* add back auth plugin

* Harvest config feb 03 2025 (#637)

* Fix variable replacement in harvest worker configs and switch from /tmp path to /srv/app

* Add whoami output to start_ckan.sh

* [download_event.py] Add missing closing parenthesis

* Set supervisor home by variable

* Fix harvest config permissions

* Use CKAN_IMAGE variable instead of local image name

* Handle sed supervisor changes as root; Add start_ckan sub-script

* Revert sub-script; Always use user ckan for supervisor

* Fix sed commands

* Use root user with ckan home for supervisord

* Revert "Harvest config feb 03 2025 (#637)"

This reverts commit e68155a.

* Harvest dynamic configs pt. 3 (#638)

* Add supercronic for harvest run command (#640)

* Fix alignment

* Fix build

* Fix build

* [ODP-414] add email notification when download-flow fails (#641)

* add email notification when flow fails

* update error notification

* empty

* remove pgclient version

* update libpq

---------

Co-authored-by: Michael Polidori <[email protected]>

* Upgrade to CKAN 2.11 (#632)

* Update setup.py

* Update Members permission to team form + ODP-370 (#642)

* members can not

* update role: Editor can create sub-team and admin moving subteam from public to private should not throw error

* disabled Public option if parent is private

* Trigger CI

---------

Co-authored-by: Luccas Mateus <[email protected]>

* Change setup.py and setup.cfg

* Fix ckanext-wri install (#643)

* Improve resource location design (#646)

* Trigger CI

* [odp-426]: Add edit icon to dashboard entities (#648)

* [odp-426]: Add edit icon to dashboard entities

* update schema

* Add bulk purge collaborator issue patch (#645)

* Increase UWSGI timeouts; Extract URLs from markdown links in learn_more (#649)

* Resource location search improvements (#650)

* add authorized check to group/teams last node (#651)

* Trigger CI

* Rm global from DatafileLocation

* Trigger CI

* enable edit icon for collaborators (#652)

* Fix typo

* intgration test for collaborator permission (#654)

* enable edit icon for collaborators

* add intergration test  for dashboard collaborator permission

* Improve speed

* Improve js

* Fix prefetching

* Change color of area select tool

* Improvements map

* Remove edit icon on teams/topic page for editor (#656)

* enable edit icon for collaborators

* remove editor permision

* empty

* Fix tests

* Fix tests

* Fix tests

* Fix test

* Clear all session storage

* Fix tests

* Fix tests

* Fix private teams tests

* Fix cypress.config.js

* Fix tests

* Fix tests

* Fix tests

* Fix tests

* Fix whitespace wrap on text

* Trigger CI

* Add group admin email to workflow error mail (#663)

* enable edit icon for collaborators

* send workflow error to team admin

* removed email check

* E2etest (#657)

* enable edit icon for collaborators

* empty

* add check to ensure org is actually private

* update

* update

* fix test

* update test

* empty

* update

* update test

* update test

* update test

* update test

* update test

* update test to see if organization create api is truly working

* update test

* remove other test for now

* push update

* update env.example

* fix test

* empty

* Fix git vulnerability

* Fix git

* Add if condition (#664)

* [odp-449] Teams Implementation - Root parent Team Edit (#669)

* enable edit icon for collaborators

* admin should be able to edit root team

* ODP-447 (#668)

* ODP-447

* Fix build

* Fix tests

* Fix t ests

* Trigger CI

* [Dev] Increase proxy-read-timeout to avoid early external request disconnects (#665)

* Odp 448 (#670)

* ODP-448

* Add extra tests

* Fix session leakage

* Fix tests

* Forgot to commit

* Fix tests

* Add required indicator for non-sysadmins (#672)

* Change data stored in orttho

* Fix odp430 (#674)

* enable edit icon for collaborators

* fix odp-430

* Trigger CI

* Add better warning

* Add extras to list of defaultvalues (#676)

* enable edit icon for collaborators

* fix odp-430

* add extras to default value

* Form-id

* Trigger CI

* [Odp 458] create/edit dataset in sub-team public (#678)

* enable edit icon for collaborators

* extend capacity so editor can create or edit dataset in subteam

* editor should be able to see public subteam in organization_list_for_user api

* parent team admin should be able to edit subteam public dataset

* add missing visbility check: public dataset can not be assigned to private team

* reshape logic

* update patch

* remove log

* update test

* empty

* [ODP-453] Teams Implementation - Edit sub team (private or public) (#675)

* Add integration tests

* Bump ckanext-hierarchy commit: fix cascading roles

* Fix tests

* Fix tests

* Fix tests

* Fix tests

* Limit setting private Teams to public only to sysadmins (#679)

* Add docs for subpaths (#568)

* Add docs for subpaths

* Force rerun pipeline

* Allow Team Admins public to private permissions (#680)

* use sysadmin key to fetch dataset collaborators (#682)

* enable edit icon for collaborators

* use sysadmin key to fetch dataset collaborators

* Hide by default when no viz available

* fix: first publish

* Fix test

* Fix caution max-w

* Set create_unowned_dataset to False; Remove dev testing GitHub Actions file

* Remove duplicate form-id

---------

Co-authored-by: Michael Polidori <[email protected]>
Co-authored-by: Stephen Oni <[email protected]>
luccasmmg added a commit that referenced this pull request May 21, 2025
* Harvest dynamic configs pt. 2 (#635)

* Update ckanext-s3filestore branch

* Fix typo

* Update layer manager to use wri release

* Fix Dockerfile

* [ODP-235] Allow private and hidden teams (#537)

* update teams create and edit form

* update organization list api

* update schema

* update api

* remove extras

* fix type errors

* update user_list_wri to support private teams

* fix api call

* remove chained action

* add visibility

* fix breaking changes

* update env

* update env plugin

* fix test

* update test

* add visibility to org during dataset edit

* add test for private teams

* remove logs

* update private team functionality

* Merge branch 'priveateams' of https://github.com/wri/wri-odp into priveateams

* Merge branch 'priveateams' of https://github.com/wri/wri-odp into priveateams

* resolve conflict

* undo changes

* update organization patch and create

* add private attribute to fetched orgs

* update organization_list sql logic

* improve team visbility

* improve error message

* update private team test

* update failing test

* update test

* update settings

* update test

* update test

* update test

* update test

* update test

* update test

* update test

* update docker compose

* add tooltip

* update test

* add padlock to private teams

* add back auth plugin

* Harvest config feb 03 2025 (#637)

* Fix variable replacement in harvest worker configs and switch from /tmp path to /srv/app

* Add whoami output to start_ckan.sh

* [download_event.py] Add missing closing parenthesis

* Set supervisor home by variable

* Fix harvest config permissions

* Use CKAN_IMAGE variable instead of local image name

* Handle sed supervisor changes as root; Add start_ckan sub-script

* Revert sub-script; Always use user ckan for supervisor

* Fix sed commands

* Use root user with ckan home for supervisord

* Revert "Harvest config feb 03 2025 (#637)"

This reverts commit e68155a.

* Harvest dynamic configs pt. 3 (#638)

* Add supercronic for harvest run command (#640)

* Fix alignment

* Fix build

* Fix build

* [ODP-414] add email notification when download-flow fails (#641)

* add email notification when flow fails

* update error notification

* empty

* remove pgclient version

* update libpq

---------

Co-authored-by: Michael Polidori <[email protected]>

* Upgrade to CKAN 2.11 (#632)

* Update setup.py

* Update Members permission to team form + ODP-370 (#642)

* members can not

* update role: Editor can create sub-team and admin moving subteam from public to private should not throw error

* disabled Public option if parent is private

* Trigger CI

---------

Co-authored-by: Luccas Mateus <[email protected]>

* Change setup.py and setup.cfg

* Fix ckanext-wri install (#643)

* Improve resource location design (#646)

* Trigger CI

* [odp-426]: Add edit icon to dashboard entities (#648)

* [odp-426]: Add edit icon to dashboard entities

* update schema

* Add bulk purge collaborator issue patch (#645)

* Increase UWSGI timeouts; Extract URLs from markdown links in learn_more (#649)

* Resource location search improvements (#650)

* add authorized check to group/teams last node (#651)

* Trigger CI

* Rm global from DatafileLocation

* Trigger CI

* enable edit icon for collaborators (#652)

* Fix typo

* intgration test for collaborator permission (#654)

* enable edit icon for collaborators

* add intergration test  for dashboard collaborator permission

* Improve speed

* Improve js

* Fix prefetching

* Change color of area select tool

* Improvements map

* Remove edit icon on teams/topic page for editor (#656)

* enable edit icon for collaborators

* remove editor permision

* empty

* Fix tests

* Fix tests

* Fix tests

* Fix test

* Clear all session storage

* Fix tests

* Fix tests

* Fix private teams tests

* Fix cypress.config.js

* Fix tests

* Fix tests

* Fix tests

* Fix tests

* Fix whitespace wrap on text

* Trigger CI

* Add group admin email to workflow error mail (#663)

* enable edit icon for collaborators

* send workflow error to team admin

* removed email check

* E2etest (#657)

* enable edit icon for collaborators

* empty

* add check to ensure org is actually private

* update

* update

* fix test

* update test

* empty

* update

* update test

* update test

* update test

* update test

* update test

* update test to see if organization create api is truly working

* update test

* remove other test for now

* push update

* update env.example

* fix test

* empty

* Fix git vulnerability

* Fix git

* Add if condition (#664)

* [odp-449] Teams Implementation - Root parent Team Edit (#669)

* enable edit icon for collaborators

* admin should be able to edit root team

* ODP-447 (#668)

* ODP-447

* Fix build

* Fix tests

* Fix t ests

* Trigger CI

* [Dev] Increase proxy-read-timeout to avoid early external request disconnects (#665)

* Odp 448 (#670)

* ODP-448

* Add extra tests

* Fix session leakage

* Fix tests

* Forgot to commit

* Fix tests

* Add required indicator for non-sysadmins (#672)

* Change data stored in orttho

* Fix odp430 (#674)

* enable edit icon for collaborators

* fix odp-430

* Trigger CI

* Add better warning

* Add extras to list of defaultvalues (#676)

* enable edit icon for collaborators

* fix odp-430

* add extras to default value

* Form-id

* Trigger CI

* [Odp 458] create/edit dataset in sub-team public (#678)

* enable edit icon for collaborators

* extend capacity so editor can create or edit dataset in subteam

* editor should be able to see public subteam in organization_list_for_user api

* parent team admin should be able to edit subteam public dataset

* add missing visbility check: public dataset can not be assigned to private team

* reshape logic

* update patch

* remove log

* update test

* empty

* [ODP-453] Teams Implementation - Edit sub team (private or public) (#675)

* Add integration tests

* Bump ckanext-hierarchy commit: fix cascading roles

* Fix tests

* Fix tests

* Fix tests

* Fix tests

* Limit setting private Teams to public only to sysadmins (#679)

* Add docs for subpaths (#568)

* Add docs for subpaths

* Force rerun pipeline

* Allow Team Admins public to private permissions (#680)

* use sysadmin key to fetch dataset collaborators (#682)

* enable edit icon for collaborators

* use sysadmin key to fetch dataset collaborators

* Hide by default when no viz available

* fix: first publish

* Fix test

* Fix caution max-w

* Update package_update auth for editor (#687)

* enable edit icon for collaborators

* update auth: editor should be able to edit public dataset

* update test

* empty

* remove package

* Add tags to prefect tasks (#688)

* Add tags to prefect tasks

* Add FLOW_DEPLOYMENT_ENV variable to test yaml

* Fix conflicts

---------

Co-authored-by: Michael Polidori <[email protected]>
Co-authored-by: Stephen Oni <[email protected]>
luccasmmg added a commit that referenced this pull request May 22, 2025
* [sitemap]: remove diallow all from sitemap

* Add harvest configs and supervisorctl

* Force rerun deployment

* Force rerun deployment

* empty

* Fix supervisord file permissions

* Add harvester to initial plugins

* Trigger CI

* Searchcard (#605)

* [sitemap]: remove diallow all from sitemap

* update searchcard style

* add aria-label to the footer

* update test

* update

* update dataset card

* Fix supervisord.conf path

* Fix supervisord file path in Dockerfile.dev

* Revert "Merge branch 'dev' of https://github.com/wri/wri-odp into dev" (#608)

This reverts commit 09e0761, reversing
changes made to c54ef01.

Co-authored-by: Luccas Mateus <[email protected]>

* Re apply multiple applications (#609)

* Revert "Merge branch 'dev' of https://github.com/wri/wri-odp into dev"

This reverts commit 09e0761, reversing
changes made to c54ef01.

* Reapply "Merge branch 'dev' of https://github.com/wri/wri-odp into dev"

This reverts commit 9399810.

---------

Co-authored-by: Luccas Mateus <[email protected]>

* Force rerun deployment

* Add log output after unit tests

* Move error logs in GitHub Actions

* Improve group package count api call (#611)

* [sitemap]: remove diallow all from sitemap

* empty

* improve groups package count fetch

* Move log print; Fix timeout

* update auto-url field in dataset form

* ODP-399 (#614)

* ODP-399

* Fix build

* scroll to the top on state change (#615)

* scroll to the top on stte change

* update pagination

* Swap back to Azure SSO from Okta SSO

* ODP-397 (#617)

* Fix requesteds by Nesma

* ODP-380 (#620)

* Allow CORS in tests

* Remove unnecessary build section from docker-compose.test

* Update docs

* update application and others (#624)

* update images and doc (#623)

* update userdoc search page

* Applications docs

* [ODP-400] Homepage search bar improvements (#612)

* update search field style

* update search field

* update color contrast

* update cta button (#627)

* Fix build

* User info (#628)

* Progress

* Only misiing csv export

* Almost finished

* Add docs

* Tests

* Fix test

* Orttho

* Rm poetry

* QA Fixes

* Fix ortto signup (Only when user accepts)

* Fixes onSuccess mutation download batch

* Downgrade git

* QA Fixes

* Delete test thats no longer relevant

* Fix test cost splitting

* Fix test cost splitting

* Rm console.log

* Change wording for button

* Marketing + Vulnerability

* fix issue with weird scrolling behaviour (#629)

* fix issue with weird scrolling bahaviour

* add height for mobile scroll

* Update to have timestamp

* Fix vulnerability

* [run_unit_tests.sh] Give verbose output

* fix search input alignment

* update search input fields

* Kim comments

* [main.yml] Temp. stop build logs

* Fix vulnerability

* [main.yml] Fix broken build

* [main.yml] Fix broken build

* [main.yml] Typo fix

* [main.yml] Fix image name

* Fix alignment recent added/updated

* Fix broken link

* ODP-397 Kim request

* update dataset edit url placeholder (#631)

* [docker-compose.test.yml] Temp. use redis 3

* [main.yml] Run build

* [main.yml] Disable build

* [docker-compose.test.yml] Add redis retry

* [docker-compose.test.yml] Dont run frontend

* [main.yml] Don't run frontend docker

* [docker-compose.test.yml] Remove redis health check

* [docker-compose.test.yml] Remove datapusher temporarily

* [docker-compose.test.yml] Fix redis container name

* [run_unit_tests.sh] Run traceback as long

* [run_unit_tests.sh] Update test command

* Small UI Fixes

* Fix font size

* [supervisor.harvest.conf] Temp. run harvester as root

* [main.yml] Run the build and push the images

* [docker-compose.test.yml] Revert changes

* [main.yml] Run tests

* [supervisor.*.conf] Use env variable to dynamically set user based on user running CKAN

* update filter scrolltop (#633)

* Kim requests(Download id, new fomratting date)

* Fix fonts

* Fix timezone

* Ortto forms

* Fix timezone

* Fix font size

* Fix typo

* Trigger CI

* Fix build

* Sync dev staging 02 17 25 (#639)

* Harvest dynamic configs pt. 2 (#635)

* Update ckanext-s3filestore branch

* Fix typo

* Update layer manager to use wri release

* Fix Dockerfile

* [ODP-235] Allow private and hidden teams (#537)

* update teams create and edit form

* update organization list api

* update schema

* update api

* remove extras

* fix type errors

* update user_list_wri to support private teams

* fix api call

* remove chained action

* add visibility

* fix breaking changes

* update env

* update env plugin

* fix test

* update test

* add visibility to org during dataset edit

* add test for private teams

* remove logs

* update private team functionality

* Merge branch 'priveateams' of https://github.com/wri/wri-odp into priveateams

* Merge branch 'priveateams' of https://github.com/wri/wri-odp into priveateams

* resolve conflict

* undo changes

* update organization patch and create

* add private attribute to fetched orgs

* update organization_list sql logic

* improve team visbility

* improve error message

* update private team test

* update failing test

* update test

* update settings

* update test

* update test

* update test

* update test

* update test

* update test

* update test

* update docker compose

* add tooltip

* update test

* add padlock to private teams

* add back auth plugin

* Harvest config feb 03 2025 (#637)

* Fix variable replacement in harvest worker configs and switch from /tmp path to /srv/app

* Add whoami output to start_ckan.sh

* [download_event.py] Add missing closing parenthesis

* Set supervisor home by variable

* Fix harvest config permissions

* Use CKAN_IMAGE variable instead of local image name

* Handle sed supervisor changes as root; Add start_ckan sub-script

* Revert sub-script; Always use user ckan for supervisor

* Fix sed commands

* Use root user with ckan home for supervisord

* Revert "Harvest config feb 03 2025 (#637)"

This reverts commit e68155a.

* Harvest dynamic configs pt. 3 (#638)

* Add supercronic for harvest run command (#640)

---------

Co-authored-by: Luccas Mateus <[email protected]>
Co-authored-by: Stephen Oni <[email protected]>

* Sync dev staging 03 03 25 (#644)

* Sync dev to Staging Mar 3, 2025

* Fix typo

* [ODP-235] Allow private and hidden teams (#537)

* update teams create and edit form

* update organization list api

* update schema

* update api

* remove extras

* fix type errors

* update user_list_wri to support private teams

* fix api call

* remove chained action

* add visibility

* fix breaking changes

* update env

* update env plugin

* fix test

* update test

* add visibility to org during dataset edit

* add test for private teams

* remove logs

* update private team functionality

* Merge branch 'priveateams' of https://github.com/wri/wri-odp into priveateams

* Merge branch 'priveateams' of https://github.com/wri/wri-odp into priveateams

* resolve conflict

* undo changes

* update organization patch and create

* add private attribute to fetched orgs

* update organization_list sql logic

* improve team visbility

* improve error message

* update private team test

* update failing test

* update test

* update settings

* update test

* update test

* update test

* update test

* update test

* update test

* update test

* update docker compose

* add tooltip

* update test

* add padlock to private teams

* add back auth plugin

* Harvest config feb 03 2025 (#637)

* Fix variable replacement in harvest worker configs and switch from /tmp path to /srv/app

* Add whoami output to start_ckan.sh

* [download_event.py] Add missing closing parenthesis

* Set supervisor home by variable

* Fix harvest config permissions

* Use CKAN_IMAGE variable instead of local image name

* Handle sed supervisor changes as root; Add start_ckan sub-script

* Revert sub-script; Always use user ckan for supervisor

* Fix sed commands

* Use root user with ckan home for supervisord

* Revert "Harvest config feb 03 2025 (#637)"

This reverts commit e68155a.

* Harvest dynamic configs pt. 3 (#638)

* Add supercronic for harvest run command (#640)

* Fix alignment

* Fix build

* Fix build

* [ODP-414] add email notification when download-flow fails (#641)

* add email notification when flow fails

* update error notification

* empty

* remove pgclient version

* update libpq

---------

Co-authored-by: Michael Polidori <[email protected]>

* Update Members permission to team form + ODP-370 (#642)

* members can not

* update role: Editor can create sub-team and admin moving subteam from public to private should not throw error

* disabled Public option if parent is private

* Trigger CI

---------

Co-authored-by: Luccas Mateus <[email protected]>

* Fix shapely imports

---------

Co-authored-by: Luccas Mateus <[email protected]>
Co-authored-by: Stephen Oni <[email protected]>

* Sync dev staging mar 19 (#653)

* Harvest dynamic configs pt. 2 (#635)

* Update ckanext-s3filestore branch

* Fix typo

* Update layer manager to use wri release

* Fix Dockerfile

* [ODP-235] Allow private and hidden teams (#537)

* update teams create and edit form

* update organization list api

* update schema

* update api

* remove extras

* fix type errors

* update user_list_wri to support private teams

* fix api call

* remove chained action

* add visibility

* fix breaking changes

* update env

* update env plugin

* fix test

* update test

* add visibility to org during dataset edit

* add test for private teams

* remove logs

* update private team functionality

* Merge branch 'priveateams' of https://github.com/wri/wri-odp into priveateams

* Merge branch 'priveateams' of https://github.com/wri/wri-odp into priveateams

* resolve conflict

* undo changes

* update organization patch and create

* add private attribute to fetched orgs

* update organization_list sql logic

* improve team visbility

* improve error message

* update private team test

* update failing test

* update test

* update settings

* update test

* update test

* update test

* update test

* update test

* update test

* update test

* update docker compose

* add tooltip

* update test

* add padlock to private teams

* add back auth plugin

* Harvest config feb 03 2025 (#637)

* Fix variable replacement in harvest worker configs and switch from /tmp path to /srv/app

* Add whoami output to start_ckan.sh

* [download_event.py] Add missing closing parenthesis

* Set supervisor home by variable

* Fix harvest config permissions

* Use CKAN_IMAGE variable instead of local image name

* Handle sed supervisor changes as root; Add start_ckan sub-script

* Revert sub-script; Always use user ckan for supervisor

* Fix sed commands

* Use root user with ckan home for supervisord

* Revert "Harvest config feb 03 2025 (#637)"

This reverts commit e68155a.

* Harvest dynamic configs pt. 3 (#638)

* Add supercronic for harvest run command (#640)

* Fix alignment

* Fix build

* Fix build

* [ODP-414] add email notification when download-flow fails (#641)

* add email notification when flow fails

* update error notification

* empty

* remove pgclient version

* update libpq

---------

Co-authored-by: Michael Polidori <[email protected]>

* Upgrade to CKAN 2.11 (#632)

* Update setup.py

* Update Members permission to team form + ODP-370 (#642)

* members can not

* update role: Editor can create sub-team and admin moving subteam from public to private should not throw error

* disabled Public option if parent is private

* Trigger CI

---------

Co-authored-by: Luccas Mateus <[email protected]>

* Change setup.py and setup.cfg

* Fix ckanext-wri install (#643)

* Improve resource location design (#646)

* Trigger CI

* [odp-426]: Add edit icon to dashboard entities (#648)

* [odp-426]: Add edit icon to dashboard entities

* update schema

* Add bulk purge collaborator issue patch (#645)

* Increase UWSGI timeouts; Extract URLs from markdown links in learn_more (#649)

* Resource location search improvements (#650)

* add authorized check to group/teams last node (#651)

* Trigger CI

* Rm global from DatafileLocation

* Trigger CI

* enable edit icon for collaborators (#652)

* Fix typo

* Remove dev helm config values and GH Actions file

---------

Co-authored-by: Michael Polidori <[email protected]>
Co-authored-by: Stephen Oni <[email protected]>

* Sync dev staging mar 26 (#659)

* Harvest dynamic configs pt. 2 (#635)

* Update ckanext-s3filestore branch

* Fix typo

* Update layer manager to use wri release

* Fix Dockerfile

* [ODP-235] Allow private and hidden teams (#537)

* update teams create and edit form

* update organization list api

* update schema

* update api

* remove extras

* fix type errors

* update user_list_wri to support private teams

* fix api call

* remove chained action

* add visibility

* fix breaking changes

* update env

* update env plugin

* fix test

* update test

* add visibility to org during dataset edit

* add test for private teams

* remove logs

* update private team functionality

* Merge branch 'priveateams' of https://github.com/wri/wri-odp into priveateams

* Merge branch 'priveateams' of https://github.com/wri/wri-odp into priveateams

* resolve conflict

* undo changes

* update organization patch and create

* add private attribute to fetched orgs

* update organization_list sql logic

* improve team visbility

* improve error message

* update private team test

* update failing test

* update test

* update settings

* update test

* update test

* update test

* update test

* update test

* update test

* update test

* update docker compose

* add tooltip

* update test

* add padlock to private teams

* add back auth plugin

* Harvest config feb 03 2025 (#637)

* Fix variable replacement in harvest worker configs and switch from /tmp path to /srv/app

* Add whoami output to start_ckan.sh

* [download_event.py] Add missing closing parenthesis

* Set supervisor home by variable

* Fix harvest config permissions

* Use CKAN_IMAGE variable instead of local image name

* Handle sed supervisor changes as root; Add start_ckan sub-script

* Revert sub-script; Always use user ckan for supervisor

* Fix sed commands

* Use root user with ckan home for supervisord

* Revert "Harvest config feb 03 2025 (#637)"

This reverts commit e68155a.

* Harvest dynamic configs pt. 3 (#638)

* Add supercronic for harvest run command (#640)

* Fix alignment

* Fix build

* Fix build

* [ODP-414] add email notification when download-flow fails (#641)

* add email notification when flow fails

* update error notification

* empty

* remove pgclient version

* update libpq

---------

Co-authored-by: Michael Polidori <[email protected]>

* Upgrade to CKAN 2.11 (#632)

* Update setup.py

* Update Members permission to team form + ODP-370 (#642)

* members can not

* update role: Editor can create sub-team and admin moving subteam from public to private should not throw error

* disabled Public option if parent is private

* Trigger CI

---------

Co-authored-by: Luccas Mateus <[email protected]>

* Change setup.py and setup.cfg

* Fix ckanext-wri install (#643)

* Improve resource location design (#646)

* Trigger CI

* [odp-426]: Add edit icon to dashboard entities (#648)

* [odp-426]: Add edit icon to dashboard entities

* update schema

* Add bulk purge collaborator issue patch (#645)

* Increase UWSGI timeouts; Extract URLs from markdown links in learn_more (#649)

* Resource location search improvements (#650)

* add authorized check to group/teams last node (#651)

* Trigger CI

* Rm global from DatafileLocation

* Trigger CI

* enable edit icon for collaborators (#652)

* Fix typo

* intgration test for collaborator permission (#654)

* enable edit icon for collaborators

* add intergration test  for dashboard collaborator permission

* Improve speed

* Improve js

* Fix prefetching

* Change color of area select tool

* Improvements map

* Remove edit icon on teams/topic page for editor (#656)

* enable edit icon for collaborators

* remove editor permision

* empty

* Fix tests

* Fix tests

* Fix tests

* Fix test

* Clear all session storage

* Fix tests

* Fix tests

* Fix private teams tests

* Fix cypress.config.js

* Fix tests

* Fix tests

* Fix tests

* Fix tests

* Rm test-main

---------

Co-authored-by: Michael Polidori <[email protected]>
Co-authored-by: Stephen Oni <[email protected]>

* Sync dev staging apr 14 (#671)

* Harvest dynamic configs pt. 2 (#635)

* Update ckanext-s3filestore branch

* Fix typo

* Update layer manager to use wri release

* Fix Dockerfile

* [ODP-235] Allow private and hidden teams (#537)

* update teams create and edit form

* update organization list api

* update schema

* update api

* remove extras

* fix type errors

* update user_list_wri to support private teams

* fix api call

* remove chained action

* add visibility

* fix breaking changes

* update env

* update env plugin

* fix test

* update test

* add visibility to org during dataset edit

* add test for private teams

* remove logs

* update private team functionality

* Merge branch 'priveateams' of https://github.com/wri/wri-odp into priveateams

* Merge branch 'priveateams' of https://github.com/wri/wri-odp into priveateams

* resolve conflict

* undo changes

* update organization patch and create

* add private attribute to fetched orgs

* update organization_list sql logic

* improve team visbility

* improve error message

* update private team test

* update failing test

* update test

* update settings

* update test

* update test

* update test

* update test

* update test

* update test

* update test

* update docker compose

* add tooltip

* update test

* add padlock to private teams

* add back auth plugin

* Harvest config feb 03 2025 (#637)

* Fix variable replacement in harvest worker configs and switch from /tmp path to /srv/app

* Add whoami output to start_ckan.sh

* [download_event.py] Add missing closing parenthesis

* Set supervisor home by variable

* Fix harvest config permissions

* Use CKAN_IMAGE variable instead of local image name

* Handle sed supervisor changes as root; Add start_ckan sub-script

* Revert sub-script; Always use user ckan for supervisor

* Fix sed commands

* Use root user with ckan home for supervisord

* Revert "Harvest config feb 03 2025 (#637)"

This reverts commit e68155a.

* Harvest dynamic configs pt. 3 (#638)

* Add supercronic for harvest run command (#640)

* Fix alignment

* Fix build

* Fix build

* [ODP-414] add email notification when download-flow fails (#641)

* add email notification when flow fails

* update error notification

* empty

* remove pgclient version

* update libpq

---------

Co-authored-by: Michael Polidori <[email protected]>

* Upgrade to CKAN 2.11 (#632)

* Update setup.py

* Update Members permission to team form + ODP-370 (#642)

* members can not

* update role: Editor can create sub-team and admin moving subteam from public to private should not throw error

* disabled Public option if parent is private

* Trigger CI

---------

Co-authored-by: Luccas Mateus <[email protected]>

* Change setup.py and setup.cfg

* Fix ckanext-wri install (#643)

* Improve resource location design (#646)

* Trigger CI

* [odp-426]: Add edit icon to dashboard entities (#648)

* [odp-426]: Add edit icon to dashboard entities

* update schema

* Add bulk purge collaborator issue patch (#645)

* Increase UWSGI timeouts; Extract URLs from markdown links in learn_more (#649)

* Resource location search improvements (#650)

* add authorized check to group/teams last node (#651)

* Trigger CI

* Rm global from DatafileLocation

* Trigger CI

* enable edit icon for collaborators (#652)

* Fix typo

* intgration test for collaborator permission (#654)

* enable edit icon for collaborators

* add intergration test  for dashboard collaborator permission

* Improve speed

* Improve js

* Fix prefetching

* Change color of area select tool

* Improvements map

* Remove edit icon on teams/topic page for editor (#656)

* enable edit icon for collaborators

* remove editor permision

* empty

* Fix tests

* Fix tests

* Fix tests

* Fix test

* Clear all session storage

* Fix tests

* Fix tests

* Fix private teams tests

* Fix cypress.config.js

* Fix tests

* Fix tests

* Fix tests

* Fix tests

* Fix whitespace wrap on text

* Trigger CI

* Add group admin email to workflow error mail (#663)

* enable edit icon for collaborators

* send workflow error to team admin

* removed email check

* E2etest (#657)

* enable edit icon for collaborators

* empty

* add check to ensure org is actually private

* update

* update

* fix test

* update test

* empty

* update

* update test

* update test

* update test

* update test

* update test

* update test to see if organization create api is truly working

* update test

* remove other test for now

* push update

* update env.example

* fix test

* empty

* Fix git vulnerability

* Fix git

* Add if condition (#664)

* [odp-449] Teams Implementation - Root parent Team Edit (#669)

* enable edit icon for collaborators

* admin should be able to edit root team

* ODP-447 (#668)

* ODP-447

* Fix build

* Fix tests

* Fix t ests

* Trigger CI

* [Dev] Increase proxy-read-timeout to avoid early external request disconnects (#665)

* Revert "ODP-447 (#668)"

This reverts commit 7c0e465.

* Revert "[odp-449] Teams Implementation - Root parent Team Edit (#669)"

This reverts commit 7d61dcd.

* Rm test-main

* Revert ingress changes

---------

Co-authored-by: Michael Polidori <[email protected]>
Co-authored-by: Stephen Oni <[email protected]>

* Trigger CI

* Fix ODP-430 on Staging (#677)

* Add form-id to download popup

* Sync dev staging may 12 (#685)

* Harvest dynamic configs pt. 2 (#635)

* Update ckanext-s3filestore branch

* Fix typo

* Update layer manager to use wri release

* Fix Dockerfile

* [ODP-235] Allow private and hidden teams (#537)

* update teams create and edit form

* update organization list api

* update schema

* update api

* remove extras

* fix type errors

* update user_list_wri to support private teams

* fix api call

* remove chained action

* add visibility

* fix breaking changes

* update env

* update env plugin

* fix test

* update test

* add visibility to org during dataset edit

* add test for private teams

* remove logs

* update private team functionality

* Merge branch 'priveateams' of https://github.com/wri/wri-odp into priveateams

* Merge branch 'priveateams' of https://github.com/wri/wri-odp into priveateams

* resolve conflict

* undo changes

* update organization patch and create

* add private attribute to fetched orgs

* update organization_list sql logic

* improve team visbility

* improve error message

* update private team test

* update failing test

* update test

* update settings

* update test

* update test

* update test

* update test

* update test

* update test

* update test

* update docker compose

* add tooltip

* update test

* add padlock to private teams

* add back auth plugin

* Harvest config feb 03 2025 (#637)

* Fix variable replacement in harvest worker configs and switch from /tmp path to /srv/app

* Add whoami output to start_ckan.sh

* [download_event.py] Add missing closing parenthesis

* Set supervisor home by variable

* Fix harvest config permissions

* Use CKAN_IMAGE variable instead of local image name

* Handle sed supervisor changes as root; Add start_ckan sub-script

* Revert sub-script; Always use user ckan for supervisor

* Fix sed commands

* Use root user with ckan home for supervisord

* Revert "Harvest config feb 03 2025 (#637)"

This reverts commit e68155a.

* Harvest dynamic configs pt. 3 (#638)

* Add supercronic for harvest run command (#640)

* Fix alignment

* Fix build

* Fix build

* [ODP-414] add email notification when download-flow fails (#641)

* add email notification when flow fails

* update error notification

* empty

* remove pgclient version

* update libpq

---------

Co-authored-by: Michael Polidori <[email protected]>

* Upgrade to CKAN 2.11 (#632)

* Update setup.py

* Update Members permission to team form + ODP-370 (#642)

* members can not

* update role: Editor can create sub-team and admin moving subteam from public to private should not throw error

* disabled Public option if parent is private

* Trigger CI

---------

Co-authored-by: Luccas Mateus <[email protected]>

* Change setup.py and setup.cfg

* Fix ckanext-wri install (#643)

* Improve resource location design (#646)

* Trigger CI

* [odp-426]: Add edit icon to dashboard entities (#648)

* [odp-426]: Add edit icon to dashboard entities

* update schema

* Add bulk purge collaborator issue patch (#645)

* Increase UWSGI timeouts; Extract URLs from markdown links in learn_more (#649)

* Resource location search improvements (#650)

* add authorized check to group/teams last node (#651)

* Trigger CI

* Rm global from DatafileLocation

* Trigger CI

* enable edit icon for collaborators (#652)

* Fix typo

* intgration test for collaborator permission (#654)

* enable edit icon for collaborators

* add intergration test  for dashboard collaborator permission

* Improve speed

* Improve js

* Fix prefetching

* Change color of area select tool

* Improvements map

* Remove edit icon on teams/topic page for editor (#656)

* enable edit icon for collaborators

* remove editor permision

* empty

* Fix tests

* Fix tests

* Fix tests

* Fix test

* Clear all session storage

* Fix tests

* Fix tests

* Fix private teams tests

* Fix cypress.config.js

* Fix tests

* Fix tests

* Fix tests

* Fix tests

* Fix whitespace wrap on text

* Trigger CI

* Add group admin email to workflow error mail (#663)

* enable edit icon for collaborators

* send workflow error to team admin

* removed email check

* E2etest (#657)

* enable edit icon for collaborators

* empty

* add check to ensure org is actually private

* update

* update

* fix test

* update test

* empty

* update

* update test

* update test

* update test

* update test

* update test

* update test to see if organization create api is truly working

* update test

* remove other test for now

* push update

* update env.example

* fix test

* empty

* Fix git vulnerability

* Fix git

* Add if condition (#664)

* [odp-449] Teams Implementation - Root parent Team Edit (#669)

* enable edit icon for collaborators

* admin should be able to edit root team

* ODP-447 (#668)

* ODP-447

* Fix build

* Fix tests

* Fix t ests

* Trigger CI

* [Dev] Increase proxy-read-timeout to avoid early external request disconnects (#665)

* Odp 448 (#670)

* ODP-448

* Add extra tests

* Fix session leakage

* Fix tests

* Forgot to commit

* Fix tests

* Add required indicator for non-sysadmins (#672)

* Change data stored in orttho

* Fix odp430 (#674)

* enable edit icon for collaborators

* fix odp-430

* Trigger CI

* Add better warning

* Add extras to list of defaultvalues (#676)

* enable edit icon for collaborators

* fix odp-430

* add extras to default value

* Form-id

* Trigger CI

* [Odp 458] create/edit dataset in sub-team public (#678)

* enable edit icon for collaborators

* extend capacity so editor can create or edit dataset in subteam

* editor should be able to see public subteam in organization_list_for_user api

* parent team admin should be able to edit subteam public dataset

* add missing visbility check: public dataset can not be assigned to private team

* reshape logic

* update patch

* remove log

* update test

* empty

* [ODP-453] Teams Implementation - Edit sub team (private or public) (#675)

* Add integration tests

* Bump ckanext-hierarchy commit: fix cascading roles

* Fix tests

* Fix tests

* Fix tests

* Fix tests

* Limit setting private Teams to public only to sysadmins (#679)

* Add docs for subpaths (#568)

* Add docs for subpaths

* Force rerun pipeline

* Allow Team Admins public to private permissions (#680)

* use sysadmin key to fetch dataset collaborators (#682)

* enable edit icon for collaborators

* use sysadmin key to fetch dataset collaborators

* Hide by default when no viz available

* fix: first publish

* Fix test

* Fix caution max-w

* Set create_unowned_dataset to False; Remove dev testing GitHub Actions file

* Remove duplicate form-id

---------

Co-authored-by: Michael Polidori <[email protected]>
Co-authored-by: Stephen Oni <[email protected]>

* Sync dev staging may 21 (#689)

* Harvest dynamic configs pt. 2 (#635)

* Update ckanext-s3filestore branch

* Fix typo

* Update layer manager to use wri release

* Fix Dockerfile

* [ODP-235] Allow private and hidden teams (#537)

* update teams create and edit form

* update organization list api

* update schema

* update api

* remove extras

* fix type errors

* update user_list_wri to support private teams

* fix api call

* remove chained action

* add visibility

* fix breaking changes

* update env

* update env plugin

* fix test

* update test

* add visibility to org during dataset edit

* add test for private teams

* remove logs

* update private team functionality

* Merge branch 'priveateams' of https://github.com/wri/wri-odp into priveateams

* Merge branch 'priveateams' of https://github.com/wri/wri-odp into priveateams

* resolve conflict

* undo changes

* update organization patch and create

* add private attribute to fetched orgs

* update organization_list sql logic

* improve team visbility

* improve error message

* update private team test

* update failing test

* update test

* update settings

* update test

* update test

* update test

* update test

* update test

* update test

* update test

* update docker compose

* add tooltip

* update test

* add padlock to private teams

* add back auth plugin

* Harvest config feb 03 2025 (#637)

* Fix variable replacement in harvest worker configs and switch from /tmp path to /srv/app

* Add whoami output to start_ckan.sh

* [download_event.py] Add missing closing parenthesis

* Set supervisor home by variable

* Fix harvest config permissions

* Use CKAN_IMAGE variable instead of local image name

* Handle sed supervisor changes as root; Add start_ckan sub-script

* Revert sub-script; Always use user ckan for supervisor

* Fix sed commands

* Use root user with ckan home for supervisord

* Revert "Harvest config feb 03 2025 (#637)"

This reverts commit e68155a.

* Harvest dynamic configs pt. 3 (#638)

* Add supercronic for harvest run command (#640)

* Fix alignment

* Fix build

* Fix build

* [ODP-414] add email notification when download-flow fails (#641)

* add email notification when flow fails

* update error notification

* empty

* remove pgclient version

* update libpq

---------

Co-authored-by: Michael Polidori <[email protected]>

* Upgrade to CKAN 2.11 (#632)

* Update setup.py

* Update Members permission to team form + ODP-370 (#642)

* members can not

* update role: Editor can create sub-team and admin moving subteam from public to private should not throw error

* disabled Public option if parent is private

* Trigger CI

---------

Co-authored-by: Luccas Mateus <[email protected]>

* Change setup.py and setup.cfg

* Fix ckanext-wri install (#643)

* Improve resource location design (#646)

* Trigger CI

* [odp-426]: Add edit icon to dashboard entities (#648)

* [odp-426]: Add edit icon to dashboard entities

* update schema

* Add bulk purge collaborator issue patch (#645)

* Increase UWSGI timeouts; Extract URLs from markdown links in learn_more (#649)

* Resource location search improvements (#650)

* add authorized check to group/teams last node (#651)

* Trigger CI

* Rm global from DatafileLocation

* Trigger CI

* enable edit icon for collaborators (#652)

* Fix typo

* intgration test for collaborator permission (#654)

* enable edit icon for collaborators

* add intergration test  for dashboard collaborator permission

* Improve speed

* Improve js

* Fix prefetching

* Change color of area select tool

* Improvements map

* Remove edit icon on teams/topic page for editor (#656)

* enable edit icon for collaborators

* remove editor permision

* empty

* Fix tests

* Fix tests

* Fix tests

* Fix test

* Clear all session storage

* Fix tests

* Fix tests

* Fix private teams tests

* Fix cypress.config.js

* Fix tests

* Fix tests

* Fix tests

* Fix tests

* Fix whitespace wrap on text

* Trigger CI

* Add group admin email to workflow error mail (#663)

* enable edit icon for collaborators

* send workflow error to team admin

* removed email check

* E2etest (#657)

* enable edit icon for collaborators

* empty

* add check to ensure org is actually private

* update

* update

* fix test

* update test

* empty

* update

* update test

* update test

* update test

* update test

* update test

* update test to see if organization create api is truly working

* update test

* remove other test for now

* push update

* update env.example

* fix test

* empty

* Fix git vulnerability

* Fix git

* Add if condition (#664)

* [odp-449] Teams Implementation - Root parent Team Edit (#669)

* enable edit icon for collaborators

* admin should be able to edit root team

* ODP-447 (#668)

* ODP-447

* Fix build

* Fix tests

* Fix t ests

* Trigger CI

* [Dev] Increase proxy-read-timeout to avoid early external request disconnects (#665)

* Odp 448 (#670)

* ODP-448

* Add extra tests

* Fix session leakage

* Fix tests

* Forgot to commit

* Fix tests

* Add required indicator for non-sysadmins (#672)

* Change data stored in orttho

* Fix odp430 (#674)

* enable edit icon for collaborators

* fix odp-430

* Trigger CI

* Add better warning

* Add extras to list of defaultvalues (#676)

* enable edit icon for collaborators

* fix odp-430

* add extras to default value

* Form-id

* Trigger CI

* [Odp 458] create/edit dataset in sub-team public (#678)

* enable edit icon for collaborators

* extend capacity so editor can create or edit dataset in subteam

* editor should be able to see public subteam in organization_list_for_user api

* parent team admin should be able to edit subteam public dataset

* add missing visbility check: public dataset can not be assigned to private team

* reshape logic

* update patch

* remove log

* update test

* empty

* [ODP-453] Teams Implementation - Edit sub team (private or public) (#675)

* Add integration tests

* Bump ckanext-hierarchy commit: fix cascading roles

* Fix tests

* Fix tests

* Fix tests

* Fix tests

* Limit setting private Teams to public only to sysadmins (#679)

* Add docs for subpaths (#568)

* Add docs for subpaths

* Force rerun pipeline

* Allow Team Admins public to private permissions (#680)

* use sysadmin key to fetch dataset collaborators (#682)

* enable edit icon for collaborators

* use sysadmin key to fetch dataset collaborators

* Hide by default when no viz available

* fix: first publish

* Fix test

* Fix caution max-w

* Update package_update auth for editor (#687)

* enable edit icon for collaborators

* update auth: editor should be able to edit public dataset

* update test

* empty

* remove package

* Add tags to prefect tasks (#688)

* Add tags to prefect tasks

* Add FLOW_DEPLOYMENT_ENV variable to test yaml

* Fix conflicts

---------

Co-authored-by: Michael Polidori <[email protected]>
Co-authored-by: Stephen Oni <[email protected]>

* Sync staging prod

---------

Co-authored-by: steveoni <[email protected]>
Co-authored-by: Michael Polidori <[email protected]>
Co-authored-by: Muhammad Ismail Shahzad <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants