Skip to content

✨ Source Azure Blob Storage: add client_credentials auth #50398

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 16 commits into from
Jan 6, 2025

Conversation

vpipkt
Copy link
Contributor

@vpipkt vpipkt commented Dec 23, 2024

What

In connector source-azure-blob-storage, allow authentication to Azure using client_credentials type of grant. This is a common pattern for accessing Azure resources using a Service Principal's app registration.

How

Add a third option to the authentication for using only tenant id, client id and client secret; Add a new Authenticator inheriting the Oauth2Authenticator that sets options specific to Azure's requirements found here.

Review guide

  1. stream_reader.py add another Authenticator class and wire it up to spec
  2. unit_tests
    0. test_config_migration: use a temp file so test execution doesn't overwrite files in git
    4. add a simple test for new Authenticator

User Impact

Adds a new option to authenticate using Service Principals. Should not impact existing authentication patterns

Can this PR be safely reverted and rolled back?

  • YES 💚
  • NO ❌

Copy link

vercel bot commented Dec 23, 2024

@vpipkt is attempting to deploy a commit to the Airbyte Growth Team on Vercel.

A member of the Team first needs to authorize it.

@vpipkt vpipkt temporarily deployed to community-ci-auto December 23, 2024 10:20 — with GitHub Actions Inactive
@vpipkt vpipkt changed the title Feat/az blob client cred Source Azure Blob Storage: add client_credentials auth Dec 23, 2024
@vpipkt vpipkt changed the title Source Azure Blob Storage: add client_credentials auth ✨ Source Azure Blob Storage: add client_credentials auth Dec 23, 2024
@marcosmarxm
Copy link
Member

marcosmarxm commented Dec 23, 2024

/format-fix

Format-fix job started... Check job output.

✅ Changes applied successfully. (d8c9540)

forgot to reset patch version
@marcosmarxm
Copy link
Member

running tests again.

@vpipkt vpipkt requested a review from marcosmarxm January 3, 2025 08:36
@vpipkt
Copy link
Contributor Author

vpipkt commented Jan 3, 2025

I really don't see how to move forward past test failures. Locally I am missing a bunch of environment variables and also the source-azure-blob-storage/secrets directory referenced in the acceptance test config. I also cannot see the output from CI runs here.

Copy link

vercel bot commented Jan 6, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
airbyte-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jan 6, 2025 7:37pm

@marcosmarxm marcosmarxm merged commit 01363dd into airbytehq:master Jan 6, 2025
30 checks passed
@vpipkt
Copy link
Contributor Author

vpipkt commented Jan 8, 2025

thank you so very very much @marcosmarxm 🙇

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connectors Connector related issues area/documentation Improvements or additions to documentation community connectors/source/azure-blob-storage
Projects
Development

Successfully merging this pull request may close these issues.

4 participants