Skip to content

🐛 Source Github: decrease discovery time #36429

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Mar 26, 2024

Conversation

davydov-d
Copy link
Contributor

@davydov-d davydov-d commented Mar 24, 2024

What

https://github.com/airbytehq/oncall/issues/3467

How

There were two bottlenecks that have been tackled:

  • a broad repository name pattern (<org_name>/*) did not allow specifying a a subset of repos narrow enough
  • retrieving all repos' branches at discovery time affected it heavily

So:

  • now spec supports repo names like airbytehq/airb*
  • branches discovery is moved to the Commits stream where it is dirtectly used

Copy link

vercel bot commented Mar 24, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Updated (UTC)
airbyte-docs ✅ Ready (Inspect) Visit Preview Mar 24, 2024 5:01pm

@octavia-squidington-iii octavia-squidington-iii added area/connectors Connector related issues area/documentation Improvements or additions to documentation connectors/source/github labels Mar 24, 2024
@octavia-squidington-iv octavia-squidington-iv requested review from a team March 24, 2024 17:03
@davydov-d davydov-d merged commit 003fc6e into master Mar 26, 2024
@davydov-d davydov-d deleted the ddavydov/source-github-increase-discovery-time branch March 26, 2024 18:36
@davydov-d davydov-d changed the title 🐛 Source Github: increase discovery time 🐛 Source Github: decrease discovery time Mar 26, 2024
nurikk pushed a commit to nurikk/airbyte that referenced this pull request Apr 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connectors Connector related issues area/documentation Improvements or additions to documentation connectors/source/github
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants