Fetching all github data for a github org

[khalibartan]

Hi Team, i'm struggling to define a connection and blueprint that help me fetch data for all github repos hosted within an organization and i want this to be future proof where any new repos that get added in github devlake starts to pull data for it, how can i achieve that?

[dosubot[bot]]

Hello @khalibartan! I'm Dosu, here to help you with any bugs, questions, or to assist you in becoming a contributor. While you're waiting for a human maintainer, feel free to ask me anything!

To fetch data for all GitHub repositories within an organization and ensure that new repositories are automatically included, you can follow these steps:

1. Define a GitHub Connection: Set up a connection to your GitHub organization using DevLake's connection management endpoints. Ensure that you have the necessary permissions (repo, read:user, read:org) for accessing all repositories, including private ones ^[1].

2. Configure a Blueprint: Create a blueprint in DevLake that includes the data connection to your GitHub organization. Set the data scope to cover all repositories within the organization. This will allow DevLake to fetch data from all existing repositories ^[2].

3. Dynamic Inclusion of New Repositories: While DevLake does not explicitly mention a built-in feature for automatically detecting and including new repositories, you can periodically update the data scope in your blueprint to include any new repositories. This might involve scripting or automating the update process using DevLake's API.

4. Sync Policy: Set up a sync policy within your blueprint to define how frequently DevLake should check for updates and fetch data. This ensures that your data is kept up-to-date with any changes in the repositories ^[2].

By following these steps, you can manage your GitHub connections and blueprints in a way that is scalable and adaptable to future changes in your organization's repositories.

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other}

[klesh]

Currently, this feature is not available. However, you can write a script to call DevLake's APIs to achieve the desired outcome.

[khalibartan]

created script to do this