Skip to content

A CLI for magically managing you package.json overrides (or resolutions) πŸ‘©πŸ½β€πŸŒΎ

License

Notifications You must be signed in to change notification settings

yowainwright/pastoralist

Repository files navigation

Typed with TypeScript npm version ci Github Twitter

Manage your package.json *overrides, resolutions, and patches with ease!

With the Pastoralist CLI, you can ensure your project's overrides (or resolutions) and patches are kept up-to-date by running a single one word command! Jump to setup or scroll on!


What are *overrides and resolutions?

Overrides and resolutions solve the same problem!
They give developers a way to specify dependency versions downloaded to a repository's node_modules folder.

Node package manager CLIs, like npm, yarn, and pnpm, enable engineers to solve dependency specificity issues by adding an overrides or resolutions object to a repository's root package.json. This is awesome for fixing dependency issues with security and/or code. Read more about npm, yarn, and pnpm overrides or resolution solutions.


Why is Pastoralist Awesome?

Is the override still needed? Is there a better fix? Like a security patch or a major release?

After using overrides or resolutions to fix dependency specificity issues for a while, it is easy to lose track of why a dependency is in an overrides or resolutions package.json object! This is an inconvenient problem when trying to maintain dependencies over time. This information is not really knownβ€”until now!

With Pastoralist CLI, you can run the pastoralist CLI command and an overrides (resolution) object that looks like this:

// Note the trim dependency in overrides
"overrides": {
  "trim": "^0.0.3"
},

Will look like this:

// Note the trim dependency is now added to the appendix
"overrides": {
  "trim": "^0.0.3"
},
"pastoralist": {
  "appendix": {
    "trim@^0.0.3": {
      "dependents": {
        "remark-parse": "4.0.0"
      }
    }
  }
}

But there's more!

If Pastoralist is run and an override or resolution is no longer required, Pastoralist will remove the dependency from pastoralist.appendix, overrides, or resolutions!

AKA, the object above, will now look like the object below if trim is no longer needed.

// Note that since trim is no longer needed,
// it has been removed from the appendix and overrides
"overrides": {},
"pastoralist": {
  "appendix": {}
}

✨ New Features

Patch Support: Pastoralist now automatically detects and tracks patches (e.g., from patch-package) in your project:

"pastoralist": {
  "appendix": {
    "[email protected]": {
      "dependents": {
        "my-app": "lodash@^4.17.0"
      },
      "patches": ["patches/lodash+4.17.21.patch"]
    }
  }
}

Enhanced Dependency Support: Now supports peerDependencies alongside dependencies and devDependencies for complete dependency tracking.

Smart Cleanup: Get notified about unused patches when dependencies are removed:

πŸ‘ Found 2 potentially unused patch files:
  - patches/old-package+1.0.0.patch
Consider removing these patches if the packages are no longer used.

There is more to come with Pastoralist! But for now, by adding pastoralist to package.json postInstall script, you don't have to worry about installing unneeded override or resolution packages anymore!


How Pastoralist works

Pastoralist manages overrides and resolutions so you don't have to!

It is comprised of a few functions which read the root package.json file's overrides or resolutions and map the packages in them to a pastoralist.appendix object.

If Pastoralist observes an override or resolution is no longer needed, it removes it from resolutions or overrides, and the pastoralist appendix object.

This means with Pastoralist, your only concern is adding dependencies to the overrides and resolutions objects. Broken down, Pastoralist manages your overrides and resolutions with 4 simple steps demonstrated in the flow chart below.

Key notes

  1. Pastoralist does not manage what is added to overrides or resolutions objects.
  2. Pastoralist does manage dependencies that exist in a package.json's overrides or resolutions objects.
  3. Pastoralist will remove overrides and resolutions if they become unneeded according to child package.json's spec!

Using Pastoralist with Workspaces

Pastoralist operates on a single package.json at a time. In a workspace/monorepo setup, you can run Pastoralist on any package.json that has overrides by specifying its path:

# Run on root package.json
pastoralist

# Run on a workspace package
pastoralist --path packages/app-a/package.json

For detailed information about using Pastoralist in workspace/monorepo environments, including best practices and automation strategies, see Workspaces and Monorepos.


Setup

Okay! Hopefully the breakdowns above were clear enough on why you might want to use Pastoralist!

Please submit a pull request or issue if it wasn't!

Now for the super simple setup!

  1. Install
npm install pastoralist --save-dev
# pastoralist does not expect to be a dependency! It's a tool!!!
  1. run
pastoralist
# => That's it! Check out your package.json
  1. (recommended) add Pastoralist to a postInstall script
// package.json
{
  "scripts": {
    "postinstall": "pastoralist"
  }
}

Testing

Unit Tests

pnpm test

End-to-End Tests

Run comprehensive e2e tests using Docker to verify real-world scenarios:

pnpm run test-e2e

The e2e tests create a realistic monorepo workspace with lodash dependencies and verify:

  • Appendix creation and updates
  • Override version changes
  • Appendix preservation when overrides are removed (bug fix verification)
  • Cross-package dependency tracking
  • Patch detection and tracking
  • PeerDependencies support

In the near future, Pastoralist will fully support a config file but this is it for now!

Read on to understand what is going on under the hood of Pastoralist!


Pastoralist Object Anatomy

When Pastoralist is run in a repository with override or resolution dependencies, it will output a shape like below.

// package.json
"pastoralist": {
  // the appendix contains mapped resolutions/overrides
  "appendix": {
    // the resolution/override is stringified with it's version
    "trim@^0.0.3": {
      // dependents contain dependents which actually require the override/resolution dependency
      "dependents": {
        "remark-parse": "4.0.0"
      }
    }
  }
}

When ever Pastoralist is run again, it will check the pastoralist.appendix object and remove any resolutions/overrides that are no longer needed.

Thanks

Shout out to Bryant Cabrera and the infamous Mardin for all the fun conversation, insights, and pairing around this topic.


Made by @yowainwright for fun with passion! MIT, 2022

About

A CLI for magically managing you package.json overrides (or resolutions) πŸ‘©πŸ½β€πŸŒΎ

Topics

Resources

License

Code of conduct

Security policy

Stars

Watchers

Forks

Packages

No packages published

Contributors 2

  •  
  •