Pint is painful to use in large projects

[mortenscheel]

Pint Version

1.18.1

PHP Version

8.3.4

Description

I know that Pint's lack of parallelization has been discussed before in #93, #275 and #299 - but I would like to provide an example of how just how big this problem can be.

My team works on a very large modularized monolith Laravel app. Pint has to process 4698 php files.
On a new Macbook Pro with top specs, this takes at least 12 minutes, and that's when there's nothing it has to fix. When we used php-cs-fixer it took only a fraction of that time.
Of course it only takes this long when there are no cached results, but there are a lot of things that will cause the cache to be busted:

• If the php-cs-fixer dependency is updated to a newer version.
• Every time you rebuild your docker container, unless you configure Pint to store the cache inside the project folder.
• If php is updated to a newer version, even a patch release. This happens rather frequently, especially if run in a docker container using a :latest base image.
• If you run pint on your host machine and the existing cache was created in docker (or vice versa), because the results are cached using absolute paths.

Every time one of these things happen, we have to sit and wait for at least 12 minutes. That is more than just a minor annoyance, and I hope you'll agree that it's worth looking into.

Steps To Reproduce

1. Have a Laravel project containing several thousand files.
2. Run pint.
3. Go for a walk.

[github-actions]

Thank you for reporting this issue!

As Laravel is an open source project, we rely on the community to help us diagnose and fix issues as it is not possible to research and fix every issue reported to us via GitHub.

If possible, please make a pull request fixing the issue you have described, along with corresponding tests. All pull requests are promptly reviewed by the Laravel team.

Thank you!

[ejunker]

12 minutes for 4698 files seems high. For reference, I have a project with 2993 files, and it only takes 56 seconds without using cache on a Macbook Pro with an M3 Pro CPU. I'm using the Laravel preset. Maybe running pint within Docker is causing it to run slower?

[bepsvpt]

@mortenscheel

Since the pull request (#325) has not been merged, you can try the following two methods to see if they fix the performance issue:

XDEBUG_MODE=off php vendor/bin/pint

or

php -d "xdebug.mode=off" vendor/bin/pint

[mortenscheel]

@bepsvpt that was an easy 10x performance improvement 😂 Now it takes ~1 minute. I hope @taylorotwell reconsiders merging your PR.

[bepsvpt]

@mortenscheel

I'm glad to hear that the methods provided above were able to resolve the performance issue you encountered!

[Zen0x7]

@mortenscheel just to know, which types of files takes more time? On my case #299, i had a couple of files with large arrays declared, just to understand the reason behind the slow performance.

[mortenscheel]

@mortenscheel just to know, which types of files takes more time? On my case #299, i had a couple of files with large arrays declared, just to understand the reason behind the slow performance.

How do you find that out? All I can say is that the process was sluggish, but it didn't seem like it was only a couple of files that were slow.

[Zen0x7]

@mortenscheel

What you think about this?

#!/bin/bash

if [ -z "$1" ]; then
  echo "Usage: $0 <folder>"
  exit 1
fi

# Config
input_folder="$1"
command_template="./vendor/bin/pint -q"

# CPU max threads
max_parallel=$(nproc)

# Find files and run pint per file
find "$input_folder" -type f | xargs -I {} -P "$max_parallel" bash -c "$command_template {}"

[mortenscheel]

What you think about this?

I suspect each process will overwrite the cache with its own partial results. Have you tried running it twice and see if it's fast the second time?

Anyway I'm satisfied just running it with XDEBUG_MODE=off

[x-sheep]

I just tried XDEBUG_MODE=off with Pint version 1.21.2 and the speed increase is enormous. I don't have an opinion on #325 being the correct approach, but I agree that Pint should proactively disable Xdebug while it's running.

[Jubeki]

Maybe something to look forward to: Make pint 40x faster (using parallel option): #376

Hopefully this will be released soon.

[mortenscheel]

@Jubeki the moment we've all been waiting for. 🥂