paths-filter/README.md
2020-08-04 20:57:29 +02:00

6.6 KiB

paths-filter status

Paths filter

With this Github Action you can execute your workflow steps only if relevant files are modified.

It saves time and resources especially in monorepo setups, where you can run slow tasks (e.g. integration tests or deployments) only for changed components. Github workflows built-in path filters doesn't allow this because they doesn't work on a level of individual jobs or steps.

Supported workflows:

  • Action triggered by pull_request event:
    • changes detected against the pull request base branch
  • Action triggered by push event:
    • changes detected against the most recent commit on the same branch before the push
    • changes detected against the top of the configured base branch (e.g. master)

Usage

Filter rules are defined using YAML format. Each filter rule is a list of glob expressions. Corresponding output variable will be created to indicate if there's a changed file matching any of the rule glob expressions. Output variables can be later used in the if clause to conditionally run specific steps.

Inputs

  • token: GitHub Access Token - defaults to ${{ github.token }} so you don't have to explicitly provide it.
  • **working-directory: Relative path under $GITHUB_WORKSPACE where the repository was checked out. Useful only if you checked out your repository under custom path.
  • base: Git reference (e.g. branch name) against which the changes will be detected. Defaults to repository default branch (e.g. master). If it references same branch it was pushed to, changes are detected against the most recent commit before the push. This option is ignored if action is triggered by pull_request event.
  • filters: Path to the configuration file or directly embedded string in YAML format. Filter configuration is a dictionary, where keys specifies rule names and values are lists of file path patterns.

Outputs

  • For each rule it sets output variable named by the rule to text:
    • 'true' - if any of changed files matches any of rule patterns
    • 'false' - if none of changed files matches any of rule patterns

Notes

  • minimatch dot option is set to true - therefore globbing will match also paths where file or folder name starts with a dot.
  • You can use YAML anchors to reuse path expression(s) inside another rule. See example in the tests.
  • If changes are detected against the previous commit and there is none (i.e. first push of a new branch), all filter rules will report changed files.
  • You can use base: ${{ github.ref }} to configure change detection against previous commit for every branch you create.

Example

on:
  push:
    branches:
      - master
  pull_request:
    branches:
      - master
jobs:
  tests:
    runs-on: ubuntu-latest
    steps:
    - uses: actions/checkout@v2
    - uses: dorny/paths-filter@v2.2.0
      id: filter
      with:
        # inline YAML or path to separate file (e.g.: .github/filters.yaml)
        filters: |
          backend:
            - 'backend/**/*'
          frontend:
            - 'frontend/**/*'          

    # run only if 'backend' files were changed
    - name: backend unit tests
      if: steps.filter.outputs.backend == 'true'
      run: ...

    # run only if 'frontend' files were changed
    - name: frontend unit tests
      if: steps.filter.outputs.frontend == 'true'
      run: ...

    # run if 'backend' or 'frontend' files were changed
    - name: e2e tests
      if: steps.filter.outputs.backend == 'true' || steps.filter.outputs.frontend == 'true'
      run: ...

If your workflow uses multiple jobs, you can put paths-filter into own job and use job outputs in other jobs if statements:

on:
  pull_request:
    branches:
      - master
jobs:
  changes:
    runs-on: ubuntu-latest
    # Set job outputs to values from filter step
    outputs:
      backend: ${{ steps.filter.outputs.backend }}
      frontend: ${{ steps.filter.outputs.frontend }}
    steps:
    # For pull requests it's not necessary to checkout the code
    - uses: dorny/paths-filter@v2.2.0
      id: filter
      with:
        # Filters stored in own yaml file
        filters: '.github/filters.yml'
  backend:
    needs: changes
    if: ${{ needs.changes.outputs.backend == 'true' }}
    steps:
      - ...
  frontend:
    needs: changes
    if: ${{ needs.changes.outputs.frontend == 'true' }}
    steps:
      - ...

How it works

  1. If action was triggered by pull request:
    • If access token was provided it's used to fetch list of changed files from Github API.
    • If access token was not provided, top of the base branch is fetched and changed files are detected using git diff-index <SHA> command.
  2. If action was triggered by push event
    • if base input parameter references same branch it was pushed to, most recent commit before the push is fetched
    • If base input parameter references other branch, top of that branch is fetched
    • changed files are detected using git diff-index FETCH_HEAD command.
  3. For each filter rule it checks if there is any matching file
  4. Output variables are set

Difference from similar projects:

  • Has Changed Path
    • detects changes from previous commit
    • you have to configure checkout action to fetch some number of previous commits
    • outputs only single true / false value if any of provided paths contains changes
  • Changed Files Exporter
    • outputs lists with paths of created, updated and deleted files
    • output is not directly usable in the if clause
  • Changed File Filter
    • allows change detection between any refs or commits
    • fetches whole history of your git repository
    • might have negative performance impact on big repositories (github by default fetches only single commit)