Skip to content

Conversation

@fmeum
Copy link
Collaborator

@fmeum fmeum commented Apr 16, 2025

RELNOTES: The contents of source directories are now tracked for invalidation. Using glob to consume source directories is still strongly preferred, but there may be cases in which this isn't feasible (e.g. file names that aren't valid labels).

Fixes #25834

@fmeum fmeum force-pushed the 25834-flip-source-directory branch 2 times, most recently from e92da87 to f9a3684 Compare April 16, 2025 09:59
@fmeum fmeum force-pushed the 25834-flip-source-directory branch from 640d4ae to 29f481d Compare May 20, 2025 09:12

/**
* A flag to enable / disable tracking of source directories. Uses a system property which can be
* set via a startup flag. The intention is for this code to be temporary, so I didn't want to add
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can update this comment, but as I don't know the situation at Google, I would need suggestions from you.

@fmeum fmeum changed the title Enable source directory tracking by default Track source directory contents by default May 20, 2025
@fmeum fmeum marked this pull request as ready for review May 20, 2025 09:51
@fmeum fmeum requested review from fweikert and gregestren as code owners May 20, 2025 09:51
@fmeum fmeum requested review from tjgq and removed request for fweikert and gregestren May 20, 2025 09:51
@github-actions github-actions bot added team-Documentation Documentation improvements that cannot be directly linked to other team labels awaiting-review PR is awaiting review from an assigned reviewer labels May 20, 2025
@iancha1992 iancha1992 added the team-Remote-Exec Issues and PRs for the Execution (Remote) team label May 20, 2025
copybara-service bot pushed a commit that referenced this pull request Aug 7, 2025
Preparation for #25870

Closes #26698.

PiperOrigin-RevId: 792236653
Change-Id: Iaf10cc32c4938987a6afef1b73081666963435b2
@fmeum
Copy link
Collaborator Author

fmeum commented Aug 7, 2025

@tjgq I rebased onto master.

fmeum added 4 commits August 7, 2025 20:56
# Conflicts:
#	src/test/java/com/google/devtools/build/lib/skyframe/BUILD
#	src/test/shell/integration/execution_phase_tests.sh
@fmeum fmeum requested a review from tjgq August 7, 2025 21:07
@tjgq tjgq added awaiting-PR-merge PR has been approved by a reviewer and is ready to be merge internally and removed awaiting-review PR is awaiting review from an assigned reviewer awaiting-PR-merge PR has been approved by a reviewer and is ready to be merge internally labels Aug 25, 2025
@tjgq tjgq added the awaiting-review PR is awaiting review from an assigned reviewer label Aug 25, 2025
@tjgq
Copy link
Contributor

tjgq commented Aug 25, 2025

LGTM, but it probably won't get submitted before next week (I want to get an ack from a couple of folks who are currently OOO).

@copybara-service copybara-service bot closed this in a36ce44 Sep 5, 2025
@github-actions github-actions bot removed the awaiting-review PR is awaiting review from an assigned reviewer label Sep 5, 2025
@fmeum fmeum deleted the 25834-flip-source-directory branch October 25, 2025 19:09
fmeum added a commit to fmeum/bazel that referenced this pull request Oct 25, 2025
Preparation for bazelbuild#25870

Closes bazelbuild#26698.

PiperOrigin-RevId: 792236653
Change-Id: Iaf10cc32c4938987a6afef1b73081666963435b2
(cherry picked from commit f12e843)
fmeum added a commit to fmeum/bazel that referenced this pull request Oct 25, 2025
RELNOTES: The contents of source directories are now tracked for invalidation. Using `glob` or explicit lists of files to consume source directories is still strongly preferred, but there may be cases in which this isn't feasible (e.g. file names that aren't valid labels).

Fixes bazelbuild#25834

Closes bazelbuild#25870.

PiperOrigin-RevId: 803387098
Change-Id: Ibf9ecf86289226c3cde1b09a802c61451b02bfba
(cherry picked from commit a36ce44)
dd-mergequeue bot pushed a commit to DataDog/datadog-agent that referenced this pull request Jan 15, 2026
### What does this PR do?
Bump `bazel` version from [8.4.2](https://github.com/bazelbuild/bazel/releases/tag/8.4.2) to [8.5.1](https://github.com/bazelbuild/bazel/releases/tag/8.5.1).

To make that happen, we also need to:
- specify which `bash` to use on Windows when evaluating **repository** rules, for compatibility with bazelbuild/bazel#26927:
  ```
  ERROR: /path/to/external/bazel_tools/tools/test/BUILD:23:10: in sh_binary rule @@bazel_tools//tools/test:collect_coverage: 
  Error in fail: No suitable shell toolchain found:
  * if you are running Bazel on Windows, set the BAZEL_SH environment variable to the path of bash.exe
  ```
  (actual job output: https://gitlab.ddbuild.io/DataDog/datadog-agent/-/jobs/1349246422#L77)
- bump `rules_go` from (implicit) [0.57.0](https://github.com/bazel-contrib/rules_go/releases/tag/v0.57.0) to (explicit) [0.59.0](https://github.com/bazel-contrib/rules_go/releases/tag/v0.59.0) for bazel-contrib/rules_go/pull/4493 to be compatible with bazelbuild/bazel/pull/27296:
  ```
  Error: 'Facts' value has no field or method 'clear'
  ```

### Motivation
1. this upgrade alone brings several improvements and bug fixes, among which:
- bazelbuild/bazel#27117
- bazelbuild/bazel#27296
- bazelbuild/bazel#27417, covers:
  - bazelbuild/bazel#25834
  - bazelbuild/bazel#25863
  - bazelbuild/bazel#25864
  - bazelbuild/bazel#25870
  - bazelbuild/bazel#26698
- bazelbuild/bazel#27531
- bazelbuild/bazel#27560
- bazelbuild/bazel#27564
- bazelbuild/bazel#27705
- bazelbuild/bazel#27995
- bazelbuild/bazel#27996

2. `bazel` 9.0 is due soon, so better off favoring incremental bumps.

### Additional Notes
Leveraging [the latter](bazelbuild/bazel#27996) might allow us to later reconsider whether we'd like to go back to the `--remote_cache` flag (instead of the `--remote_executor` flag that we had to switch to in #44962).

Co-authored-by: regis.desgroppes <regis.desgroppes@datadoghq.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

team-Documentation Documentation improvements that cannot be directly linked to other team labels team-Remote-Exec Issues and PRs for the Execution (Remote) team

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Enable BAZEL_TRACK_SOURCE_DIRECTORIES by default

3 participants