I tested this now, but unfortunately no comments are created for me. Did you have any success?

I don't see any output from octokit, so I'm not even sure, whether the POST request is executed at all.

Possible problems:

• creating issue comments requires write permission. A PR from a forked repository only has read permissions (see https://docs.github.com/en/actions/using-workflows/workflow-syntax-for-github-actions#permissions ).
• The default token, that is generated for a action, might not necessarily work for that reason.
• Since we use the token now also to create comments, we should probably update the documentation for the token parameter (it's now not only used for "analyzeModifiedFilesOnly").
• Executing the POST Requests locally with curl with my own PAT works. (Note: I added some logging in d80fd94 and efcf6fa). So, the general data should be fine, but since Octokit doesn't log anything at all...
• I tried around a bit with await/async, since the request is a promise and is executed asynchrounously, so it might happen, that the request are not executed before the action finishes. But that didn't change anything (60d1c0e, 29996a5, 1462bb4)
• See Test Pull Request with Comments pmd-github-action-tests#15 for the last Test PR (which is from the same repo, so it indeed has write access to create comments).
  • build output: https://github.com/pmd/pmd-github-action-tests/actions/runs/7569416067/job/20612658017#step:4:221

  About to create 1 comments now for PR #15
  ##[debug]POST /repos/pmd/pmd-github-action-tests/issues/15/comments with {"owner":"pmd","repo":"pmd-github-action-tests","issue_number":15,"body":":heavy_exclamation_mark: (2) - AvoidCatchingThrowableSample.java (Line:5)\n:heavy_exclamation_mark: (2) - AvoidCatchingThrowableSample.java (Line:12)"}
  Finished creating comments.
  

• Test procedure: https://github.com/pmd/pmd-github-action-tests/tree/java#pull-request-with-comments

Many thanks for your investigation. I'll close the PR for now. I'll reopen PR once I resolve all the issues.