Skip to content
This repository was archived by the owner on Sep 30, 2024. It is now read-only.

fix(search_jobs): progress reporting#64287

Merged
stefanhengl merged 2 commits into
mainfrom
stefan-splf-184-only-show-completed-tasks-while-search-job-is-in-status
Aug 6, 2024
Merged

fix(search_jobs): progress reporting#64287
stefanhengl merged 2 commits into
mainfrom
stefan-splf-184-only-show-completed-tasks-while-search-job-is-in-status

Conversation

@stefanhengl

@stefanhengl stefanhengl commented Aug 6, 2024

Copy link
Copy Markdown
Member

Relates to #64186

With this PR we only show 83 out of 120 tasks if the search job is currently processing. In all other states, we don't show this stat. This is a consequence of the janitor job I recently added, because after aggregation, this data is not available anymore. User's can still inspect the logs and download results to get a detailed view of which revisions were searched.

I also remove an unnecessary dependency of the download links on the job state.

Test plan:

Screenshot 2024-08-05 at 18 57 54

I ran a search job locally and confirmed that the progress message is only visible while the job is processing and that logs and downloads are always available.

Changelog

  • Show detailed progress only while job is in status "processing"
  • Remove dependency of download links on job state

Relates to #64186

With this PR we only show `83 out of 120 tasks` if the search job is
currently processing. In all other states, we don't show this stats.
This is a consequence of the janitor job. After aggregation, this data
is not available anymore.

I remove an unncessary restriction on the download of logs and results.

Test plan:
I ran a search job locally and confirmed that the progress message is
only visible while the job is processing and that logs and downloads are
always available.
@cla-bot cla-bot Bot added the cla-signed label Aug 6, 2024
@github-actions github-actions Bot added team/product-platform team/search-platform Issues owned by the search platform team labels Aug 6, 2024
@stefanhengl stefanhengl requested a review from a team August 6, 2024 06:02
@stefanhengl stefanhengl marked this pull request as ready for review August 6, 2024 06:03
return nil, err
}
return pointers.Ptr(exportPath), nil
exportPath, err := url.JoinPath(conf.Get().ExternalURL, fmt.Sprintf("/.api/search/export/%d.jsonl", r.Job.ID))

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just double-checking: the results and logs are still available while the job is in progress, right?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes. Results and logs are always available.

@stefanhengl stefanhengl merged commit 1559752 into main Aug 6, 2024
@stefanhengl stefanhengl deleted the stefan-splf-184-only-show-completed-tasks-while-search-job-is-in-status branch August 6, 2024 09:16
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

cla-signed team/product-platform team/search-platform Issues owned by the search platform team

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants