Skip to content

automatic dedup #25

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
jqnatividad merged 4 commits into from
May 1, 2022
Merged

automatic dedup #25

jqnatividad merged 4 commits into from
May 1, 2022

Conversation

@jqnatividad
Copy link
Collaborator

@jqnatividad jqnatividad commented Apr 30, 2022

resolves #11

@jqnatividad
add QSV_DEDUP config
ba0fca5 
and remove defunct QSV_AUTOINDE
@jqnatividad
Implement Deduplication
4077361 
- also ensure that we delete temporary files on JobError
@jqnatividad
Document QSV_DEDUP config
3060aaa
@jqnatividad jqnatividad marked this pull request as draft April 30, 2022 02:20
@jqnatividad
better deduplication messages
d4f337f 
- also added rows to copy before starting postgres copy
- use "rows" instead of "entries" for consistency
@jqnatividad jqnatividad marked this pull request as ready for review May 1, 2022 21:27
@jqnatividad jqnatividad merged commit b3c9bb0 into master May 1, 2022
@jqnatividad jqnatividad mentioned this pull request May 3, 2022
Open
@jqnatividad jqnatividad deleted the 11-automatic-dedup branch January 18, 2023 02:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Automatic deduplication

2 participants

@jqnatividad