Skip to content

Release v2.11.0#280

Merged
cwlacewe merged 86 commits intomasterfrom
pre-2.11
Apr 14, 2025
Merged

Release v2.11.0#280
cwlacewe merged 86 commits intomasterfrom
pre-2.11

Conversation

@cwlacewe
Copy link
Copy Markdown
Contributor

@cwlacewe cwlacewe commented Apr 13, 2025

Improvements to Descriptor/Descriptor Set

  • Integration of Descriptor support in Neo4J backend
  • Expose runtime parameters of all VCL indices

New Experimental Feature

  • Orchestration in VDMS with Kubernetes for easier setup of user-defined function environments both locally and on remote servers

Bug Fixes

  • Fix provided setup script
  • Refactor test suite

Updated Dependencies

  • Upgrade Faiss version to v1.9.0
  • Add pre-commit for formatting

Updated documentation in Wiki

cwlacewe and others added 30 commits October 10, 2022 21:33
* Add generic AddBlob command
* Correct zlib and tiledb paths
* Add CSV CPP Client Plugin
* Add files to update pypi package
Co-authored-by: Ragaad <ragaad.altarawneh@intel.com>
* v2.5.0 Release (#168)
DIsable aws unit test due to [known issue] (aws/aws-sdk-cpp#2014)
formatting cleanup

Co-authored-by: Chaunte W. Lacewell <chaunte.w.lacewell@intel.com>
Address code scanning issues with remote functions and vdms client
michaelbeale-IL and others added 18 commits October 27, 2024 18:39
* Update _CI_coverage_compare.yml

changing default permissions to only content:write

* Update _CI_update.yml

* Update CI.yml

* Update _CI_coverage_compare.yml

* Update _CI_update.yml

* Update _CI_coverage_compare.yml

* Update CI.yml

* Update _CI_coverage_compare.yml
Bumps [werkzeug](https://github.com/pallets/werkzeug) from 3.0.4 to 3.0.6.
- [Release notes](https://github.com/pallets/werkzeug/releases)
- [Changelog](https://github.com/pallets/werkzeug/blob/main/CHANGES.rst)
- [Commits](pallets/werkzeug@3.0.4...3.0.6)

---
updated-dependencies:
- dependency-name: werkzeug
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Chaunte W. Lacewell <chaunte.w.lacewell@intel.com>
* Update _CI_coverage_compare.yml

* Update _CI_update.yml

* Automated updates: Format and/or coverage

* Automated updates: Format and/or coverage

* Automated updates: Format and/or coverage

---------

Co-authored-by: sys_vdms <sys_vdms@intel.com>
Co-authored-by: Chaunte W. Lacewell <chaunte.w.lacewell@intel.com>
* issue 240 fix

* Automated updates: Format and/or coverage

* Automated updates: Format and/or coverage

* Automated updates: Format and/or coverage

---------

Co-authored-by: sys_vdms <sys_vdms@intel.com>
Co-authored-by: Chaunte W. Lacewell <chaunte.w.lacewell@intel.com>
* fix for issue 237

* Automated updates: Format and/or coverage

* Automated updates: Format and/or coverage

* Automated updates: Format and/or coverage

* Automated updates: Format and/or coverage

---------

Co-authored-by: sys_vdms <sys_vdms@intel.com>
Co-authored-by: Chaunte W. Lacewell <chaunte.w.lacewell@intel.com>
* Update _CI_coverage_compare.yml

* Update _CI_update.yml

* Automated updates: Format and/or coverage

* Automated updates: Format and/or coverage

---------

Co-authored-by: sys_vdms <sys_vdms@intel.com>
…#251)

* Update faiss version in both Dockerfiles

* update Faiss version to latest and add IP metric to Flat HNSW

* Automated updates: Format and/or coverage

---------

Co-authored-by: s-gobriel <sameh.gobriel@intel.com>
Co-authored-by: sys_vdms <sys_vdms@intel.com>
* Enable pre-commit (lint, format, line endings, and remove trailing whitespace) and apply to code

* Remove comments from lint tests

* Update workflow and remove formatting

* Remove auto-formatter.sh as no longer needed

* Add action to run precommit on pushes

* Insert change that should be fixed by precommit

* link precommit and CI workflows

* Fix inserted issue to run CI

* Remove concurrency to see if CI is triggered

* try to merge workflows as ci isnt triggering

* Insert change that should be fixed by precommit

* Update CI

* fix trigger

* fix precommit trigger

* fix precommit permissions

* Fix update trigger

* Fix inserted issue

* Clean workflow scripts

* Insert whitespace to verify CI

* [pre-commit.ci lite] apply automatic fixes

* Update error message if precommit fails

* Covert all code to Google coding style

* Update push config in workflow

* clear cache command

* Remove comments in update CI and add reference to Developer Guide to point to pre-commit instructions

* Remove check push failure workflow

* Update commit cmd.

* fix permission

* Update commit cmd.

* Remove token from update workflow

* Automated coverage update

---------

Co-authored-by: pre-commit-ci-lite[bot] <117423508+pre-commit-ci-lite[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
* Fix issue related to the installation of Python

* Update the setup_vdms.sh script to update the new to the Python3+

The script file was updated to only "upgrade" the version of Python
when the current version is lower than the minimum version needed

Also some other script files were updated to call python3 only

* Automated updates: Format and/or coverage

* Automated updates: Format and/or coverage

* Update the code according to suggestions in PR 236

* Automated updates: Format and/or coverage

* Automated updates: Format and/or coverage

* Automated updates: Format and/or coverage

* 236 Fix some bugs found during the installation of Python in the setup_vdms file

* 236 Remove command which is not needed anymore in setup_vdms file

* Automated coverage update

---------

Co-authored-by: sys_vdms <sys_vdms@intel.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
* Expose runtime and build  parameters of all the VCL indices

* removed comments

* Updated descriptor set tests

* fix bug for python test

* [pre-commit.ci lite] apply automatic fixes

* Automated coverage update

* Update unit test files

* [pre-commit.ci lite] apply automatic fixes

* Automated coverage update

---------

Co-authored-by: pre-commit-ci-lite[bot] <117423508+pre-commit-ci-lite[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Chaunte W. Lacewell <chaunte.w.lacewell@intel.com>
* 276 Add new script, fixes to some bugs found and changes to current scripts

* 276 Apply format in Python files

* 276 Fix compilation error when merging the file

* 276 Update some tests and run_all_tests.py file

* 276 Fix code scanning alert no. 18

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>

* 276 Fix code scanning alert

* 276 Enabled the option of printing out the log files generated by the C++ tests

* 276 Attempt to print out the logs created by the testing process

* 276 Another attempt to print out the contents of the logs

* Update CI.yml

Updating permissions for Results Job to add content: write to pass to CI_Coverage_compare.

* 276 Add one new line just to trigger the CI/CD process

* 276 Attempt to print out the logs in case of any errors

* 276 Add new step in the _CI_coverage.yml file
    Print out the log files created by the testing

* 276 Attempt to print the logs of the testing

* 276 Display the python version
    Update run_all_tests.py to use python3

* 276 Add import skvideo.io to the function files

* 276 Attempt to reload the skvideo module during the testing

* 276 Reload the cv2 library for fixing issue during the testing

* 276 Python 3.12 version used in the run_all_tests.py file
    Attempt to check if the requirements are installed correctly

* 276 Attempt to fix the issue related to the mp4 encoder missing

* 276 Show error message in QueryHandler.CustomFunctionNoProcess test

* 276 Remove QueryHandler.CustomFunctionNoProcess test

* 276 Fix run_all_tests.py file to retrieve the coverage for the Python tests

* Automated updates: Format and/or coverage

* 276 Bring back the execution of the E2E tests for Neo4J

* 276 Fix a compilation error due to a missing include in utils.h file

* Automated updates: Format and/or coverage

* 276 Remove any calls to CustomVCL class

* Automated updates: Format and/or coverage

* 276 Add debug message for checking the call to "cleanup_query()" function

* 276 Fix compilation errors after merge commit

* [pre-commit.ci lite] apply automatic fixes

* 276 Fix errors reported during the pre-commit stage

* [pre-commit.ci lite] apply automatic fixes

* 276 Add debug messages to check where cleanup_error() is called

* 276 Apply linting and formatting fixes

* 276 Update older scripts to delete temporary database directories

* 276 Add new tests cases

* 276 Remove typo

* Automated coverage update

* 276 Removing debugging messages

* 276 Remove commented line

* 276 More fixes according to feedback received from PR

* Automated coverage update

* 276 Move the logic to set the haarcascade_frontalface_default_path variable

* 276 Update the README files

* 276 Remove the duplicated files of the haarcascade_frontalface_default file

* 276 Add resources dir to the repo

* 276 Remove hardcoded pid to the tests in TestScript
    Add random pid values to those tests

* 276 Fix error in the path to the xml required by UDF tests

* 276 Remove in Server the lines related to delete the DB

* 276 Fix typo in the path to the file

* 276 Add more information to the error messages

* 276 Fix path to file

* 276 Fix errors related to the path of the files

* 276 Add resources dir to the container

* 276 Update the path to the resource file
    Remove unused parameters in some functions

* 276 Fix bug related to the paths which were not being found correctly

* Automated coverage update

* 276 Remove hardcoded values for the mocked pids in TestScript.py file

* 276 Bring back the use of the previous library in the caption.py files

* 276 Fix some wrong paths in one of the CI/CD files

* Revert "276 Bring back the use of the previous library in the caption.py files"

This reverts commit de9a709.

* 276 Update the code in caption.py files for using the fps from the input video

* 276 Update the caption.py files

* 276 Add missing PMGDQueryHandler::destroy() call in two unit tests

* Automated coverage update

---------

Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
Co-authored-by: Michael Beale <michael.beale@intel.com>
Co-authored-by: sys_vdms <sys_vdms@intel.com>
Co-authored-by: pre-commit-ci-lite[bot] <117423508+pre-commit-ci-lite[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
…ary directory parameter. (#278)

* 277 Update the README files and also add the default value for
    temporary directory

* Automated coverage update

* 277 Update the README file to explain where the resources dir should be copied to

* 277 Update the README file to fix a typo in the instructions

* Automated coverage update

* 277 Fix indent error in README file

---------

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
* Initial stub out and compilation

* WiP commit

* updated api schema, now correctly validating

* adddescriptor set now working

* find descriptor set bare bones working

* WIP

* Basic find descriptor flow up and running

* WiP commit

* WiP neo4j descriptor set

* pre-commit cleanup

* WiP, does not compile, integrating PR tests, need to merge develop in

* build fix, back to normal check in cadence

* Basic tests working, updating for integration into CI/CD

* autocheck tweaks

* fixing test script-undoing comment that nuked UDF testing for local testing

* workflow fix

* missing env setting

* script bug fix

* Update _CI_coverage.yml for Handler test

Added minio params to test call and restart neo4j

* Automated coverage update

* descriptor set update and merge

* script updates

* 210 Update the filter for the non remote C++ tests to include the Neo4j Handler tests

* 210 Remove test called CustomFunctionNoProcess

* Automated coverage update

* Automated coverage update

---------

Co-authored-by: Chaunte W. Lacewell <chaunte.w.lacewell@intel.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Rolando Quesada <rolando.quesada.jimenez@intel.com>
* srck8s

* k8sfolder

* minor changes

* latest

imagecommandchanges

* latest

k8sfixes

* latest

k8sfixes1

* latest

k8sfixes2

* latest

k8sfixes3

* readmeupdate

* localContainerCheckOK

* dependency

* makeFix

* dcokerfileupdate

* dockerfileupdate

* readme updates and config fixes

* readme updates and config fixes

* Dockerfile update for kube client install

* Dockerfile mods for kube client install

* checkin docker file update

* checkin docker file update bazel

* readme and docker file updates

* dockerfile updates

* test case updates

* kubehelper test

* adding missing file

* [pre-commit.ci lite] apply automatic fixes

* optional kubernetes install

* [pre-commit.ci lite] apply automatic fixes

* Automated coverage update

* addressed review comments

* Automated coverage update

* checkin dockerfile condition update

* Automated coverage update

* Format Dockerfiles, convert wget to curl, remove duplicate 'option' i… (#272)

* Format Dockerfiles, convert wget to curl, remove duplicate 'option' in CMakeLists due to cmake warning and centralized in main CmakeLists

* Fix base Dockerfile indention

---------

Signed-off-by: cwlacewe <chaunte.w.lacewell@intel.com>

* minor fix for CMakeLists

* added K8s test files to python test script

* [pre-commit.ci lite] apply automatic fixes

* path fix

* removed stray text in test file

* [pre-commit.ci lite] apply automatic fixes

* updates to cleandb

---------

Signed-off-by: cwlacewe <chaunte.w.lacewell@intel.com>
Co-authored-by: Rohit Verma <rohit1.verma@intel.com>
Co-authored-by: pre-commit-ci-lite[bot] <117423508+pre-commit-ci-lite[bot]@users.noreply.github.com>
Co-authored-by: Chaunte W. Lacewell <chaunte.w.lacewell@intel.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Signed-off-by: Lacewell, Chaunte W <chaunte.w.lacewell@intel.com>
Signed-off-by: Lacewell, Chaunte W <chaunte.w.lacewell@intel.com>
Signed-off-by: Lacewell, Chaunte W <chaunte.w.lacewell@intel.com>
@cwlacewe cwlacewe requested review from keirafadams and rolandoquesada and removed request for keirafadams April 14, 2025 00:02
@cwlacewe cwlacewe marked this pull request as ready for review April 14, 2025 00:03
@cwlacewe cwlacewe requested a review from keirafadams April 14, 2025 00:04
rolandoquesada
rolandoquesada previously approved these changes Apr 14, 2025
Copy link
Copy Markdown
Contributor

@rolandoquesada rolandoquesada left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The changes look good to me. However, there are some git conflicts and coverage issues to be solved though.

Signed-off-by: Lacewell, Chaunte W <chaunte.w.lacewell@intel.com>
@cwlacewe cwlacewe dismissed rolandoquesada’s stale review April 14, 2025 19:02

The merge-base changed after approval.

@cwlacewe cwlacewe merged commit 90721ba into master Apr 14, 2025
2 checks passed
@cwlacewe cwlacewe added this to the v2.11.0 Tasks milestone Apr 15, 2025
@cwlacewe cwlacewe deleted the pre-2.11 branch October 24, 2025 20:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

10 participants