ENG-1440: refactoring factories to aiXplain SDK v2 #371

thiago-aixplain · 2025-01-19T14:41:56Z

Assets:

api key
corpus
data
dataset
wallet

aixplain/v2/api_key.py

kadirpekel · 2025-01-20T15:40:06Z

aixplain/v2/corpus.py

+        return CorpusFactory.list(**kwargs)["results"]
+
+    @classmethod
+    def create(


Again. We have CreateResourceMixin should be better applied.

kadirpekel · 2025-01-20T15:40:27Z

aixplain/v2/dataset.py

+class Dataset(
+    BaseResource,
+    ListResourceMixin[DatasetListParams, "Dataset"],
+    GetResourceMixin[BareGetParams, "Dataset"],


Again. We have CreateResourceMixin should be better applied.

kadirpekel · 2025-01-20T15:41:55Z

aixplain/v2/finetune.py

    BareCreateParams,
 )

-if TYPE_CHECKING:


Why did you modified here like so. Importing those modules directly will cause error because it will ask for environment variables to be set as in the legacy.

kadirpekel · 2025-01-20T15:43:43Z

aixplain/v2/api_key.py

+
+    @classmethod
+    def list(cls) -> Dict:
+        return APIKeyFactory.list()


Without knowing the exact return object here but we should extract the actual list containing the related objects.

kadirpekel · 2025-01-21T08:56:56Z

aixplain/v2/api_key.py

+        import aixplain.utils.config as config
+
+        api_key = kwargs.get("api_key", config.TEAM_API_KEY)
+        return APIKeyFactory.get(api_key=api_key)


We need to wrap the the returned objects with the Resource class itself where it needs across the PR.

* ENG-1332: Started implementing new aixplain programmatic api * ENG-1332: removed legacy counterparts * ENG-1332: many improvements * ENG-1332: reorganization on the module structure * ENG-1332: packaging tweak * ENG-1332: enums autogenerated with foundation * ENG-1332: fixed and completed enums foundation * ENG-1332: bug fix * ENG-1332: generate.py called with prod account * ENG-1332: enums.py cleaned up * ENG-1332: relocated v2 module into main aixplain module * ENG-1332: fixed dynamic enum assignment * ENG-1332: static enum and resource definition on main class * ENG-1332: first set of unit tests for v2 * ENG-1332: base resource unit tests for v2 * ENG-1332: completed critical unit tests for v2 * ENG-1332: fixed type hints to make autocompletion work well * ENG-1332: Many improvements on class structure * ENG-1332: Added missing resource implementations * ENG-1331: Fixed unit tests * added api key * removed api-key * ENG-1332: added missing factory methods. revisited typeddict optional params * ENG-1332: Main class constructor revisited * ENG-1332: fixed tests * ENG-1440: refactoring factories to aiXplain SDK v2 (#371) * Adding Wallet on v2 * Adding API Key * Data asset in v2 * Fixed create in api key and dataset * Fixes in corpus, dataset and api key new factories --------- Co-authored-by: xainaz <zaina.abushaban@aixplain.com> * ENG-1332: progress on paging * ENG-1332: removed Resource/Page wrappers * ENG-1332: Got the v2 testable through functional tests * ENG-1332: factory var name restored to original * ENG-1332: quick revisit all functional tests to employ v2 counterparts * ENG-1332: Fixed many frictions in functional test adoption * Last fixes in repo * Adding Team agent class on SDK v2 * Breaking down general assets * ENG-1332: parameterized general asset tests * ENG-1332: Fixed team agent tests * Fixing APIKey getter in v2 * ENG-1332: Several bug fixes --------- Co-authored-by: xainaz <zaina.abushaban@aixplain.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiago@aixplain.com>

* Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Merge dev to test (#126) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Add new LLMs finetuner models (mistral and solar) (#128) * Merge dev to test (#129) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enabling dataset ID and model ID as parameters for finetuner creation (#131) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fix supplier representation of a model (#132) * Fix supplier representation of a model * Fixing parameter typing --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fixing indentation in documentation sample code (#134) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Merge to test (#135) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) * Enabling dataset ID and model ID as parameters for finetuner creation (#131) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fix supplier representation of a model (#132) * Fix supplier representation of a model * Fixing parameter typing --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fixing indentation in documentation sample code (#134) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Update FineTune unit and functional tests (#136) * Merge dev to test (#137) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) * Enabling dataset ID and model ID as parameters for finetuner creation (#131) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fix supplier representation of a model (#132) * Fix supplier representation of a model * Fixing parameter typing --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fixing indentation in documentation sample code (#134) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Update FineTune unit and functional tests (#136) --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Click fix (#140) * Merge to prod (#119) * Merge dev to test (#107) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Development to Test (#109) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> * Merge to test (#111) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#118) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> * Merge to prod. (#130) * Merge dev to test (#107) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Development to Test (#109) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> * Merge to test (#111) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#118) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Merge to test (#124) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Merge dev to test (#126) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key pa…

* Merge to test (#163) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) * Enabling dataset ID and model ID as parameters for finetuner creation (#131) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fix supplier representation of a model (#132) * Fix supplier representation of a model * Fixing parameter typing --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fixing indentation in documentation sample code (#134) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Update FineTune unit and functional tests (#136) * Click fix (#140) * Merge to prod (#119) * Merge dev to test (#107) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Development to Test (#109) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> * Merge to test (#111) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#118) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> * Merge to prod. (#130) * Merge dev to test (#107) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Development to Test (#109) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> * Merge to test (#111) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#118) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Merge to test (#124) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Merge dev to test (#126) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Merge dev to test (#129) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Downgraded click Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: ikxplain <88332269+ikxplain@users.noreply.github.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * M 5905660469 enhance benchmark job response (#145) * added fetching score * add simplified benchmark job scores * add getting failuire rates * added explanations to benchmark * temp push 1 * M 5905660469 enhance benchmark job response (#146) * added fetching score * add simplified benchmark job scores * add getting failuire rates * added explanations to benchmark * temp push 1 * undo temp change * New pipeline functional tests (#143) * New pipeline functional tests * Fixe on attribute name * Fixing test cases --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@Thiagos-MacBook-Pro-2.local> * M 6107719447 check finetuner status (#133) * Finetune status object * New finetune status checker * Covering some None cases * Finetune status checker updates and new unit tests --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-126.ec2.internal> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@Thiagos-MacBook-Pro-2.local> * Update metric.py (#147) * Fixing finetune checker test and doc (#150) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@Thiagos-MacBook-Pro-2.local> * Skip model onboard and deployment tests (#153) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Saving/Update Pipeline Services (#154) * Saving/Update Pipeline Services * Docstrings for new functions * Pipeline creation unit test --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@Thiagos-MacBook-Pro-2.local> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Do not run service mode tests for specific pipelines (#159) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-126.ec2.internal> * Fix on Metadata (#162) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-126.ec2.internal> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> Co-authored-by: mikelam-us-aixplain <131073216+mikelam-us-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> Co-authored-by: Shreyas Sharma <85180538+shreyasXplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@Thiagos-MacBook-Pro-2.local> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-126.ec2.internal> * Interval label new structures (#157) * Interval label new structures * Fixes on data type * Docs for onboarding an image label detection corpus * Adding label detection dataset onboarding example in documentation * Fixing documentation link * Pixel to percentage --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-126.ec2.internal> * Development 2 Test - Release 0.2.11 (#165) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) * Hf deployment test (#115) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#117) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding HF token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Do not download textual URLs (#120) * Do not download textual URLs * Treat as string --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Enable api key parameter in data asset creation (#122) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-3.ec2.internal> * Update Finetuner hyperparameters (#125) * Update Finetuner hyperparameters * Change hyperparameters error message * Add new LLMs finetuner models (mistral and solar) (#128) * Enabling dataset ID and model ID as parameters for finetuner creation (#131) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fix supplier representation of a model (#132) * Fix supplier representation of a model * Fixing parameter typing --------- Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Fixing indentation in documentation sample code (#134) Co-authored-by: Thiago Castro Ferreira <thiagocastroferreira@ip-192-168-0-4.ec2.internal> * Update FineTune unit and functional tests (#136) * Click fix (#140) * Merge to prod (#119) * Merge dev to test (#107) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Development to Test (#109) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> * Merge to test (#111) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) --------- Co-authored-by: Lucas Pavanelli <86805709+lucas-aixplain@users.noreply.github.com> Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Merge dev to test (#113) * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Update Finetuner functional tests (#112) --------- Co-authored-by: Thiago Castro Ferreira <85182544+thiago-aixplain@users.noreply.github.com> * Hf deployment test (#114) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Simplifying status Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests and correcting tokens Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added bad repo ID test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Finished rough draft of tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding tests Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Fixing hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding hf token Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Correcting first test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Testing Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Adding config Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added user doc Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added gated model test Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> --------- Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Hf deployment test (#118) * Started adding Hugging Face deployment to aiXplain SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Added model status function to SDK Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updating Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Updated CLI Signed-off-by: mikelam-us <michael.lam@aixplain.com> * Create bounds for FineTune hyperparameters (#103) * Test bound to hyperparameters * Update finetune llm hyperparameters * Remove option to use PEFT, always on use now * Fixing pipeline general asset test (#106) * Adding CLI Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Corrected request error Signed-off-by: mikelam-us-aixplain <michael.lam@aixplain.com> * Clearing out unnecessary information in return Signed-off-by: mikelam-us-ai…

thiago-aixplain added 3 commits January 19, 2025 16:56

Adding Wallet on v2

c1d2415

Adding API Key

ebc330a

Data asset in v2

85518d0

thiago-aixplain requested a review from kadirpekel January 19, 2025 14:41

kadirpekel reviewed Jan 20, 2025

View reviewed changes

aixplain/v2/api_key.py Outdated Show resolved Hide resolved

kadirpekel reviewed Jan 20, 2025

View reviewed changes

kadirpekel reviewed Jan 21, 2025

View reviewed changes

xainaz and others added 4 commits January 21, 2025 22:13

Fixed create in api key and dataset

b8fc7b9

Merge branch 'ENG-1332' into ENG-1440-refactor

ec5f43e

Merge branch 'ENG-1332' into ENG-1440-refactor

c312a4e

Fixes in corpus, dataset and api key new factories

0ade433

thiago-aixplain merged commit 910aba4 into ENG-1332 Jan 22, 2025

thiago-aixplain deleted the ENG-1440-refactor branch January 22, 2025 12:20

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

ENG-1440: refactoring factories to aiXplain SDK v2 #371

ENG-1440: refactoring factories to aiXplain SDK v2 #371

Uh oh!

thiago-aixplain commented Jan 19, 2025

Uh oh!

Uh oh!

kadirpekel Jan 20, 2025

Uh oh!

kadirpekel Jan 20, 2025

Uh oh!

kadirpekel Jan 20, 2025

Uh oh!

kadirpekel Jan 20, 2025

Uh oh!

kadirpekel Jan 21, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

ENG-1440: refactoring factories to aiXplain SDK v2 #371

ENG-1440: refactoring factories to aiXplain SDK v2 #371

Uh oh!

Conversation

thiago-aixplain commented Jan 19, 2025

Uh oh!

Uh oh!

kadirpekel Jan 20, 2025

Choose a reason for hiding this comment

Uh oh!

kadirpekel Jan 20, 2025

Choose a reason for hiding this comment

Uh oh!

kadirpekel Jan 20, 2025

Choose a reason for hiding this comment

Uh oh!

kadirpekel Jan 20, 2025

Choose a reason for hiding this comment

Uh oh!

kadirpekel Jan 21, 2025

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants