versatile-data-kit
versatile-data-kit copied to clipboard
One framework to develop, deploy and operate data workflows with Python and SQL.
Add performance measurement logs that show how much time it takes to fetch the query plan. This can be used to estimate potential impact on Impala for calculating lineage. Also...
This change instantiates a new job builder image, which will feature a set of security improvements. The first improvement is the removal of execute privileges from files composing a Data...
Currently, we expose "gauge" metrics for data job termination statuses, which we can then use to moonitor the operability of data jobs deployed in kubernetes clusters. This works fine for...
It is a common error where you can set db_default_type=sqlite but because it's declared in the plugin as "SQLITE" we get error that no such db connection type exists which...
**What is the feature request? What problem does it solve?** As employees leave the organization/company or users change mails , eventually the notification list configured for the job would start...
**What is the feature request? What problem does it solve?** Our Python interfaces are described in the classes of vdk API https://github.com/vmware/versatile-data-kit/blob/main/projects/vdk-core/src/vdk/api/ But that's not very easy to navigate and...
We are adding support for Kerberos authentication in the Control REST API . This is extending the support for the client to be able to make authentication requests with kerberos....
This PR is made for review only and will not be merged. Signed-off-by: Gabriel Georgiev
**Describe the bug** After https://github.com/trinodb/trino/issues/9129 trino would fail `drop view if not exists` query if a table with that name exists instead of silently proceeding. Which is a problem for...
The code duplication with [this](https://github.com/vmware/versatile-data-kit/blob/main/projects/vdk-core/src/vdk/internal/builtin_plugins/run/data_job.py#L255) is something we should fix _Originally posted by @tozka in https://github.com/vmware/versatile-data-kit/pull/793#pullrequestreview-961666538_