implement iceberg rest catalog register table endpoint #73
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
14 tasks
e80b0af to
64f4abe
Compare
dennyglee
pushed a commit
that referenced
this pull request
Sep 2, 2024
* start of login page * env and google auth button * merge with main, remove params reference * start of okta auth * initial commit for handling auth token (#67) * start of login with keycloak * handle google sign in with token * more google auth * profile dropdown * merge with main * merge with main * convert to axios * start of readme instructions * get current user endpoint (#70) clean up some other endpoints * commenting out UI until repositories are merged * clean up current user (#74) * yarn lock file * remove keycloak for now, node version error in jwt-decode dependency * commit yarn lock * remove state as useEffect dependency, comment out currentUser call for now --------- Co-authored-by: Xiang Xu <xiang.xu@databricks.com>
tdas
pushed a commit
that referenced
this pull request
Sep 5, 2024
* start of login page * env and google auth button * merge with main, remove params reference * start of okta auth * initial commit for handling auth token (#67) * start of login with keycloak * handle google sign in with token * more google auth * profile dropdown * merge with main * merge with main * convert to axios * start of readme instructions * get current user endpoint (#70) clean up some other endpoints * commenting out UI until repositories are merged * clean up current user (#74) * yarn lock file * remove keycloak for now, node version error in jwt-decode dependency * commit yarn lock * remove state as useEffect dependency, comment out currentUser call for now --------- Co-authored-by: Xiang Xu <xiang.xu@databricks.com>
rtyler
pushed a commit
to rtyler/unitycatalog
that referenced
this pull request
Sep 5, 2024
* start of login page * env and google auth button * merge with main, remove params reference * start of okta auth * initial commit for handling auth token (unitycatalog#67) * start of login with keycloak * handle google sign in with token * more google auth * profile dropdown * merge with main * merge with main * convert to axios * start of readme instructions * get current user endpoint (unitycatalog#70) clean up some other endpoints * commenting out UI until repositories are merged * clean up current user (unitycatalog#74) * yarn lock file * remove keycloak for now, node version error in jwt-decode dependency * commit yarn lock * remove state as useEffect dependency, comment out currentUser call for now --------- Co-authored-by: Xiang Xu <xiang.xu@databricks.com>
4 tasks
|
@dennyglee this is a pretty amazing feature, is there any plan to have the "register_table" endpoint available? |
Contributor
Hey @nicor88 - I don't believe we have a plan around this yet but it would be great if you're interested helping/documenting a proposed design for this if you're up for it? I think that's a great idea, eh?! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR Checklist
docsis updatedDescription of changes
This makes a native iceberg table more "top-level" like a delta table and adds the ability to register/store an existing native iceberg table in UC (instead of UC considering an iceberg table just a delta table with uniform enabled, i.e. having a uniform iceberg metadata location set).
Here's an example of it working locally with OSS Spark using the iceberg-spark 'register_table' procedure (Note: you need to manually create the new schema/namespace using cli first):
Spark conf for above example:
Related Issue
Addresses part of adding additional Iceberg REST Endpoints #3
Testing
Test cases for the above mentioned scenarios have been added and are running fine.