Skip to content

Physical S3 backend implementation#242

Merged
armon merged 3 commits intohashicorp:masterfrom
jstremick:f-physical-s3-backend
May 21, 2015
Merged

Physical S3 backend implementation#242
armon merged 3 commits intohashicorp:masterfrom
jstremick:f-physical-s3-backend

Conversation

@jstremick
Copy link
Copy Markdown

Adds a new 's3' physical backend to store vault data in an S3 bucket.

Notes:

  • The bucket must exist before vault can use it and we'll verify that it can be read.
  • Credentials will sought from a chain of sources: backend config -> environment -> credential file -> EC2 IAM role
  • Recursive delete test added. Looking at the other backends, it looks like if a key is deleted that any child keys should also be deleted.

No HA support as the eventually consistent nature of S3 means acquiring locks via bucket isn't feasible. Maybe SimpleDB or another synchronous service could provide that ability?

I updated godeps.json should I also commit the libraries it updated? and aws-sdk-go.

@jstremick
Copy link
Copy Markdown
Author

Implements #120

@jstremick
Copy link
Copy Markdown
Author

Looks like I've broken tests for a few other physical backends when testing recursive deletes. Let me know what the expected behavior should be and I'll update.

The S3Backend tests fail without credentials. Should I do anything about that?

Comment thread physical/physical_test.go Outdated
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should not be the case actually. This is invalid. If "foo" is deleted, only that key should be. The directories under should not be affected.

@armon
Copy link
Copy Markdown
Contributor

armon commented May 20, 2015

@jstremick I've left some feedback, but this is looking really good!

armon added a commit that referenced this pull request May 21, 2015
@armon armon merged commit ab77e05 into hashicorp:master May 21, 2015
@armon armon mentioned this pull request May 21, 2015
@armon
Copy link
Copy Markdown
Contributor

armon commented May 21, 2015

@jstremick Awesome, thanks!

@jstremick
Copy link
Copy Markdown
Author

@armon Welcome!

@jstremick jstremick deleted the f-physical-s3-backend branch May 21, 2015 00:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants