Skip to content

Example file for docker compose and k8s#1006

Merged
merrymercy merged 5 commits intosgl-project:mainfrom
LucienShui:chore/docker_entrypoint
Aug 13, 2024
Merged

Example file for docker compose and k8s#1006
merrymercy merged 5 commits intosgl-project:mainfrom
LucienShui:chore/docker_entrypoint

Conversation

@LucienShui
Copy link
Copy Markdown
Contributor

@LucienShui LucienShui commented Aug 9, 2024

Motivation

More convenience to start with docker.

Modification

  1. Add compose.yml for serving as service.
  2. Add k8s example file.
  3. Update README.md for corresponding changes.

Comment thread docker/Dockerfile Outdated
Comment thread compose.yml Outdated
Comment thread README.md Outdated
@merrymercy
Copy link
Copy Markdown
Contributor

Could you revert your changes to the entry points?

@zhyncs
Copy link
Copy Markdown
Collaborator

zhyncs commented Aug 12, 2024

@LucienShui May you rebase the latest main branch? Thanks. ref #1033

@zhyncs
Copy link
Copy Markdown
Collaborator

zhyncs commented Aug 12, 2024

cc @LucienShui

ref cmd

# first sync fork's main

# next
git checkout main
git pull
git checkout  chore/docker_entrypoint
git rebase main
git push -f

@LucienShui LucienShui force-pushed the chore/docker_entrypoint branch from f7ec3d1 to bd4b7ec Compare August 12, 2024 16:42
@LucienShui LucienShui changed the title Add entrypoint to Dockerfile, add compose.yml [WIP] Example file for docker compose and k8s Aug 12, 2024
@zhyncs
Copy link
Copy Markdown
Collaborator

zhyncs commented Aug 13, 2024

Hi @LucienShui I noticed that you updated your PR. Have the compose and k8s conf been locally verified?

@LucienShui
Copy link
Copy Markdown
Contributor Author

Hi @LucienShui I noticed that you updated your PR. Have the compose and k8s conf been locally verified?

Yes, both compose and k8s have been verified locally, but I want to simplify these files as much as possible to make them more beginner-friendly so I added [WIP] in PR's title.

Feel free to merge it now but it would be better after I make more changes.

BTW, I need to work during the day so I only have time in the evening, my timezone is UTC+8.

@zhyncs
Copy link
Copy Markdown
Collaborator

zhyncs commented Aug 13, 2024

Got it. Thanks!

@LucienShui LucienShui changed the title [WIP] Example file for docker compose and k8s Example file for docker compose and k8s Aug 13, 2024
@LucienShui LucienShui force-pushed the chore/docker_entrypoint branch from 8c0e903 to 652f2a0 Compare August 13, 2024 16:28
@LucienShui
Copy link
Copy Markdown
Contributor Author

This PR is ready to merge, thanks for your time and patience!

@@ -0,0 +1,66 @@
apiVersion: node.k8s.io/v1
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

May we add health check, image pull policy and network policy?

Copy link
Copy Markdown
Contributor Author

@LucienShui LucienShui Aug 13, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry, I've just started learning k8s for 4 days, after searching, I still have no idea about what the network policy should do here.

Health check and pull policy was added.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's basically done, and I currently don't have the appropriate environment. It might need to wait for another reviewer to do a simple local verification. Thank you for your contribution!

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Comment thread docker/compose.yaml
@LucienShui LucienShui force-pushed the chore/docker_entrypoint branch from b71fbdf to 0b082f5 Compare August 13, 2024 18:09
Comment thread README.md Outdated
@merrymercy merrymercy enabled auto-merge (squash) August 13, 2024 22:07
@merrymercy merrymercy disabled auto-merge August 13, 2024 22:07
@merrymercy merrymercy merged commit 312e849 into sgl-project:main Aug 13, 2024
@merrymercy
Copy link
Copy Markdown
Contributor

@LucienShui Thanks for the contribution!

timethink pushed a commit to timethink/sglang that referenced this pull request Mar 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants