Pinned
We’re excited to announce that Lilac is joining @databricks!
For more details, check out the Databricks blog:
Lilac, joining Databricks!
40 posts
Lilac, joining Databricks!
@lilac_ai
Joined April 2023
- Today we are announcing Lilac Garden, our new cloud service for accelerating AI dataset transforms. The first service is LLM-powered clustering, enabling a birds eye view of data, 100x faster than running locally. Read more and sign up for the waitlist: docs.lilacml.com/blog/introduci…
- We just released 0.2.3 which allows you to share Lilac-processed datasets via @huggingface from the CLI. Expensive embeddings, signals, and map results can now be shared with others. We'll be releasing some Lilac-processed datasets soon. Docs: docs.lilacml.com/datasets/datas…
- Replying to @lilac_aiThis clustering pipeline is all open-sourced, so you can run it locally, but may be prohibitively slow. Lilac Garden clustering is powered by @modal_labs, allowing us to scale up to 4M documents in < 1 hour. Sign up for the waitlist: docs.google.com/forms/d/e/1FAI…
- Brian Lee just joined Lilac as our first hire, welcome :) Brian worked at Google Brain on projects like: TensorFlow AutoGraph, a smell digitization project, and MiniGo. He is also a terrific writer and ML engineer. Excited to have you on board! moderndescartes.com
- We have a brand new website! Stay tuned for some new features. lilacml.com
- We just launched two new UI features: ✅ Compare two text fields and show a visual side-by-side diff ✅ Individual item-view mode, with arrow-key shortcuts Demo: lilacai-lilac.hf.space/datasets#lilac… Docs: lilacml.com/datasets/datas… lilacml.com/datasets/datas…
- We're excited to announce a new way to ✨edit data✨ for AI models. We use the @astral_sh ruff formatter to edit code in the @GlaiveAI dataset to align a coding assistant to our style. Blog: docs.lilacml.com/blog/curate-co… Video: youtu.be/bw8JUpAOSZQ
- We just made it much easier to load and host any HuggingFace dataset in Lilac, with no code! Just provide the Lilac Deployer UI: ✅ HuggingFace dataset name ✅ Your HF access token We will spin up a HuggingFace space with Lilac on that dataset. huggingface.co/spaces/lilacai…
00:00 - We just released [email protected]! This release brings in Monaco (the VSCode engine) to render documents, with powerful context menus for searching, labeling concepts, and more. We also added UI support for common ChatML formats like ShareGPT Release notes: github.com/lilacai/lilac/…
- Replying to @lilac_aiWe've clustered popular fine-tuning datasets like @alignment_lab OpenOrca, @huggingface UltraChat, Glaive, LLM eval datasets, user logs @lmsysorg Chatbot Arena, content scraping (HN comments). Browse clusters in our demo: lilacai-lilac.hf.space/datasets#lilac… Download clusters with our CLI:
- [email protected] is now released. We now support: - Loading custom embeddings - Exporting directly to HuggingFace Release notes: github.com/lilacai/lilac/…
- Explore the GAIR-lima fine tuning dataset from the Mosaic blog post below using our Lilac @huggingface space! lilacai-lilac.hf.space/datasets#lilac…What should you do if you want to effectively and cheaply “instruction finetune” an LLM? @aditi_jh and @JacobianNeuro share some important insights. (1/5)
- Replying to @lilac_aiAnd an article with Business Insider:
