Skip to content

feat: improve caching#45

Merged
jackye1995 merged 7 commits into
lance-format:mainfrom
jackye1995:cache
Feb 22, 2026
Merged

feat: improve caching#45
jackye1995 merged 7 commits into
lance-format:mainfrom
jackye1995:cache

Conversation

@jackye1995

@jackye1995 jackye1995 commented Feb 21, 2026

Copy link
Copy Markdown
Collaborator

In general, ensure that:

  1. we use the same session across datasets and cache session
  2. we fix dataset version to read so each version is cached

jackye1995 and others added 7 commits February 20, 2026 23:50
Rename index-aware split planning config properties to use consistent
naming pattern with other config groups:
- lance.btree_indexed_rows_per_split → lance.index.btree.rows_per_split
- lance.bitmap_indexed_rows_per_split → lance.index.bitmap.rows_per_split

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Add comprehensive performance documentation covering:
- Caching configuration (session and dataset caches)
- Session-level cache sizes (index and metadata)
- Lance environment variables (I/O threads, upload settings)
- Index-aware split planning configuration
- Read and write batch size settings

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Reorganize cache configuration with consistent property naming:
- lance.cache.session.max_entries (was lance.cache.max_sessions)
- lance.cache.session.ttl_minutes (was lance.cache.session_ttl_minutes)
- lance.cache.session.index_cache_size_bytes (was lance.session.index_cache_size_bytes)
- lance.cache.session.metadata_cache_size_bytes (was lance.session.metadata_cache_size_bytes)
- lance.cache.dataset.max_entries (was lance.cache.max_datasets)
- lance.cache.dataset.ttl_minutes (was lance.cache.dataset_ttl_minutes)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@jackye1995 jackye1995 merged commit 546143e into lance-format:main Feb 22, 2026
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant