Snider
|
d188b05ad8
|
feat: modernise to Go 1.26 iterators and stdlib helpers
Security Scan / security (push) Successful in 10s
Test / test (push) Failing after 39s
Add ChunkMarkdownSeq, QuerySeq, KeywordFilterSeq, ListCollectionsSeq
iterators for streaming. Use slices.SortFunc, slices.Contains,
slices.Collect in mock/query/keyword. Range-over-int in benchmarks.
Co-Authored-By: Gemini <noreply@google.com>
Co-Authored-By: Virgil <virgil@lethean.io>
|
2026-02-23 05:36:39 +00:00 |
|
Snider
|
d8fd067a8c
|
feat: Phase 3 enhancements — sentence splitting, collection helpers, keyword filter, benchmarks
3.1: Sentence-aware chunk splitting at ". ", "? ", "! " boundaries when
paragraphs exceed ChunkConfig.Size. Overlap now aligns to word boundaries
to avoid mid-word splits.
3.2: VectorStore interface gains ListCollections and CollectionInfo methods.
New collections.go with ListCollections, DeleteCollection, CollectionStats
helpers returning backend-agnostic CollectionInfo. Mock updated accordingly.
3.3: KeywordFilter re-ranks QueryResults by boosting scores for keyword
matches (case-insensitive, +10% per keyword). QueryConfig.Keywords flag
enables automatic extraction and filtering.
3.4: Mock-only benchmarks for chunking, query, ingest, formatting, and
keyword filtering.
Co-Authored-By: Virgil <virgil@lethean.io>
|
2026-02-20 08:02:00 +00:00 |
|