Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support Milvus v2.4 #306

Merged
merged 41 commits into from
Apr 18, 2024
Merged

Support Milvus v2.4 #306

merged 41 commits into from
Apr 18, 2024

Conversation

shanghaikid
Copy link
Contributor

No description provided.

shanghaikid and others added 30 commits January 10, 2024 10:31
@shanghaikid
init 2.4
7c9f443 
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
sync 2.4 proto
020d5fa 
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
Merge branch 'main' into 2.4
327beca
@shanghaikid
update CI
f2c866c 
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
add 2.4 index (#272)
26acea8 
* add INVERTED index

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* add GPU_BRUTE_FORCE and GPU_CAGRA

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* fix index test

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

---------

Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
support search group by (#273)
34670d1 
* support group by

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* remove  console

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

---------

Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
Merge branch 'main' into 2.4
ced8768 
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
Merge branch 'main' into 2.4
bb753b6
@shanghaikid
update 2.4 version
a3cd0ad 
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
Merge branch 'main' into 2.4
20c488d
@shanghaikid
Merge branch 'main' into 2.4
fec7cba 
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
support mmap (#275)
7223a1e 
* support mmap

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* comment out test for now

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

---------

Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
update proto
ad82ec3 
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
Merge branch 'main' into 2.4
0e1c8ca
@shanghaikid
Merge branch 'main' into 2.4
b5a11ab
@shanghaikid
Merge branch 'main' into 2.4
b41a323
@shanghaikid
support search with multiple vectors (#278)
aa826d0 
* update genCollectionParams to support multiple vectors field

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* add test for generateInsertData about multiple vectors

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* add compatible test for mutliple vectors

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* update proto

Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com>

* optimize search()

Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com>

* part

Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com>

* move buildSearchParams and formatSearchResult to utils

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* refactor

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* fix test

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* refactor part2

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* improve code
Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* refactor part3

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* update part5

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* prefinish multivsearch

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* add comments

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* update test

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* fix comments

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* fix test

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* fix build

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

---------

Signed-off-by: ryjiang <jiangruiyi@gmail.com>
Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com>
@shanghaikid
sync 2.4 proto
fa71d07 
Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com>
@shanghaikid
Add sparse vector support (#285)
ced4d74 
* add test data and const

Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com>

* add sparse data generator

Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com>

* fix create collection

Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com>

* stash

Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com>

* remove duplicate data sent to the sever

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* refactor data part1

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* finish insert

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* add query

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* finish sparse vector

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* fix alter collection should run before load

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* fix http

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* update test milvus verison

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* fix test

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* add http test

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

---------

Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com>
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
fix alterIndex
e3d11d5 
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
Support f16 & bf16 (#287)
b717176 
* add f16 insert

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* fp16 part2

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* stash

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* f16 part3

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* finish query

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* finish f16

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* fix type errors

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* update parseFloat16VectorToBytes function

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* add bf16 support

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* update types

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* fix test

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* add test

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

---------

Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
Merge branch 'main' into 2.4
5034a82
@shanghaikid
Support more types of sparse vectors (#293)
611a550 
* generate different types of sparse vector

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* fix sparse array in js

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* add sparse array test

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* add csr sparse vector test

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* add coo support

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* remove unused import

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* refine comments

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* refine comment

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

---------

Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
Sparse test update (#296)
3e34a4d 
* update sparse test case

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* log level

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

---------

Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
rename sparsevector test
82e1358 
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
Merge branch '2.4' of github.com:milvus-io/milvus-sdk-node into 2.4
60523c5
@shanghaikid
Add nq > 1 tests for sparse vectors and upgrade protos (#297)
1183230 
* add more test

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* add nq > 1 tests for sparse vectors

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* update test version

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

---------

Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
add nq>1 tests for hybridSearch (#298)
c77c5cf 
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
Fix single search failed on mutliple vectors collection if the anns f…
88fad2f 
…ield is specified. (#300)

* add more tests

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* Fix multiple test

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

---------

Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
update README.md
ef19189 
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
shanghaikid and others added 11 commits April 15, 2024 11:26
@shanghaikid
add more tests for client contstructor (#301)
6349b76 
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
Add bfloat16 support (#302)
e9fcf68 
* add test for bf16

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

* add bf16 support

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

---------

Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
add transformers (#303)
1941c77 
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
rename types
645331a 
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
update readme (#304)
c93660a 
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
Fix search transformers
2a14e0e 
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
Revert "Fix search transformers"
c453140 
This reverts commit 2a14e0e.
@shanghaikid
make transformer optional (#305)
6ed6eaa 
* make transform optional

Signed-off-by: shanghaikid <jiangruiyi@gmail.com>

* update readme

Signed-off-by: shanghaikid <jiangruiyi@gmail.com>

* fix http test

Signed-off-by: shanghaikid <jiangruiyi@gmail.com>

* fix format test

Signed-off-by: shanghaikid <jiangruiyi@gmail.com>

* fix sparse array test

Signed-off-by: ryjiang <jiangruiyi@gmail.com>

---------

Signed-off-by: shanghaikid <jiangruiyi@gmail.com>
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@zhanshuyou
feat: milvus api v2 (#295)
272681a 
Signed-off-by: Shuyou <shuyou.zhan@zilliz.com>
@shanghaikid
bump version
d6f7088 
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@shanghaikid
fix build
42cd88a 
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
@sre-ci-robot
Copy link

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: shanghaikid

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@shanghaikid shanghaikid changed the title release v2.4.0 Support Milvus v2.4 Apr 18, 2024
@shanghaikid shanghaikid merged commit 1a53e35 into main Apr 18, 2024
5 of 6 checks passed
@shanghaikid shanghaikid deleted the 2.4 branch April 18, 2024 03:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
size/XXL
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@shanghaikid @sre-ci-robot @zhanshuyou