Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Briefly list any new interfaces that will be introduced as part of this proposal or any existing interfaces that will be removed or changed.

We will use Arrow format to replace all in-memory data format used for Insert/Search/Query.

  • Proto changed for Insert
Code Block
// internal/proto/milvus.proto
message InsertRequest {
  ...
- repeated  common.MsgBase baseschema.FieldData fields_data = 5;
+ bytes batch_record = 5;
  ...
}
  • Proto changed for Search
Code Block
// internal/proto/milvus.proto
-message PlaceholderValue {
-  string tag = 1;
-  stringPlaceholderType db_nametype = 2;
-  // values is a 2d-array, every array contains a vector
-  string collection_namerepeated bytes values = 3;
-}

-message PlaceholderGroup {
-  repeated PlaceholderValue placeholders = 1;
-}

message SearchRequest {
  ...
- bytes placeholder_group = 6;  string partition_name// must
+ bytes vector_record = 46; // must
  ...
}

message Hits {
  ...
- repeated bytes row_data = 2;
+ bytes batch_record = 2;
  ...
}

// internal/proto/schema.proto
message SearchResultData {
  ...
- repeated FieldData fields_data = 53;
+ bytes batch_record = 3;
  ...
}
  • Proto changed for Query
Code Block
message QueryResults {5;
  ...
- repeated uint32schema.FieldData hashfields_keysdata = 62;
+ bytes uint32 numbatch_rowsrecord = 72;
}


Design Details(required)

...