diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml index 4ea3717c65..a8bd1a9a59 100644 --- a/.github/workflows/ci.yml +++ b/.github/workflows/ci.yml @@ -327,5 +327,9 @@ jobs: uses: actions/setup-python@v5 with: python-version: 3.8 + - name: Use Node.js 20.x + uses: actions/setup-node@v4 + with: + node-version: 20.x - name: Check code style run: ./ci/run_ci.sh format diff --git a/README.md b/README.md index 0bbd94e3c9..2b2a1694c7 100644 --- a/README.md +++ b/README.md @@ -34,7 +34,7 @@ In addition to cross-language serialization, Fory also features at: - Drop-in replace Java serialization frameworks such as JDK/Kryo/Hessian, but 100x faster at most, which can greatly improve - the efficiency of high-performance RPC calls, data transfer, and object persistence. + the efficiency of high-performance RPC calls, data transfer, and object persistence. - **100% compatible** with JDK serialization API with much faster implementation: supporting JDK `writeObject`/`readObject`/`writeReplace`/`readResolve`/`readObjectNoData`/`Externalizable` API. - Supports **Java 8~21**, Java 17+ `record` is supported too. - Supports [AOT compilation serialization](docs/guide/graalvm_guide.md) for **GraalVM native image**, and no reflection/serialization json config are needed. @@ -417,7 +417,7 @@ Static serialization is relatively secure. But dynamic serialization such as For For example, the deserialization may invoke `init` constructor or `equals`/`hashCode` method, if the method body contains malicious code, the system will be at risk. Fory provides a class registration option that is enabled by default for such protocols, allowing only deserialization of trusted registered types or built-in types. - **Do not disable class registration unless you can ensure your environment is secure**. +**Do not disable class registration unless you can ensure your environment is secure**. If this option is disabled, you are responsible for serialization security. You can configure `org.apache.fory.resolver.ClassChecker` by `ClassResolver#setClassChecker` to control which classes are allowed for serialization. diff --git a/ci/format.sh b/ci/format.sh index 1be740c848..b66652bdd0 100755 --- a/ci/format.sh +++ b/ci/format.sh @@ -281,6 +281,10 @@ format_changed() { git diff --name-only --diff-filter=ACRM "$MERGEBASE" -- '*.ts' | xargs -P 5 \ node ./javascript/node_modules/.bin/eslint fi + # Install prettier globally + npm install -g prettier + # Fix markdown files + prettier --write "**/*.md" popd fi } diff --git a/dart/README.md b/dart/README.md index 8d6941345f..2e68b749e4 100644 --- a/dart/README.md +++ b/dart/README.md @@ -93,35 +93,35 @@ fory.register($EnumFoo, "example.EnumFoo"); Fory Dart currently supports the following type mappings in XLANG mode: -| Fory Type | Dart Type | -|----------------------------|------------------------------------------------| -| bool | bool | -| int8 | fory.Int8 | -| int16 | fory.Int16 | -| int32 | fory.Int32 | -| var_int32 | fory.Int32 | -| int64 | int | -| var_int64 | int | -| sli_int64 | int | -| float32 | fory.Float32 | -| float64 | double | -| string | String | -| enum | Enum | -| named_enum | Enum | -| named_struct | class | -| list | List | -| set | Set (LinkedHashSet, HashSet, SplayTreeSet) | -| map | Map (LinkedHashMap, HashMap, SplayTreeMap) | -| timestamp | fory.TimeStamp | -| local_date | fory.LocalDate | -| binary | Uint8List | -| bool_array | BoolList | -| int8_array | Int8List | -| int16_array | Int16List | -| int32_array | Int32List | -| int64_array | Int64List | -| float32_array | Float32List | -| float64_array | Float64List | +| Fory Type | Dart Type | +| ------------- | ------------------------------------------ | +| bool | bool | +| int8 | fory.Int8 | +| int16 | fory.Int16 | +| int32 | fory.Int32 | +| var_int32 | fory.Int32 | +| int64 | int | +| var_int64 | int | +| sli_int64 | int | +| float32 | fory.Float32 | +| float64 | double | +| string | String | +| enum | Enum | +| named_enum | Enum | +| named_struct | class | +| list | List | +| set | Set (LinkedHashSet, HashSet, SplayTreeSet) | +| map | Map (LinkedHashMap, HashMap, SplayTreeMap) | +| timestamp | fory.TimeStamp | +| local_date | fory.LocalDate | +| binary | Uint8List | +| bool_array | BoolList | +| int8_array | Int8List | +| int16_array | Int16List | +| int32_array | Int32List | +| int64_array | Int64List | +| float32_array | Float32List | +| float64_array | Float64List | ## Project Structure diff --git a/dart/packages/fory-test/README.md b/dart/packages/fory-test/README.md index 50be5150fa..3a6ef0b2c4 100644 --- a/dart/packages/fory-test/README.md +++ b/dart/packages/fory-test/README.md @@ -1,4 +1,3 @@ - ## Testing Approach The test suite is inspired by Fory Java's testing approach and includes: diff --git a/dart/packages/fory/README.md b/dart/packages/fory/README.md index 265a66152f..bcada49948 100644 --- a/dart/packages/fory/README.md +++ b/dart/packages/fory/README.md @@ -93,35 +93,35 @@ fory.register($EnumFoo, "example.EnumFoo"); Fory Dart currently supports the following type mappings in XLANG mode: -| Fory Type | Dart Type | -|----------------------------|------------------------------------------------| -| bool | bool | -| int8 | fory.Int8 | -| int16 | fory.Int16 | -| int32 | fory.Int32 | -| var_int32 | fory.Int32 | -| int64 | int | -| var_int64 | int | -| sli_int64 | int | -| float32 | fory.Float32 | -| float64 | double | -| string | String | -| enum | Enum | -| named_enum | Enum | -| named_struct | class | -| list | List | -| set | Set (LinkedHashSet, HashSet, SplayTreeSet) | -| map | Map (LinkedHashMap, HashMap, SplayTreeMap) | -| timestamp | fory.TimeStamp | -| local_date | fory.LocalDate | -| binary | Uint8List | -| bool_array | BoolList | -| int8_array | Int8List | -| int16_array | Int16List | -| int32_array | Int32List | -| int64_array | Int64List | -| float32_array | Float32List | -| float64_array | Float64List | +| Fory Type | Dart Type | +| ------------- | ------------------------------------------ | +| bool | bool | +| int8 | fory.Int8 | +| int16 | fory.Int16 | +| int32 | fory.Int32 | +| var_int32 | fory.Int32 | +| int64 | int | +| var_int64 | int | +| sli_int64 | int | +| float32 | fory.Float32 | +| float64 | double | +| string | String | +| enum | Enum | +| named_enum | Enum | +| named_struct | class | +| list | List | +| set | Set (LinkedHashSet, HashSet, SplayTreeSet) | +| map | Map (LinkedHashMap, HashMap, SplayTreeMap) | +| timestamp | fory.TimeStamp | +| local_date | fory.LocalDate | +| binary | Uint8List | +| bool_array | BoolList | +| int8_array | Int8List | +| int16_array | Int16List | +| int32_array | Int32List | +| int64_array | Int64List | +| float32_array | Float32List | +| float64_array | Float64List | ## Project Structure diff --git a/docs/benchmarks/README.md b/docs/benchmarks/README.md index adfc52bd54..5961c71441 100644 --- a/docs/benchmarks/README.md +++ b/docs/benchmarks/README.md @@ -104,6 +104,7 @@ No class forward/backward compatibility are supported in this mode. The deserialization peer can have different class definition with the serialization peer. Class forward/backward compatibility are supported in this mode. +

@@ -119,6 +120,7 @@ Serialize data off-heap memory. The deserialization peer must have same class definition with the serialization peer. No class forward/backward compatibility are supported in this mode. +

@@ -130,6 +132,7 @@ No class forward/backward compatibility are supported in this mode. The deserialization peer can have different class definition with the serialization peer. Class forward/backward compatibility are supported in this mode. +

@@ -141,6 +144,7 @@ Class forward/backward compatibility are supported in this mode. The deserialization peer must have same class definition with the serialization peer. No class forward/backward compatibility are supported in this mode. +

@@ -152,6 +156,7 @@ No class forward/backward compatibility are supported in this mode. The deserialization peer can have different class definition with the serialization peer. Class forward/backward compatibility are supported in this mode. +

@@ -187,386 +192,386 @@ But if you serialize data between processes on same node and use shared-memory, ### Java Serialization -| Lib | Benchmark | bufferType | objectType | references | Tps | -| ------- | ------- | ------- | ------- | ------- | ------- | -| Fst | serialize | array | SAMPLE | False | 915907.574306 | -| Fst | serialize | array | SAMPLE | True | 731869.156376 | -| Fst | serialize | array | MEDIA_CONTENT | False | 751892.023189 | -| Fst | serialize | array | MEDIA_CONTENT | True | 583859.907758 | -| Fst | serialize | array | STRUCT | False | 882178.995727 | -| Fst | serialize | array | STRUCT | True | 757753.756691 | -| Fst | serialize | array | STRUCT2 | False | 371762.982661 | -| Fst | serialize | array | STRUCT2 | True | 380638.700267 | -| Fst | serialize | directBuffer | SAMPLE | False | 902302.261168 | -| Fst | serialize | directBuffer | SAMPLE | True | 723614.06677 | -| Fst | serialize | directBuffer | MEDIA_CONTENT | False | 728001.08025 | -| Fst | serialize | directBuffer | MEDIA_CONTENT | True | 595679.580108 | -| Fst | serialize | directBuffer | STRUCT | False | 807847.663261 | -| Fst | serialize | directBuffer | STRUCT | True | 762088.935404 | -| Fst | serialize | directBuffer | STRUCT2 | False | 365317.705376 | -| Fst | serialize | directBuffer | STRUCT2 | True | 370851.880711 | -| Fory | serialize | array | SAMPLE | False | 3570966.469087 | -| Fory | serialize | array | SAMPLE | True | 1767693.83509 | -| Fory | serialize | array | MEDIA_CONTENT | False | 3031642.924542 | -| Fory | serialize | array | MEDIA_CONTENT | True | 2450384.600246 | -| Fory | serialize | array | STRUCT | False | 7501415.56726 | -| Fory | serialize | array | STRUCT | True | 6264439.154428 | -| Fory | serialize | array | STRUCT2 | False | 3586126.623874 | -| Fory | serialize | array | STRUCT2 | True | 3306474.506382 | -| Fory | serialize | directBuffer | SAMPLE | False | 3684487.760591 | -| Fory | serialize | directBuffer | SAMPLE | True | 1826456.709478 | -| Fory | serialize | directBuffer | MEDIA_CONTENT | False | 2479862.129632 | -| Fory | serialize | directBuffer | MEDIA_CONTENT | True | 1938527.588331 | -| Fory | serialize | directBuffer | STRUCT | False | 9834243.243204 | -| Fory | serialize | directBuffer | STRUCT | True | 7551780.823133 | -| Fory | serialize | directBuffer | STRUCT2 | False | 2643155.135327 | -| Fory | serialize | directBuffer | STRUCT2 | True | 2391110.083108 | -| Fory | serialize_compatible | array | SAMPLE | False | 3604596.465625 | -| Fory | serialize_compatible | array | SAMPLE | True | 1619648.337293 | -| Fory | serialize_compatible | array | MEDIA_CONTENT | False | 1679272.036243 | -| Fory | serialize_compatible | array | MEDIA_CONTENT | True | 1406736.538716 | -| Fory | serialize_compatible | array | STRUCT | False | 3530406.108869 | -| Fory | serialize_compatible | array | STRUCT | True | 3293059.098127 | -| Fory | serialize_compatible | array | STRUCT2 | False | 2773368.99768 | -| Fory | serialize_compatible | array | STRUCT2 | True | 2564174.550276 | -| Fory | serialize_compatible | directBuffer | SAMPLE | False | 3484533.218305 | -| Fory | serialize_compatible | directBuffer | SAMPLE | True | 1730824.630648 | -| Fory | serialize_compatible | directBuffer | MEDIA_CONTENT | False | 1710680.937387 | -| Fory | serialize_compatible | directBuffer | MEDIA_CONTENT | True | 1149999.473994 | -| Fory | serialize_compatible | directBuffer | STRUCT | False | 2653169.568374 | -| Fory | serialize_compatible | directBuffer | STRUCT | True | 2393817.762938 | -| Fory | serialize_compatible | directBuffer | STRUCT2 | False | 1912402.937879 | -| Fory | serialize_compatible | directBuffer | STRUCT2 | True | 1848338.968058 | -| Forymetashared | serialize_compatible | array | SAMPLE | False | 4409055.687063 | -| Forymetashared | serialize_compatible | array | SAMPLE | True | 1840705.439334 | -| Forymetashared | serialize_compatible | array | MEDIA_CONTENT | False | 2992488.235281 | -| Forymetashared | serialize_compatible | array | MEDIA_CONTENT | True | 2058738.716953 | -| Forymetashared | serialize_compatible | array | STRUCT | False | 9204444.777172 | -| Forymetashared | serialize_compatible | array | STRUCT | True | 7064625.291374 | -| Forymetashared | serialize_compatible | array | STRUCT2 | False | 2575824.143864 | -| Forymetashared | serialize_compatible | array | STRUCT2 | True | 3543082.528217 | -| Forymetashared | serialize_compatible | directBuffer | SAMPLE | False | 5043538.364886 | -| Forymetashared | serialize_compatible | directBuffer | SAMPLE | True | 1859289.705838 | -| Forymetashared | serialize_compatible | directBuffer | MEDIA_CONTENT | False | 2491443.556971 | -| Forymetashared | serialize_compatible | directBuffer | MEDIA_CONTENT | True | 1804349.244125 | -| Forymetashared | serialize_compatible | directBuffer | STRUCT | False | 11650249.648715 | -| Forymetashared | serialize_compatible | directBuffer | STRUCT | True | 8702412.752357 | -| Forymetashared | serialize_compatible | directBuffer | STRUCT2 | False | 2714748.572448 | -| Forymetashared | serialize_compatible | directBuffer | STRUCT2 | True | 1866073.031851 | -| Hession | serialize | array | SAMPLE | False | 240386.502846 | -| Hession | serialize | array | SAMPLE | True | 192414.014211 | -| Hession | serialize | array | MEDIA_CONTENT | False | 367782.358049 | -| Hession | serialize | array | MEDIA_CONTENT | True | 329427.47068 | -| Hession | serialize | array | STRUCT | False | 258233.998931 | -| Hession | serialize | array | STRUCT | True | 260845.209485 | -| Hession | serialize | array | STRUCT2 | False | 56056.080075 | -| Hession | serialize | array | STRUCT2 | True | 60038.87979 | -| Hession | serialize | directBuffer | SAMPLE | False | 240981.308085 | -| Hession | serialize | directBuffer | SAMPLE | True | 211949.960255 | -| Hession | serialize | directBuffer | MEDIA_CONTENT | False | 372477.13815 | -| Hession | serialize | directBuffer | MEDIA_CONTENT | True | 353376.085025 | -| Hession | serialize | directBuffer | STRUCT | False | 266481.009245 | -| Hession | serialize | directBuffer | STRUCT | True | 261762.594966 | -| Hession | serialize | directBuffer | STRUCT2 | False | 55924.319442 | -| Hession | serialize | directBuffer | STRUCT2 | True | 56674.065604 | -| Hession | serialize_compatible | array | SAMPLE | False | 234454.975158 | -| Hession | serialize_compatible | array | SAMPLE | True | 206174.173039 | -| Hession | serialize_compatible | array | MEDIA_CONTENT | False | 377195.903772 | -| Hession | serialize_compatible | array | MEDIA_CONTENT | True | 351657.879556 | -| Hession | serialize_compatible | array | STRUCT | False | 258650.663523 | -| Hession | serialize_compatible | array | STRUCT | True | 263564.913879 | -| Hession | serialize_compatible | array | STRUCT2 | False | 58509.125342 | -| Hession | serialize_compatible | array | STRUCT2 | True | 55552.977735 | -| Hession | serialize_compatible | directBuffer | SAMPLE | False | 194761.244263 | -| Hession | serialize_compatible | directBuffer | SAMPLE | True | 212840.483308 | -| Hession | serialize_compatible | directBuffer | MEDIA_CONTENT | False | 371729.727192 | -| Hession | serialize_compatible | directBuffer | MEDIA_CONTENT | True | 343834.954942 | -| Hession | serialize_compatible | directBuffer | STRUCT | False | 249241.452137 | -| Hession | serialize_compatible | directBuffer | STRUCT | True | 263623.143601 | -| Hession | serialize_compatible | directBuffer | STRUCT2 | False | 58908.567439 | -| Hession | serialize_compatible | directBuffer | STRUCT2 | True | 55524.373547 | -| Jdk | serialize | array | SAMPLE | False | 118374.836631 | -| Jdk | serialize | array | SAMPLE | True | 119858.140625 | -| Jdk | serialize | array | MEDIA_CONTENT | False | 137989.198821 | -| Jdk | serialize | array | MEDIA_CONTENT | True | 140260.668888 | -| Jdk | serialize | array | STRUCT | False | 155908.24424 | -| Jdk | serialize | array | STRUCT | True | 151258.539369 | -| Jdk | serialize | array | STRUCT2 | False | 36846.049162 | -| Jdk | serialize | array | STRUCT2 | True | 38183.705811 | -| Jdk | serialize | directBuffer | SAMPLE | False | 118273.584257 | -| Jdk | serialize | directBuffer | SAMPLE | True | 108263.040839 | -| Jdk | serialize | directBuffer | MEDIA_CONTENT | False | 138567.623369 | -| Jdk | serialize | directBuffer | MEDIA_CONTENT | True | 140158.67391 | -| Jdk | serialize | directBuffer | STRUCT | False | 154875.908438 | -| Jdk | serialize | directBuffer | STRUCT | True | 156404.686214 | -| Jdk | serialize | directBuffer | STRUCT2 | False | 37444.967981 | -| Jdk | serialize | directBuffer | STRUCT2 | True | 35798.679246 | -| Kryo | serialize | array | SAMPLE | False | 1105365.931217 | -| Kryo | serialize | array | SAMPLE | True | 734215.482491 | -| Kryo | serialize | array | MEDIA_CONTENT | False | 730792.521676 | -| Kryo | serialize | array | MEDIA_CONTENT | True | 445251.084327 | -| Kryo | serialize | array | STRUCT | False | 558194.100861 | -| Kryo | serialize | array | STRUCT | True | 557542.628765 | -| Kryo | serialize | array | STRUCT2 | False | 325172.969175 | -| Kryo | serialize | array | STRUCT2 | True | 259863.332448 | -| Kryo | serialize | directBuffer | SAMPLE | False | 1376560.302168 | -| Kryo | serialize | directBuffer | SAMPLE | True | 932887.968348 | -| Kryo | serialize | directBuffer | MEDIA_CONTENT | False | 608972.51758 | -| Kryo | serialize | directBuffer | MEDIA_CONTENT | True | 359875.473951 | -| Kryo | serialize | directBuffer | STRUCT | False | 1078046.011115 | -| Kryo | serialize | directBuffer | STRUCT | True | 853350.408656 | -| Kryo | serialize | directBuffer | STRUCT2 | False | 355688.882786 | -| Kryo | serialize | directBuffer | STRUCT2 | True | 338960.426033 | -| Kryo | serialize_compatible | array | SAMPLE | False | 378907.663184 | -| Kryo | serialize_compatible | array | SAMPLE | True | 320815.567701 | -| Kryo | serialize_compatible | array | MEDIA_CONTENT | False | 188911.259146 | -| Kryo | serialize_compatible | array | MEDIA_CONTENT | True | 145782.916427 | -| Kryo | serialize_compatible | array | STRUCT | False | 145964.199559 | -| Kryo | serialize_compatible | array | STRUCT | True | 136180.832879 | -| Kryo | serialize_compatible | array | STRUCT2 | False | 125807.748004 | -| Kryo | serialize_compatible | array | STRUCT2 | True | 114983.546343 | -| Kryo | serialize_compatible | directBuffer | SAMPLE | False | 296102.615094 | -| Kryo | serialize_compatible | directBuffer | SAMPLE | True | 276757.392449 | -| Kryo | serialize_compatible | directBuffer | MEDIA_CONTENT | False | 185363.714829 | -| Kryo | serialize_compatible | directBuffer | MEDIA_CONTENT | True | 142836.961878 | -| Kryo | serialize_compatible | directBuffer | STRUCT | False | 106695.800245 | -| Kryo | serialize_compatible | directBuffer | STRUCT | True | 106458.212005 | -| Kryo | serialize_compatible | directBuffer | STRUCT2 | False | 92130.672361 | -| Kryo | serialize_compatible | directBuffer | STRUCT2 | True | 88989.724768 | -| Protostuff | serialize | array | SAMPLE | False | 663272.710783 | -| Protostuff | serialize | array | MEDIA_CONTENT | False | 780618.761219 | -| Protostuff | serialize | array | STRUCT | False | 330975.350403 | -| Protostuff | serialize | array | STRUCT2 | False | 324563.440433 | -| Protostuff | serialize | directBuffer | SAMPLE | False | 693641.589806 | -| Protostuff | serialize | directBuffer | MEDIA_CONTENT | False | 805941.345157 | -| Protostuff | serialize | directBuffer | STRUCT | False | 340262.650047 | -| Protostuff | serialize | directBuffer | STRUCT2 | False | 325093.716261 | -| Fst | deserialize | array | SAMPLE | False | 473409.796491 | -| Fst | deserialize | array | SAMPLE | True | 428315.502365 | -| Fst | deserialize | array | MEDIA_CONTENT | False | 363455.785182 | -| Fst | deserialize | array | MEDIA_CONTENT | True | 304371.728638 | -| Fst | deserialize | array | STRUCT | False | 357887.235311 | -| Fst | deserialize | array | STRUCT | True | 353480.554035 | -| Fst | deserialize | array | STRUCT2 | False | 280131.091068 | -| Fst | deserialize | array | STRUCT2 | True | 260649.308016 | -| Fst | deserialize | directBuffer | SAMPLE | False | 441027.550809 | -| Fst | deserialize | directBuffer | SAMPLE | True | 420523.770904 | -| Fst | deserialize | directBuffer | MEDIA_CONTENT | False | 311691.658687 | -| Fst | deserialize | directBuffer | MEDIA_CONTENT | True | 251820.171513 | -| Fst | deserialize | directBuffer | STRUCT | False | 352441.597147 | -| Fst | deserialize | directBuffer | STRUCT | True | 334574.303484 | -| Fst | deserialize | directBuffer | STRUCT2 | False | 262519.85881 | -| Fst | deserialize | directBuffer | STRUCT2 | True | 234973.637096 | -| Fory | deserialize | array | SAMPLE | False | 2069988.624415 | -| Fory | deserialize | array | SAMPLE | True | 1797942.442313 | -| Fory | deserialize | array | MEDIA_CONTENT | False | 2054066.903469 | -| Fory | deserialize | array | MEDIA_CONTENT | True | 1507767.206603 | -| Fory | deserialize | array | STRUCT | False | 4595230.434552 | -| Fory | deserialize | array | STRUCT | True | 4634753.596131 | -| Fory | deserialize | array | STRUCT2 | False | 1126298.35955 | -| Fory | deserialize | array | STRUCT2 | True | 1046649.083082 | -| Fory | deserialize | directBuffer | SAMPLE | False | 2429791.078395 | -| Fory | deserialize | directBuffer | SAMPLE | True | 1958815.397807 | -| Fory | deserialize | directBuffer | MEDIA_CONTENT | False | 1502746.028159 | -| Fory | deserialize | directBuffer | MEDIA_CONTENT | True | 1290593.975753 | -| Fory | deserialize | directBuffer | STRUCT | False | 5012002.859236 | -| Fory | deserialize | directBuffer | STRUCT | True | 4864329.316938 | -| Fory | deserialize | directBuffer | STRUCT2 | False | 1117586.457565 | -| Fory | deserialize | directBuffer | STRUCT2 | True | 1018277.848128 | -| Fory | deserialize_compatible | array | SAMPLE | False | 2496046.895861 | -| Fory | deserialize_compatible | array | SAMPLE | True | 1834139.395757 | -| Fory | deserialize_compatible | array | MEDIA_CONTENT | False | 1441671.70632 | -| Fory | deserialize_compatible | array | MEDIA_CONTENT | True | 1121136.039627 | -| Fory | deserialize_compatible | array | STRUCT | False | 2110335.039275 | -| Fory | deserialize_compatible | array | STRUCT | True | 2135681.982674 | -| Fory | deserialize_compatible | array | STRUCT2 | False | 849507.176263 | -| Fory | deserialize_compatible | array | STRUCT2 | True | 815120.319155 | -| Fory | deserialize_compatible | directBuffer | SAMPLE | False | 2308111.633661 | -| Fory | deserialize_compatible | directBuffer | SAMPLE | True | 1820490.585648 | -| Fory | deserialize_compatible | directBuffer | MEDIA_CONTENT | False | 1256034.732514 | -| Fory | deserialize_compatible | directBuffer | MEDIA_CONTENT | True | 1054942.751816 | -| Fory | deserialize_compatible | directBuffer | STRUCT | False | 1596464.248141 | -| Fory | deserialize_compatible | directBuffer | STRUCT | True | 1684681.074242 | -| Fory | deserialize_compatible | directBuffer | STRUCT2 | False | 784036.589363 | -| Fory | deserialize_compatible | directBuffer | STRUCT2 | True | 782679.662083 | -| Forymetashared | deserialize_compatible | array | SAMPLE | False | 2485564.396196 | -| Forymetashared | deserialize_compatible | array | SAMPLE | True | 2002938.794909 | -| Forymetashared | deserialize_compatible | array | MEDIA_CONTENT | False | 2479742.810882 | -| Forymetashared | deserialize_compatible | array | MEDIA_CONTENT | True | 1623938.202345 | -| Forymetashared | deserialize_compatible | array | STRUCT | False | 4978833.206806 | -| Forymetashared | deserialize_compatible | array | STRUCT | True | 4807963.88252 | -| Forymetashared | deserialize_compatible | array | STRUCT2 | False | 1201998.142474 | -| Forymetashared | deserialize_compatible | array | STRUCT2 | True | 1058423.614156 | -| Forymetashared | deserialize_compatible | directBuffer | SAMPLE | False | 2489261.533644 | -| Forymetashared | deserialize_compatible | directBuffer | SAMPLE | True | 1927548.827586 | -| Forymetashared | deserialize_compatible | directBuffer | MEDIA_CONTENT | False | 1718098.363961 | -| Forymetashared | deserialize_compatible | directBuffer | MEDIA_CONTENT | True | 1333345.536684 | -| Forymetashared | deserialize_compatible | directBuffer | STRUCT | False | 5149070.65783 | -| Forymetashared | deserialize_compatible | directBuffer | STRUCT | True | 5137500.621288 | -| Forymetashared | deserialize_compatible | directBuffer | STRUCT2 | False | 1131212.586953 | -| Forymetashared | deserialize_compatible | directBuffer | STRUCT2 | True | 1089162.408165 | -| Hession | deserialize | array | SAMPLE | False | 119471.518388 | -| Hession | deserialize | array | SAMPLE | True | 121106.002978 | -| Hession | deserialize | array | MEDIA_CONTENT | False | 118156.072484 | -| Hession | deserialize | array | MEDIA_CONTENT | True | 120016.594171 | -| Hession | deserialize | array | STRUCT | False | 84709.108821 | -| Hession | deserialize | array | STRUCT | True | 91050.370244 | -| Hession | deserialize | array | STRUCT2 | False | 69758.767783 | -| Hession | deserialize | array | STRUCT2 | True | 68616.029248 | -| Hession | deserialize | directBuffer | SAMPLE | False | 117806.916589 | -| Hession | deserialize | directBuffer | SAMPLE | True | 121940.783597 | -| Hession | deserialize | directBuffer | MEDIA_CONTENT | False | 111067.942626 | -| Hession | deserialize | directBuffer | MEDIA_CONTENT | True | 121820.82126 | -| Hession | deserialize | directBuffer | STRUCT | False | 91151.633583 | -| Hession | deserialize | directBuffer | STRUCT | True | 91037.205901 | -| Hession | deserialize | directBuffer | STRUCT2 | False | 66866.108653 | -| Hession | deserialize | directBuffer | STRUCT2 | True | 65338.345185 | -| Hession | deserialize_compatible | array | SAMPLE | False | 121898.105768 | -| Hession | deserialize_compatible | array | SAMPLE | True | 121297.485903 | -| Hession | deserialize_compatible | array | MEDIA_CONTENT | False | 121619.090797 | -| Hession | deserialize_compatible | array | MEDIA_CONTENT | True | 119994.10405 | -| Hession | deserialize_compatible | array | STRUCT | False | 88617.486795 | -| Hession | deserialize_compatible | array | STRUCT | True | 90206.654212 | -| Hession | deserialize_compatible | array | STRUCT2 | False | 63703.763814 | -| Hession | deserialize_compatible | array | STRUCT2 | True | 69521.573119 | -| Hession | deserialize_compatible | directBuffer | SAMPLE | False | 124044.417439 | -| Hession | deserialize_compatible | directBuffer | SAMPLE | True | 120276.449497 | -| Hession | deserialize_compatible | directBuffer | MEDIA_CONTENT | False | 107594.47489 | -| Hession | deserialize_compatible | directBuffer | MEDIA_CONTENT | True | 116531.023438 | -| Hession | deserialize_compatible | directBuffer | STRUCT | False | 89580.561575 | -| Hession | deserialize_compatible | directBuffer | STRUCT | True | 84407.472531 | -| Hession | deserialize_compatible | directBuffer | STRUCT2 | False | 69342.030965 | -| Hession | deserialize_compatible | directBuffer | STRUCT2 | True | 68542.055543 | -| Jdk | deserialize | array | SAMPLE | False | 29309.573998 | -| Jdk | deserialize | array | SAMPLE | True | 27466.003923 | -| Jdk | deserialize | array | MEDIA_CONTENT | False | 38536.250402 | -| Jdk | deserialize | array | MEDIA_CONTENT | True | 38957.19109 | -| Jdk | deserialize | array | STRUCT | False | 29603.066599 | -| Jdk | deserialize | array | STRUCT | True | 29727.744196 | -| Jdk | deserialize | array | STRUCT2 | False | 14888.805111 | -| Jdk | deserialize | array | STRUCT2 | True | 14034.100664 | -| Jdk | deserialize | directBuffer | SAMPLE | False | 28128.457935 | -| Jdk | deserialize | directBuffer | SAMPLE | True | 28241.014735 | -| Jdk | deserialize | directBuffer | MEDIA_CONTENT | False | 40512.632076 | -| Jdk | deserialize | directBuffer | MEDIA_CONTENT | True | 37030.594632 | -| Jdk | deserialize | directBuffer | STRUCT | False | 28717.004518 | -| Jdk | deserialize | directBuffer | STRUCT | True | 29549.998286 | -| Jdk | deserialize | directBuffer | STRUCT2 | False | 14652.043788 | -| Jdk | deserialize | directBuffer | STRUCT2 | True | 14425.886048 | -| Kryo | deserialize | array | SAMPLE | False | 979173.981159 | -| Kryo | deserialize | array | SAMPLE | True | 716438.884369 | -| Kryo | deserialize | array | MEDIA_CONTENT | False | 577631.234369 | -| Kryo | deserialize | array | MEDIA_CONTENT | True | 365530.417232 | -| Kryo | deserialize | array | STRUCT | False | 607750.343557 | -| Kryo | deserialize | array | STRUCT | True | 552802.247807 | -| Kryo | deserialize | array | STRUCT2 | False | 275984.042401 | -| Kryo | deserialize | array | STRUCT2 | True | 242710.554833 | -| Kryo | deserialize | directBuffer | SAMPLE | False | 983538.936801 | -| Kryo | deserialize | directBuffer | SAMPLE | True | 762889.302732 | -| Kryo | deserialize | directBuffer | MEDIA_CONTENT | False | 389473.174523 | -| Kryo | deserialize | directBuffer | MEDIA_CONTENT | True | 306995.240799 | -| Kryo | deserialize | directBuffer | STRUCT | False | 910534.169114 | -| Kryo | deserialize | directBuffer | STRUCT | True | 914404.107564 | -| Kryo | deserialize | directBuffer | STRUCT2 | False | 319247.256793 | -| Kryo | deserialize | directBuffer | STRUCT2 | True | 249105.828416 | -| Kryo | deserialize_compatible | array | SAMPLE | False | 255086.928308 | -| Kryo | deserialize_compatible | array | SAMPLE | True | 238811.99551 | -| Kryo | deserialize_compatible | array | MEDIA_CONTENT | False | 180882.860363 | -| Kryo | deserialize_compatible | array | MEDIA_CONTENT | True | 154311.21154 | -| Kryo | deserialize_compatible | array | STRUCT | False | 78771.635309 | -| Kryo | deserialize_compatible | array | STRUCT | True | 72805.937649 | -| Kryo | deserialize_compatible | array | STRUCT2 | False | 60602.285743 | -| Kryo | deserialize_compatible | array | STRUCT2 | True | 62729.908347 | -| Kryo | deserialize_compatible | directBuffer | SAMPLE | False | 201993.78789 | -| Kryo | deserialize_compatible | directBuffer | SAMPLE | True | 174534.71087 | -| Kryo | deserialize_compatible | directBuffer | MEDIA_CONTENT | False | 134485.1603 | -| Kryo | deserialize_compatible | directBuffer | MEDIA_CONTENT | True | 119311.787329 | -| Kryo | deserialize_compatible | directBuffer | STRUCT | False | 58574.904245 | -| Kryo | deserialize_compatible | directBuffer | STRUCT | True | 60685.320299 | -| Kryo | deserialize_compatible | directBuffer | STRUCT2 | False | 54637.329134 | -| Kryo | deserialize_compatible | directBuffer | STRUCT2 | True | 51761.569591 | -| Protostuff | deserialize | array | SAMPLE | False | 619338.385412 | -| Protostuff | deserialize | array | MEDIA_CONTENT | False | 951662.019963 | -| Protostuff | deserialize | array | STRUCT | False | 517381.168594 | -| Protostuff | deserialize | array | STRUCT2 | False | 416212.973861 | -| Protostuff | deserialize | directBuffer | SAMPLE | False | 624804.978534 | -| Protostuff | deserialize | directBuffer | MEDIA_CONTENT | False | 964664.641598 | -| Protostuff | deserialize | directBuffer | STRUCT | False | 538924.947147 | -| Protostuff | deserialize | directBuffer | STRUCT2 | False | 425523.315814 | +| Lib | Benchmark | bufferType | objectType | references | Tps | +| -------------- | ---------------------- | ------------ | ------------- | ---------- | --------------- | +| Fst | serialize | array | SAMPLE | False | 915907.574306 | +| Fst | serialize | array | SAMPLE | True | 731869.156376 | +| Fst | serialize | array | MEDIA_CONTENT | False | 751892.023189 | +| Fst | serialize | array | MEDIA_CONTENT | True | 583859.907758 | +| Fst | serialize | array | STRUCT | False | 882178.995727 | +| Fst | serialize | array | STRUCT | True | 757753.756691 | +| Fst | serialize | array | STRUCT2 | False | 371762.982661 | +| Fst | serialize | array | STRUCT2 | True | 380638.700267 | +| Fst | serialize | directBuffer | SAMPLE | False | 902302.261168 | +| Fst | serialize | directBuffer | SAMPLE | True | 723614.06677 | +| Fst | serialize | directBuffer | MEDIA_CONTENT | False | 728001.08025 | +| Fst | serialize | directBuffer | MEDIA_CONTENT | True | 595679.580108 | +| Fst | serialize | directBuffer | STRUCT | False | 807847.663261 | +| Fst | serialize | directBuffer | STRUCT | True | 762088.935404 | +| Fst | serialize | directBuffer | STRUCT2 | False | 365317.705376 | +| Fst | serialize | directBuffer | STRUCT2 | True | 370851.880711 | +| Fory | serialize | array | SAMPLE | False | 3570966.469087 | +| Fory | serialize | array | SAMPLE | True | 1767693.83509 | +| Fory | serialize | array | MEDIA_CONTENT | False | 3031642.924542 | +| Fory | serialize | array | MEDIA_CONTENT | True | 2450384.600246 | +| Fory | serialize | array | STRUCT | False | 7501415.56726 | +| Fory | serialize | array | STRUCT | True | 6264439.154428 | +| Fory | serialize | array | STRUCT2 | False | 3586126.623874 | +| Fory | serialize | array | STRUCT2 | True | 3306474.506382 | +| Fory | serialize | directBuffer | SAMPLE | False | 3684487.760591 | +| Fory | serialize | directBuffer | SAMPLE | True | 1826456.709478 | +| Fory | serialize | directBuffer | MEDIA_CONTENT | False | 2479862.129632 | +| Fory | serialize | directBuffer | MEDIA_CONTENT | True | 1938527.588331 | +| Fory | serialize | directBuffer | STRUCT | False | 9834243.243204 | +| Fory | serialize | directBuffer | STRUCT | True | 7551780.823133 | +| Fory | serialize | directBuffer | STRUCT2 | False | 2643155.135327 | +| Fory | serialize | directBuffer | STRUCT2 | True | 2391110.083108 | +| Fory | serialize_compatible | array | SAMPLE | False | 3604596.465625 | +| Fory | serialize_compatible | array | SAMPLE | True | 1619648.337293 | +| Fory | serialize_compatible | array | MEDIA_CONTENT | False | 1679272.036243 | +| Fory | serialize_compatible | array | MEDIA_CONTENT | True | 1406736.538716 | +| Fory | serialize_compatible | array | STRUCT | False | 3530406.108869 | +| Fory | serialize_compatible | array | STRUCT | True | 3293059.098127 | +| Fory | serialize_compatible | array | STRUCT2 | False | 2773368.99768 | +| Fory | serialize_compatible | array | STRUCT2 | True | 2564174.550276 | +| Fory | serialize_compatible | directBuffer | SAMPLE | False | 3484533.218305 | +| Fory | serialize_compatible | directBuffer | SAMPLE | True | 1730824.630648 | +| Fory | serialize_compatible | directBuffer | MEDIA_CONTENT | False | 1710680.937387 | +| Fory | serialize_compatible | directBuffer | MEDIA_CONTENT | True | 1149999.473994 | +| Fory | serialize_compatible | directBuffer | STRUCT | False | 2653169.568374 | +| Fory | serialize_compatible | directBuffer | STRUCT | True | 2393817.762938 | +| Fory | serialize_compatible | directBuffer | STRUCT2 | False | 1912402.937879 | +| Fory | serialize_compatible | directBuffer | STRUCT2 | True | 1848338.968058 | +| Forymetashared | serialize_compatible | array | SAMPLE | False | 4409055.687063 | +| Forymetashared | serialize_compatible | array | SAMPLE | True | 1840705.439334 | +| Forymetashared | serialize_compatible | array | MEDIA_CONTENT | False | 2992488.235281 | +| Forymetashared | serialize_compatible | array | MEDIA_CONTENT | True | 2058738.716953 | +| Forymetashared | serialize_compatible | array | STRUCT | False | 9204444.777172 | +| Forymetashared | serialize_compatible | array | STRUCT | True | 7064625.291374 | +| Forymetashared | serialize_compatible | array | STRUCT2 | False | 2575824.143864 | +| Forymetashared | serialize_compatible | array | STRUCT2 | True | 3543082.528217 | +| Forymetashared | serialize_compatible | directBuffer | SAMPLE | False | 5043538.364886 | +| Forymetashared | serialize_compatible | directBuffer | SAMPLE | True | 1859289.705838 | +| Forymetashared | serialize_compatible | directBuffer | MEDIA_CONTENT | False | 2491443.556971 | +| Forymetashared | serialize_compatible | directBuffer | MEDIA_CONTENT | True | 1804349.244125 | +| Forymetashared | serialize_compatible | directBuffer | STRUCT | False | 11650249.648715 | +| Forymetashared | serialize_compatible | directBuffer | STRUCT | True | 8702412.752357 | +| Forymetashared | serialize_compatible | directBuffer | STRUCT2 | False | 2714748.572448 | +| Forymetashared | serialize_compatible | directBuffer | STRUCT2 | True | 1866073.031851 | +| Hession | serialize | array | SAMPLE | False | 240386.502846 | +| Hession | serialize | array | SAMPLE | True | 192414.014211 | +| Hession | serialize | array | MEDIA_CONTENT | False | 367782.358049 | +| Hession | serialize | array | MEDIA_CONTENT | True | 329427.47068 | +| Hession | serialize | array | STRUCT | False | 258233.998931 | +| Hession | serialize | array | STRUCT | True | 260845.209485 | +| Hession | serialize | array | STRUCT2 | False | 56056.080075 | +| Hession | serialize | array | STRUCT2 | True | 60038.87979 | +| Hession | serialize | directBuffer | SAMPLE | False | 240981.308085 | +| Hession | serialize | directBuffer | SAMPLE | True | 211949.960255 | +| Hession | serialize | directBuffer | MEDIA_CONTENT | False | 372477.13815 | +| Hession | serialize | directBuffer | MEDIA_CONTENT | True | 353376.085025 | +| Hession | serialize | directBuffer | STRUCT | False | 266481.009245 | +| Hession | serialize | directBuffer | STRUCT | True | 261762.594966 | +| Hession | serialize | directBuffer | STRUCT2 | False | 55924.319442 | +| Hession | serialize | directBuffer | STRUCT2 | True | 56674.065604 | +| Hession | serialize_compatible | array | SAMPLE | False | 234454.975158 | +| Hession | serialize_compatible | array | SAMPLE | True | 206174.173039 | +| Hession | serialize_compatible | array | MEDIA_CONTENT | False | 377195.903772 | +| Hession | serialize_compatible | array | MEDIA_CONTENT | True | 351657.879556 | +| Hession | serialize_compatible | array | STRUCT | False | 258650.663523 | +| Hession | serialize_compatible | array | STRUCT | True | 263564.913879 | +| Hession | serialize_compatible | array | STRUCT2 | False | 58509.125342 | +| Hession | serialize_compatible | array | STRUCT2 | True | 55552.977735 | +| Hession | serialize_compatible | directBuffer | SAMPLE | False | 194761.244263 | +| Hession | serialize_compatible | directBuffer | SAMPLE | True | 212840.483308 | +| Hession | serialize_compatible | directBuffer | MEDIA_CONTENT | False | 371729.727192 | +| Hession | serialize_compatible | directBuffer | MEDIA_CONTENT | True | 343834.954942 | +| Hession | serialize_compatible | directBuffer | STRUCT | False | 249241.452137 | +| Hession | serialize_compatible | directBuffer | STRUCT | True | 263623.143601 | +| Hession | serialize_compatible | directBuffer | STRUCT2 | False | 58908.567439 | +| Hession | serialize_compatible | directBuffer | STRUCT2 | True | 55524.373547 | +| Jdk | serialize | array | SAMPLE | False | 118374.836631 | +| Jdk | serialize | array | SAMPLE | True | 119858.140625 | +| Jdk | serialize | array | MEDIA_CONTENT | False | 137989.198821 | +| Jdk | serialize | array | MEDIA_CONTENT | True | 140260.668888 | +| Jdk | serialize | array | STRUCT | False | 155908.24424 | +| Jdk | serialize | array | STRUCT | True | 151258.539369 | +| Jdk | serialize | array | STRUCT2 | False | 36846.049162 | +| Jdk | serialize | array | STRUCT2 | True | 38183.705811 | +| Jdk | serialize | directBuffer | SAMPLE | False | 118273.584257 | +| Jdk | serialize | directBuffer | SAMPLE | True | 108263.040839 | +| Jdk | serialize | directBuffer | MEDIA_CONTENT | False | 138567.623369 | +| Jdk | serialize | directBuffer | MEDIA_CONTENT | True | 140158.67391 | +| Jdk | serialize | directBuffer | STRUCT | False | 154875.908438 | +| Jdk | serialize | directBuffer | STRUCT | True | 156404.686214 | +| Jdk | serialize | directBuffer | STRUCT2 | False | 37444.967981 | +| Jdk | serialize | directBuffer | STRUCT2 | True | 35798.679246 | +| Kryo | serialize | array | SAMPLE | False | 1105365.931217 | +| Kryo | serialize | array | SAMPLE | True | 734215.482491 | +| Kryo | serialize | array | MEDIA_CONTENT | False | 730792.521676 | +| Kryo | serialize | array | MEDIA_CONTENT | True | 445251.084327 | +| Kryo | serialize | array | STRUCT | False | 558194.100861 | +| Kryo | serialize | array | STRUCT | True | 557542.628765 | +| Kryo | serialize | array | STRUCT2 | False | 325172.969175 | +| Kryo | serialize | array | STRUCT2 | True | 259863.332448 | +| Kryo | serialize | directBuffer | SAMPLE | False | 1376560.302168 | +| Kryo | serialize | directBuffer | SAMPLE | True | 932887.968348 | +| Kryo | serialize | directBuffer | MEDIA_CONTENT | False | 608972.51758 | +| Kryo | serialize | directBuffer | MEDIA_CONTENT | True | 359875.473951 | +| Kryo | serialize | directBuffer | STRUCT | False | 1078046.011115 | +| Kryo | serialize | directBuffer | STRUCT | True | 853350.408656 | +| Kryo | serialize | directBuffer | STRUCT2 | False | 355688.882786 | +| Kryo | serialize | directBuffer | STRUCT2 | True | 338960.426033 | +| Kryo | serialize_compatible | array | SAMPLE | False | 378907.663184 | +| Kryo | serialize_compatible | array | SAMPLE | True | 320815.567701 | +| Kryo | serialize_compatible | array | MEDIA_CONTENT | False | 188911.259146 | +| Kryo | serialize_compatible | array | MEDIA_CONTENT | True | 145782.916427 | +| Kryo | serialize_compatible | array | STRUCT | False | 145964.199559 | +| Kryo | serialize_compatible | array | STRUCT | True | 136180.832879 | +| Kryo | serialize_compatible | array | STRUCT2 | False | 125807.748004 | +| Kryo | serialize_compatible | array | STRUCT2 | True | 114983.546343 | +| Kryo | serialize_compatible | directBuffer | SAMPLE | False | 296102.615094 | +| Kryo | serialize_compatible | directBuffer | SAMPLE | True | 276757.392449 | +| Kryo | serialize_compatible | directBuffer | MEDIA_CONTENT | False | 185363.714829 | +| Kryo | serialize_compatible | directBuffer | MEDIA_CONTENT | True | 142836.961878 | +| Kryo | serialize_compatible | directBuffer | STRUCT | False | 106695.800245 | +| Kryo | serialize_compatible | directBuffer | STRUCT | True | 106458.212005 | +| Kryo | serialize_compatible | directBuffer | STRUCT2 | False | 92130.672361 | +| Kryo | serialize_compatible | directBuffer | STRUCT2 | True | 88989.724768 | +| Protostuff | serialize | array | SAMPLE | False | 663272.710783 | +| Protostuff | serialize | array | MEDIA_CONTENT | False | 780618.761219 | +| Protostuff | serialize | array | STRUCT | False | 330975.350403 | +| Protostuff | serialize | array | STRUCT2 | False | 324563.440433 | +| Protostuff | serialize | directBuffer | SAMPLE | False | 693641.589806 | +| Protostuff | serialize | directBuffer | MEDIA_CONTENT | False | 805941.345157 | +| Protostuff | serialize | directBuffer | STRUCT | False | 340262.650047 | +| Protostuff | serialize | directBuffer | STRUCT2 | False | 325093.716261 | +| Fst | deserialize | array | SAMPLE | False | 473409.796491 | +| Fst | deserialize | array | SAMPLE | True | 428315.502365 | +| Fst | deserialize | array | MEDIA_CONTENT | False | 363455.785182 | +| Fst | deserialize | array | MEDIA_CONTENT | True | 304371.728638 | +| Fst | deserialize | array | STRUCT | False | 357887.235311 | +| Fst | deserialize | array | STRUCT | True | 353480.554035 | +| Fst | deserialize | array | STRUCT2 | False | 280131.091068 | +| Fst | deserialize | array | STRUCT2 | True | 260649.308016 | +| Fst | deserialize | directBuffer | SAMPLE | False | 441027.550809 | +| Fst | deserialize | directBuffer | SAMPLE | True | 420523.770904 | +| Fst | deserialize | directBuffer | MEDIA_CONTENT | False | 311691.658687 | +| Fst | deserialize | directBuffer | MEDIA_CONTENT | True | 251820.171513 | +| Fst | deserialize | directBuffer | STRUCT | False | 352441.597147 | +| Fst | deserialize | directBuffer | STRUCT | True | 334574.303484 | +| Fst | deserialize | directBuffer | STRUCT2 | False | 262519.85881 | +| Fst | deserialize | directBuffer | STRUCT2 | True | 234973.637096 | +| Fory | deserialize | array | SAMPLE | False | 2069988.624415 | +| Fory | deserialize | array | SAMPLE | True | 1797942.442313 | +| Fory | deserialize | array | MEDIA_CONTENT | False | 2054066.903469 | +| Fory | deserialize | array | MEDIA_CONTENT | True | 1507767.206603 | +| Fory | deserialize | array | STRUCT | False | 4595230.434552 | +| Fory | deserialize | array | STRUCT | True | 4634753.596131 | +| Fory | deserialize | array | STRUCT2 | False | 1126298.35955 | +| Fory | deserialize | array | STRUCT2 | True | 1046649.083082 | +| Fory | deserialize | directBuffer | SAMPLE | False | 2429791.078395 | +| Fory | deserialize | directBuffer | SAMPLE | True | 1958815.397807 | +| Fory | deserialize | directBuffer | MEDIA_CONTENT | False | 1502746.028159 | +| Fory | deserialize | directBuffer | MEDIA_CONTENT | True | 1290593.975753 | +| Fory | deserialize | directBuffer | STRUCT | False | 5012002.859236 | +| Fory | deserialize | directBuffer | STRUCT | True | 4864329.316938 | +| Fory | deserialize | directBuffer | STRUCT2 | False | 1117586.457565 | +| Fory | deserialize | directBuffer | STRUCT2 | True | 1018277.848128 | +| Fory | deserialize_compatible | array | SAMPLE | False | 2496046.895861 | +| Fory | deserialize_compatible | array | SAMPLE | True | 1834139.395757 | +| Fory | deserialize_compatible | array | MEDIA_CONTENT | False | 1441671.70632 | +| Fory | deserialize_compatible | array | MEDIA_CONTENT | True | 1121136.039627 | +| Fory | deserialize_compatible | array | STRUCT | False | 2110335.039275 | +| Fory | deserialize_compatible | array | STRUCT | True | 2135681.982674 | +| Fory | deserialize_compatible | array | STRUCT2 | False | 849507.176263 | +| Fory | deserialize_compatible | array | STRUCT2 | True | 815120.319155 | +| Fory | deserialize_compatible | directBuffer | SAMPLE | False | 2308111.633661 | +| Fory | deserialize_compatible | directBuffer | SAMPLE | True | 1820490.585648 | +| Fory | deserialize_compatible | directBuffer | MEDIA_CONTENT | False | 1256034.732514 | +| Fory | deserialize_compatible | directBuffer | MEDIA_CONTENT | True | 1054942.751816 | +| Fory | deserialize_compatible | directBuffer | STRUCT | False | 1596464.248141 | +| Fory | deserialize_compatible | directBuffer | STRUCT | True | 1684681.074242 | +| Fory | deserialize_compatible | directBuffer | STRUCT2 | False | 784036.589363 | +| Fory | deserialize_compatible | directBuffer | STRUCT2 | True | 782679.662083 | +| Forymetashared | deserialize_compatible | array | SAMPLE | False | 2485564.396196 | +| Forymetashared | deserialize_compatible | array | SAMPLE | True | 2002938.794909 | +| Forymetashared | deserialize_compatible | array | MEDIA_CONTENT | False | 2479742.810882 | +| Forymetashared | deserialize_compatible | array | MEDIA_CONTENT | True | 1623938.202345 | +| Forymetashared | deserialize_compatible | array | STRUCT | False | 4978833.206806 | +| Forymetashared | deserialize_compatible | array | STRUCT | True | 4807963.88252 | +| Forymetashared | deserialize_compatible | array | STRUCT2 | False | 1201998.142474 | +| Forymetashared | deserialize_compatible | array | STRUCT2 | True | 1058423.614156 | +| Forymetashared | deserialize_compatible | directBuffer | SAMPLE | False | 2489261.533644 | +| Forymetashared | deserialize_compatible | directBuffer | SAMPLE | True | 1927548.827586 | +| Forymetashared | deserialize_compatible | directBuffer | MEDIA_CONTENT | False | 1718098.363961 | +| Forymetashared | deserialize_compatible | directBuffer | MEDIA_CONTENT | True | 1333345.536684 | +| Forymetashared | deserialize_compatible | directBuffer | STRUCT | False | 5149070.65783 | +| Forymetashared | deserialize_compatible | directBuffer | STRUCT | True | 5137500.621288 | +| Forymetashared | deserialize_compatible | directBuffer | STRUCT2 | False | 1131212.586953 | +| Forymetashared | deserialize_compatible | directBuffer | STRUCT2 | True | 1089162.408165 | +| Hession | deserialize | array | SAMPLE | False | 119471.518388 | +| Hession | deserialize | array | SAMPLE | True | 121106.002978 | +| Hession | deserialize | array | MEDIA_CONTENT | False | 118156.072484 | +| Hession | deserialize | array | MEDIA_CONTENT | True | 120016.594171 | +| Hession | deserialize | array | STRUCT | False | 84709.108821 | +| Hession | deserialize | array | STRUCT | True | 91050.370244 | +| Hession | deserialize | array | STRUCT2 | False | 69758.767783 | +| Hession | deserialize | array | STRUCT2 | True | 68616.029248 | +| Hession | deserialize | directBuffer | SAMPLE | False | 117806.916589 | +| Hession | deserialize | directBuffer | SAMPLE | True | 121940.783597 | +| Hession | deserialize | directBuffer | MEDIA_CONTENT | False | 111067.942626 | +| Hession | deserialize | directBuffer | MEDIA_CONTENT | True | 121820.82126 | +| Hession | deserialize | directBuffer | STRUCT | False | 91151.633583 | +| Hession | deserialize | directBuffer | STRUCT | True | 91037.205901 | +| Hession | deserialize | directBuffer | STRUCT2 | False | 66866.108653 | +| Hession | deserialize | directBuffer | STRUCT2 | True | 65338.345185 | +| Hession | deserialize_compatible | array | SAMPLE | False | 121898.105768 | +| Hession | deserialize_compatible | array | SAMPLE | True | 121297.485903 | +| Hession | deserialize_compatible | array | MEDIA_CONTENT | False | 121619.090797 | +| Hession | deserialize_compatible | array | MEDIA_CONTENT | True | 119994.10405 | +| Hession | deserialize_compatible | array | STRUCT | False | 88617.486795 | +| Hession | deserialize_compatible | array | STRUCT | True | 90206.654212 | +| Hession | deserialize_compatible | array | STRUCT2 | False | 63703.763814 | +| Hession | deserialize_compatible | array | STRUCT2 | True | 69521.573119 | +| Hession | deserialize_compatible | directBuffer | SAMPLE | False | 124044.417439 | +| Hession | deserialize_compatible | directBuffer | SAMPLE | True | 120276.449497 | +| Hession | deserialize_compatible | directBuffer | MEDIA_CONTENT | False | 107594.47489 | +| Hession | deserialize_compatible | directBuffer | MEDIA_CONTENT | True | 116531.023438 | +| Hession | deserialize_compatible | directBuffer | STRUCT | False | 89580.561575 | +| Hession | deserialize_compatible | directBuffer | STRUCT | True | 84407.472531 | +| Hession | deserialize_compatible | directBuffer | STRUCT2 | False | 69342.030965 | +| Hession | deserialize_compatible | directBuffer | STRUCT2 | True | 68542.055543 | +| Jdk | deserialize | array | SAMPLE | False | 29309.573998 | +| Jdk | deserialize | array | SAMPLE | True | 27466.003923 | +| Jdk | deserialize | array | MEDIA_CONTENT | False | 38536.250402 | +| Jdk | deserialize | array | MEDIA_CONTENT | True | 38957.19109 | +| Jdk | deserialize | array | STRUCT | False | 29603.066599 | +| Jdk | deserialize | array | STRUCT | True | 29727.744196 | +| Jdk | deserialize | array | STRUCT2 | False | 14888.805111 | +| Jdk | deserialize | array | STRUCT2 | True | 14034.100664 | +| Jdk | deserialize | directBuffer | SAMPLE | False | 28128.457935 | +| Jdk | deserialize | directBuffer | SAMPLE | True | 28241.014735 | +| Jdk | deserialize | directBuffer | MEDIA_CONTENT | False | 40512.632076 | +| Jdk | deserialize | directBuffer | MEDIA_CONTENT | True | 37030.594632 | +| Jdk | deserialize | directBuffer | STRUCT | False | 28717.004518 | +| Jdk | deserialize | directBuffer | STRUCT | True | 29549.998286 | +| Jdk | deserialize | directBuffer | STRUCT2 | False | 14652.043788 | +| Jdk | deserialize | directBuffer | STRUCT2 | True | 14425.886048 | +| Kryo | deserialize | array | SAMPLE | False | 979173.981159 | +| Kryo | deserialize | array | SAMPLE | True | 716438.884369 | +| Kryo | deserialize | array | MEDIA_CONTENT | False | 577631.234369 | +| Kryo | deserialize | array | MEDIA_CONTENT | True | 365530.417232 | +| Kryo | deserialize | array | STRUCT | False | 607750.343557 | +| Kryo | deserialize | array | STRUCT | True | 552802.247807 | +| Kryo | deserialize | array | STRUCT2 | False | 275984.042401 | +| Kryo | deserialize | array | STRUCT2 | True | 242710.554833 | +| Kryo | deserialize | directBuffer | SAMPLE | False | 983538.936801 | +| Kryo | deserialize | directBuffer | SAMPLE | True | 762889.302732 | +| Kryo | deserialize | directBuffer | MEDIA_CONTENT | False | 389473.174523 | +| Kryo | deserialize | directBuffer | MEDIA_CONTENT | True | 306995.240799 | +| Kryo | deserialize | directBuffer | STRUCT | False | 910534.169114 | +| Kryo | deserialize | directBuffer | STRUCT | True | 914404.107564 | +| Kryo | deserialize | directBuffer | STRUCT2 | False | 319247.256793 | +| Kryo | deserialize | directBuffer | STRUCT2 | True | 249105.828416 | +| Kryo | deserialize_compatible | array | SAMPLE | False | 255086.928308 | +| Kryo | deserialize_compatible | array | SAMPLE | True | 238811.99551 | +| Kryo | deserialize_compatible | array | MEDIA_CONTENT | False | 180882.860363 | +| Kryo | deserialize_compatible | array | MEDIA_CONTENT | True | 154311.21154 | +| Kryo | deserialize_compatible | array | STRUCT | False | 78771.635309 | +| Kryo | deserialize_compatible | array | STRUCT | True | 72805.937649 | +| Kryo | deserialize_compatible | array | STRUCT2 | False | 60602.285743 | +| Kryo | deserialize_compatible | array | STRUCT2 | True | 62729.908347 | +| Kryo | deserialize_compatible | directBuffer | SAMPLE | False | 201993.78789 | +| Kryo | deserialize_compatible | directBuffer | SAMPLE | True | 174534.71087 | +| Kryo | deserialize_compatible | directBuffer | MEDIA_CONTENT | False | 134485.1603 | +| Kryo | deserialize_compatible | directBuffer | MEDIA_CONTENT | True | 119311.787329 | +| Kryo | deserialize_compatible | directBuffer | STRUCT | False | 58574.904245 | +| Kryo | deserialize_compatible | directBuffer | STRUCT | True | 60685.320299 | +| Kryo | deserialize_compatible | directBuffer | STRUCT2 | False | 54637.329134 | +| Kryo | deserialize_compatible | directBuffer | STRUCT2 | True | 51761.569591 | +| Protostuff | deserialize | array | SAMPLE | False | 619338.385412 | +| Protostuff | deserialize | array | MEDIA_CONTENT | False | 951662.019963 | +| Protostuff | deserialize | array | STRUCT | False | 517381.168594 | +| Protostuff | deserialize | array | STRUCT2 | False | 416212.973861 | +| Protostuff | deserialize | directBuffer | SAMPLE | False | 624804.978534 | +| Protostuff | deserialize | directBuffer | MEDIA_CONTENT | False | 964664.641598 | +| Protostuff | deserialize | directBuffer | STRUCT | False | 538924.947147 | +| Protostuff | deserialize | directBuffer | STRUCT2 | False | 425523.315814 | ### Java Zero-copy -| Lib | Benchmark | array_size | bufferType | dataType | Tps | -| ------- | ------- | ------- | ------- | ------- | ------- | -| Fst | deserialize | 200 | array | PRIMITIVE_ARRAY | 219333.990504 | -| Fst | deserialize | 200 | array | BUFFER | 657754.887247 | -| Fst | deserialize | 200 | directBuffer | PRIMITIVE_ARRAY | 179604.045774 | -| Fst | deserialize | 200 | directBuffer | BUFFER | 598421.278941 | -| Fst | deserialize | 1000 | array | PRIMITIVE_ARRAY | 53100.903684 | -| Fst | deserialize | 1000 | array | BUFFER | 424147.154601 | -| Fst | deserialize | 1000 | directBuffer | PRIMITIVE_ARRAY | 38572.001768 | -| Fst | deserialize | 1000 | directBuffer | BUFFER | 298929.116572 | -| Fst | deserialize | 5000 | array | PRIMITIVE_ARRAY | 10672.872798 | -| Fst | deserialize | 5000 | array | BUFFER | 136934.604328 | -| Fst | deserialize | 5000 | directBuffer | PRIMITIVE_ARRAY | 8561.694533 | -| Fst | deserialize | 5000 | directBuffer | BUFFER | 77950.612503 | -| Fst | serialize | 200 | array | PRIMITIVE_ARRAY | 313986.053417 | -| Fst | serialize | 200 | array | BUFFER | 2400193.240466 | -| Fst | serialize | 200 | directBuffer | PRIMITIVE_ARRAY | 294132.218623 | -| Fst | serialize | 200 | directBuffer | BUFFER | 2482550.111756 | -| Fst | serialize | 1000 | array | PRIMITIVE_ARRAY | 67209.107012 | -| Fst | serialize | 1000 | array | BUFFER | 1805557.47781 | -| Fst | serialize | 1000 | directBuffer | PRIMITIVE_ARRAY | 66108.014324 | -| Fst | serialize | 1000 | directBuffer | BUFFER | 1644789.42701 | -| Fst | serialize | 5000 | array | PRIMITIVE_ARRAY | 14997.400124 | -| Fst | serialize | 5000 | array | BUFFER | 811029.402136 | -| Fst | serialize | 5000 | directBuffer | PRIMITIVE_ARRAY | 15000.378818 | -| Fst | serialize | 5000 | directBuffer | BUFFER | 477148.54085 | -| Fory | deserialize | 200 | array | PRIMITIVE_ARRAY | 986136.067809 | -| Fory | deserialize | 200 | array | BUFFER | 3302149.383135 | -| Fory | deserialize | 200 | directBuffer | PRIMITIVE_ARRAY | 991807.969328 | -| Fory | deserialize | 200 | directBuffer | BUFFER | 3113115.471758 | -| Fory | deserialize | 1000 | array | PRIMITIVE_ARRAY | 205671.992736 | -| Fory | deserialize | 1000 | array | BUFFER | 2831942.848999 | -| Fory | deserialize | 1000 | directBuffer | PRIMITIVE_ARRAY | 202475.242341 | -| Fory | deserialize | 1000 | directBuffer | BUFFER | 3397690.327371 | -| Fory | deserialize | 5000 | array | PRIMITIVE_ARRAY | 40312.590172 | -| Fory | deserialize | 5000 | array | BUFFER | 3296658.120035 | -| Fory | deserialize | 5000 | directBuffer | PRIMITIVE_ARRAY | 40413.743717 | -| Fory | deserialize | 5000 | directBuffer | BUFFER | 3284441.570594 | -| Fory | serialize | 200 | array | PRIMITIVE_ARRAY | 8297232.942927 | -| Fory | serialize | 200 | array | BUFFER | 5123572.914045 | -| Fory | serialize | 200 | directBuffer | PRIMITIVE_ARRAY | 8335248.350301 | -| Fory | serialize | 200 | directBuffer | BUFFER | 5400346.890126 | -| Fory | serialize | 1000 | array | PRIMITIVE_ARRAY | 8772856.921028 | -| Fory | serialize | 1000 | array | BUFFER | 4979590.929127 | -| Fory | serialize | 1000 | directBuffer | PRIMITIVE_ARRAY | 8207563.785251 | -| Fory | serialize | 1000 | directBuffer | BUFFER | 5376191.775007 | -| Fory | serialize | 5000 | array | PRIMITIVE_ARRAY | 8027439.580246 | -| Fory | serialize | 5000 | array | BUFFER | 5018916.32477 | -| Fory | serialize | 5000 | directBuffer | PRIMITIVE_ARRAY | 7695981.988316 | -| Fory | serialize | 5000 | directBuffer | BUFFER | 5330897.68296 | -| Kryo | deserialize | 200 | array | PRIMITIVE_ARRAY | 146675.360652 | -| Kryo | deserialize | 200 | array | BUFFER | 1296284.78772 | -| Kryo | deserialize | 200 | directBuffer | PRIMITIVE_ARRAY | 518713.299424 | -| Kryo | deserialize | 200 | directBuffer | BUFFER | 1004844.498712 | -| Kryo | deserialize | 1000 | array | PRIMITIVE_ARRAY | 30409.835023 | -| Kryo | deserialize | 1000 | array | BUFFER | 721266.54113 | -| Kryo | deserialize | 1000 | directBuffer | PRIMITIVE_ARRAY | 112132.004609 | -| Kryo | deserialize | 1000 | directBuffer | BUFFER | 592972.713203 | -| Kryo | deserialize | 5000 | array | PRIMITIVE_ARRAY | 6124.351248 | -| Kryo | deserialize | 5000 | array | BUFFER | 147251.846111 | -| Kryo | deserialize | 5000 | directBuffer | PRIMITIVE_ARRAY | 21826.04041 | -| Kryo | deserialize | 5000 | directBuffer | BUFFER | 148614.476829 | -| Kryo | serialize | 200 | array | PRIMITIVE_ARRAY | 147342.606262 | -| Kryo | serialize | 200 | array | BUFFER | 1985187.977633 | -| Kryo | serialize | 200 | directBuffer | PRIMITIVE_ARRAY | 972683.763633 | -| Kryo | serialize | 200 | directBuffer | BUFFER | 1739454.51977 | -| Kryo | serialize | 1000 | array | PRIMITIVE_ARRAY | 31395.721514 | -| Kryo | serialize | 1000 | array | BUFFER | 1616159.67123 | -| Kryo | serialize | 1000 | directBuffer | PRIMITIVE_ARRAY | 209183.090868 | -| Kryo | serialize | 1000 | directBuffer | BUFFER | 1377272.56851 | -| Kryo | serialize | 5000 | array | PRIMITIVE_ARRAY | 6248.006967 | -| Kryo | serialize | 5000 | array | BUFFER | 711287.533377 | -| Kryo | serialize | 5000 | directBuffer | PRIMITIVE_ARRAY | 43565.678616 | -| Kryo | serialize | 5000 | directBuffer | BUFFER | 707092.956534 | +| Lib | Benchmark | array_size | bufferType | dataType | Tps | +| ---- | ----------- | ---------- | ------------ | --------------- | -------------- | +| Fst | deserialize | 200 | array | PRIMITIVE_ARRAY | 219333.990504 | +| Fst | deserialize | 200 | array | BUFFER | 657754.887247 | +| Fst | deserialize | 200 | directBuffer | PRIMITIVE_ARRAY | 179604.045774 | +| Fst | deserialize | 200 | directBuffer | BUFFER | 598421.278941 | +| Fst | deserialize | 1000 | array | PRIMITIVE_ARRAY | 53100.903684 | +| Fst | deserialize | 1000 | array | BUFFER | 424147.154601 | +| Fst | deserialize | 1000 | directBuffer | PRIMITIVE_ARRAY | 38572.001768 | +| Fst | deserialize | 1000 | directBuffer | BUFFER | 298929.116572 | +| Fst | deserialize | 5000 | array | PRIMITIVE_ARRAY | 10672.872798 | +| Fst | deserialize | 5000 | array | BUFFER | 136934.604328 | +| Fst | deserialize | 5000 | directBuffer | PRIMITIVE_ARRAY | 8561.694533 | +| Fst | deserialize | 5000 | directBuffer | BUFFER | 77950.612503 | +| Fst | serialize | 200 | array | PRIMITIVE_ARRAY | 313986.053417 | +| Fst | serialize | 200 | array | BUFFER | 2400193.240466 | +| Fst | serialize | 200 | directBuffer | PRIMITIVE_ARRAY | 294132.218623 | +| Fst | serialize | 200 | directBuffer | BUFFER | 2482550.111756 | +| Fst | serialize | 1000 | array | PRIMITIVE_ARRAY | 67209.107012 | +| Fst | serialize | 1000 | array | BUFFER | 1805557.47781 | +| Fst | serialize | 1000 | directBuffer | PRIMITIVE_ARRAY | 66108.014324 | +| Fst | serialize | 1000 | directBuffer | BUFFER | 1644789.42701 | +| Fst | serialize | 5000 | array | PRIMITIVE_ARRAY | 14997.400124 | +| Fst | serialize | 5000 | array | BUFFER | 811029.402136 | +| Fst | serialize | 5000 | directBuffer | PRIMITIVE_ARRAY | 15000.378818 | +| Fst | serialize | 5000 | directBuffer | BUFFER | 477148.54085 | +| Fory | deserialize | 200 | array | PRIMITIVE_ARRAY | 986136.067809 | +| Fory | deserialize | 200 | array | BUFFER | 3302149.383135 | +| Fory | deserialize | 200 | directBuffer | PRIMITIVE_ARRAY | 991807.969328 | +| Fory | deserialize | 200 | directBuffer | BUFFER | 3113115.471758 | +| Fory | deserialize | 1000 | array | PRIMITIVE_ARRAY | 205671.992736 | +| Fory | deserialize | 1000 | array | BUFFER | 2831942.848999 | +| Fory | deserialize | 1000 | directBuffer | PRIMITIVE_ARRAY | 202475.242341 | +| Fory | deserialize | 1000 | directBuffer | BUFFER | 3397690.327371 | +| Fory | deserialize | 5000 | array | PRIMITIVE_ARRAY | 40312.590172 | +| Fory | deserialize | 5000 | array | BUFFER | 3296658.120035 | +| Fory | deserialize | 5000 | directBuffer | PRIMITIVE_ARRAY | 40413.743717 | +| Fory | deserialize | 5000 | directBuffer | BUFFER | 3284441.570594 | +| Fory | serialize | 200 | array | PRIMITIVE_ARRAY | 8297232.942927 | +| Fory | serialize | 200 | array | BUFFER | 5123572.914045 | +| Fory | serialize | 200 | directBuffer | PRIMITIVE_ARRAY | 8335248.350301 | +| Fory | serialize | 200 | directBuffer | BUFFER | 5400346.890126 | +| Fory | serialize | 1000 | array | PRIMITIVE_ARRAY | 8772856.921028 | +| Fory | serialize | 1000 | array | BUFFER | 4979590.929127 | +| Fory | serialize | 1000 | directBuffer | PRIMITIVE_ARRAY | 8207563.785251 | +| Fory | serialize | 1000 | directBuffer | BUFFER | 5376191.775007 | +| Fory | serialize | 5000 | array | PRIMITIVE_ARRAY | 8027439.580246 | +| Fory | serialize | 5000 | array | BUFFER | 5018916.32477 | +| Fory | serialize | 5000 | directBuffer | PRIMITIVE_ARRAY | 7695981.988316 | +| Fory | serialize | 5000 | directBuffer | BUFFER | 5330897.68296 | +| Kryo | deserialize | 200 | array | PRIMITIVE_ARRAY | 146675.360652 | +| Kryo | deserialize | 200 | array | BUFFER | 1296284.78772 | +| Kryo | deserialize | 200 | directBuffer | PRIMITIVE_ARRAY | 518713.299424 | +| Kryo | deserialize | 200 | directBuffer | BUFFER | 1004844.498712 | +| Kryo | deserialize | 1000 | array | PRIMITIVE_ARRAY | 30409.835023 | +| Kryo | deserialize | 1000 | array | BUFFER | 721266.54113 | +| Kryo | deserialize | 1000 | directBuffer | PRIMITIVE_ARRAY | 112132.004609 | +| Kryo | deserialize | 1000 | directBuffer | BUFFER | 592972.713203 | +| Kryo | deserialize | 5000 | array | PRIMITIVE_ARRAY | 6124.351248 | +| Kryo | deserialize | 5000 | array | BUFFER | 147251.846111 | +| Kryo | deserialize | 5000 | directBuffer | PRIMITIVE_ARRAY | 21826.04041 | +| Kryo | deserialize | 5000 | directBuffer | BUFFER | 148614.476829 | +| Kryo | serialize | 200 | array | PRIMITIVE_ARRAY | 147342.606262 | +| Kryo | serialize | 200 | array | BUFFER | 1985187.977633 | +| Kryo | serialize | 200 | directBuffer | PRIMITIVE_ARRAY | 972683.763633 | +| Kryo | serialize | 200 | directBuffer | BUFFER | 1739454.51977 | +| Kryo | serialize | 1000 | array | PRIMITIVE_ARRAY | 31395.721514 | +| Kryo | serialize | 1000 | array | BUFFER | 1616159.67123 | +| Kryo | serialize | 1000 | directBuffer | PRIMITIVE_ARRAY | 209183.090868 | +| Kryo | serialize | 1000 | directBuffer | BUFFER | 1377272.56851 | +| Kryo | serialize | 5000 | array | PRIMITIVE_ARRAY | 6248.006967 | +| Kryo | serialize | 5000 | array | BUFFER | 711287.533377 | +| Kryo | serialize | 5000 | directBuffer | PRIMITIVE_ARRAY | 43565.678616 | +| Kryo | serialize | 5000 | directBuffer | BUFFER | 707092.956534 | diff --git a/docs/cpp_debug.md b/docs/cpp_debug.md index c565da62af..f288d28b8c 100644 --- a/docs/cpp_debug.md +++ b/docs/cpp_debug.md @@ -40,4 +40,4 @@ java/python debugging. - If debugging doesn't work, please select correct debug/run options: select correct debug/run options - Debug will jump to source files in bazel generated directory, we need to return raw files in source tree -for debugging again: jump to generated files + for debugging again: jump to generated files diff --git a/docs/guide/graalvm_guide.md b/docs/guide/graalvm_guide.md index 59fead716b..faae421d1d 100644 --- a/docs/guide/graalvm_guide.md +++ b/docs/guide/graalvm_guide.md @@ -29,7 +29,7 @@ Fory runs on GraalVM native image pretty well. Fory generates all serializer cod any extra cost, the performance is great. In order to use Fory on graalvm native image, you must create Fory as an **static** field of a class, and **register** all classes at - the enclosing class initialize time. Then configure `native-image.properties` under +the enclosing class initialize time. Then configure `native-image.properties` under `resources/META-INF/native-image/$xxx/native-image.propertie` to tell graalvm to init the class at native image build time. For example, here we configure `org.apache.fory.graalvm.Example` class be init at build time: diff --git a/docs/guide/java_serialization_guide.md b/docs/guide/java_serialization_guide.md index 728b5f1c93..df142ceba2 100644 --- a/docs/guide/java_serialization_guide.md +++ b/docs/guide/java_serialization_guide.md @@ -19,8 +19,6 @@ license: | limitations under the License. --- -## Java object graph serialization - When only java object serialization needed, this mode will have better performance compared to cross-language object graph serialization. @@ -213,7 +211,7 @@ class metadata. To further reduce metadata costs, Fory introduces a class metadata sharing mechanism, which allows the metadata to be sent to the deserialization process only once. For more details, please refer to the [Meta Sharing](https://fory.apache.org/docs/specification/fory_java_serialization_spec#meta-share) specification. -### Smaller size +### Compression `ForyBuilder#withIntCompressed`/`ForyBuilder#withLongCompressed` can be used to compress int/long for smaller size. Normally compress int is enough. @@ -1097,6 +1095,8 @@ Note that when implementing custom map or collection serializers: 3. Properly handle reference tracking if needed 4. Implement proper size management using `setNumElements` and `getAndClearNumElements` when `supportCodegenHook` is `true` +Besides registering serializes, one can also implement `java.io.Externalizable` for a class to customize serialization logic, such type will be serialized by fory `ExternalizableSerializer`. + ### Security & Class Registration `ForyBuilder#requireClassRegistration` can be used to disable class registration, this will allow to deserialize objects @@ -1162,12 +1162,6 @@ If there are no duplicate name for type, `namespace` can be left as empty to red **Do not use this API to register class since it will increase serialized size a lot compared to register class by id** -### Serializer Registration - -You can also register a custom serializer for a class by `Fory#registerSerializer` API. - -Or implement `java.io.Externalizable` for a class. - ### Zero-Copy Serialization ```java @@ -1250,17 +1244,17 @@ losing any information. If metadata sharing is not enabled, the new class data will be skipped and an `NonexistentSkipClass` stub object will be returned. -### Coping/Mapping object from one type to another type +### Copy/Map object from one type to another type Fory support mapping object from one type to another type. > Notes: > > 1. This mapping will execute a deep copy, all mapped fields are serialized into binary and -> deserialized from that binary to map into another type. +> deserialized from that binary to map into another type. > 2. All struct types must be registered with same ID, otherwise Fory can not mapping to correct struct type. -> Be careful when you use `Fory#register(Class)`, because fory will allocate an auto-grown ID which might be -> inconsistent if you register classes with different order between Fory instance. +> Be careful when you use `Fory#register(Class)`, because fory will allocate an auto-grown ID which might be +> inconsistent if you register classes with different order between Fory instance. ```java public class StructMappingExample { diff --git a/docs/guide/row_format_guide.md b/docs/guide/row_format_guide.md index f48ee5c2a0..a2beeabe30 100644 --- a/docs/guide/row_format_guide.md +++ b/docs/guide/row_format_guide.md @@ -19,9 +19,7 @@ license: | limitations under the License. --- -## Row format protocol - -### Java +## Java ```java public class Bar { @@ -68,7 +66,7 @@ Bar newBar = barEncoder.fromRow(barStruct); Bar newBar2 = barEncoder.fromRow(binaryArray4.getStruct(20)); ``` -### Python +## Python ```python @dataclass @@ -116,13 +114,13 @@ for (int i = 0; i < 10; i++) { return arrowWriter.finishAsRecordBatch(); ``` -### Support for Interface and Extension Types +## Support for Interface and Extension Types Fury now supports row format mapping for Java `interface` types and subclassed (`extends`) types, enabling more dynamic and flexible data schemas. These enhancements were introduced in [#2243](https://github.com/apache/fury/pull/2243), [#2250](https://github.com/apache/fury/pull/2250), and [#2256](https://github.com/apache/fury/pull/2256). -#### Example: Interface Mapping with RowEncoder +### Example: Interface Mapping with RowEncoder ```java public interface Animal { @@ -148,7 +146,7 @@ System.out.println(decoded.speak()); // Woof ``` -#### Example: Extension Type with RowEncoder +### Example: Extension Type with RowEncoder ```java public class Parent { diff --git a/docs/guide/xlang_serialization_guide.md b/docs/guide/xlang_serialization_guide.md index 829b04f527..cb21f1f268 100644 --- a/docs/guide/xlang_serialization_guide.md +++ b/docs/guide/xlang_serialization_guide.md @@ -19,9 +19,7 @@ license: | limitations under the License. --- -## Cross-language object graph serialization - -### Serialize built-in types +## Serialize built-in types Common types can be serialized automatically: primitive numeric types, string, binary, array, list, map and so on. @@ -111,17 +109,17 @@ func main() { **JavaScript** ```javascript -import Fory from '@foryjs/fory'; +import Fory from "@foryjs/fory"; /** * @foryjs/hps use v8's fast-calls-api that can be called directly by jit, ensure that the version of Node is 20 or above. * Experimental feature, installation success cannot be guaranteed at this moment * If you are unable to install the module, replace it with `const hps = null;` **/ -import hps from '@foryjs/hps'; +import hps from "@foryjs/hps"; const fory = new Fory({ hps }); -const input = fory.serialize('hello fory'); +const input = fory.serialize("hello fory"); const result = fory.deserialize(input); console.log(result); ``` @@ -140,7 +138,7 @@ fn run() { } ``` -### Serialize custom types +## Serialize custom types Serializing user-defined types needs registering the custom type using the register API to establish the mapping relationship between the type in different languages. @@ -330,22 +328,22 @@ func main() { **JavaScript** ```javascript -import Fory, { Type, InternalSerializerType } from '@foryjs/fory'; +import Fory, { Type, InternalSerializerType } from "@foryjs/fory"; /** * @foryjs/hps use v8's fast-calls-api that can be called directly by jit, ensure that the version of Node is 20 or above. * Experimental feature, installation success cannot be guaranteed at this moment * If you are unable to install the module, replace it with `const hps = null;` **/ -import hps from '@foryjs/hps'; +import hps from "@foryjs/hps"; // Now we describe data structures using JSON, but in the future, we will use more ways. -const description = Type.object('example.foo', { +const description = Type.object("example.foo", { foo: Type.string(), }); const fory = new Fory({ hps }); const { serialize, deserialize } = fory.registerSerializer(description); -const input = serialize({ foo: 'hello fory' }); +const input = serialize({ foo: "hello fory" }); const result = deserialize(input); console.log(result); ``` @@ -409,7 +407,7 @@ fn complex_struct() { } ``` -### Serialize Shared Reference and Circular Reference +## Serialize Shared Reference and Circular Reference Shared reference and circular reference can be serialized automatically, no duplicate data or recursion error. @@ -531,7 +529,7 @@ console.log(result.bar.foo === result.foo); **JavaScript** Reference cannot be implemented because of rust ownership restrictions -### Zero-Copy Serialization +## Zero-Copy Serialization **Java** diff --git a/docs/guide/xlang_type_mapping.md b/docs/guide/xlang_type_mapping.md index 72781347b4..754c5ed7ff 100644 --- a/docs/guide/xlang_type_mapping.md +++ b/docs/guide/xlang_type_mapping.md @@ -28,7 +28,7 @@ Note: ## Type Mapping | Fory Type | Fory Type ID | Java | Python | Javascript | C++ | Golang | Rust | -|-------------------------|--------------|-----------------|-----------------------------------|-----------------|--------------------------------|------------------|------------------| +| ----------------------- | ------------ | --------------- | --------------------------------- | --------------- | ------------------------------ | ---------------- | ---------------- | | bool | 1 | bool/Boolean | bool | Boolean | bool | bool | bool | | int8 | 2 | byte/Byte | int/pyfory.Int8 | Type.int8() | int8_t | int8 | i8 | | int16 | 3 | short/Short | int/pyfory.Int16 | Type.int16() | int16_t | int16 | i6 | @@ -58,7 +58,7 @@ Note: | decimal | 27 | BigDecimal | Decimal | bigint | / | / | / | | binary | 28 | byte[] | bytes | / | `uint8_t[n]/vector` | `[n]uint8/[]T` | `Vec` | | array | 29 | array | np.ndarray | / | / | array/slice | Vec | -| bool_array | 30 | bool[] | ndarray(np.bool_) | / | `bool[n]` | `[n]bool/[]T` | `Vec` | +| bool_array | 30 | bool[] | ndarray(np.bool\_) | / | `bool[n]` | `[n]bool/[]T` | `Vec` | | int8_array | 31 | byte[] | ndarray(int8) | / | `int8_t[n]/vector` | `[n]int8/[]T` | `Vec` | | int16_array | 32 | short[] | ndarray(int16) | / | `int16_t[n]/vector` | `[n]int16/[]T` | `Vec` | | int32_array | 33 | int[] | ndarray(int32) | / | `int32_t[n]/vector` | `[n]int32/[]T` | `Vec` | @@ -92,21 +92,21 @@ Here is en example: - Java: - ```java - class Foo { - @Int32Type(varint = true) - int f1; - List<@Int32Type(varint = true) Integer> f2; - } - ``` + ```java + class Foo { + @Int32Type(varint = true) + int f1; + List<@Int32Type(varint = true) Integer> f2; + } + ``` - Python: - ```python - class Foo: - f1: Int32Type(varint=True) - f2: List[Int32Type(varint=True)] - ``` + ```python + class Foo: + f1: Int32Type(varint=True) + f2: List[Int32Type(varint=True)] + ``` ## Type wrapper diff --git a/docs/specification/java_serialization_spec.md b/docs/specification/java_serialization_spec.md index 469300bb37..3a8d4bbe56 100644 --- a/docs/specification/java_serialization_spec.md +++ b/docs/specification/java_serialization_spec.md @@ -66,7 +66,7 @@ corresponding flags and maintaining internal state. Reference flags: | Flag | Byte Value | Description | -|---------------------|------------|---------------------------------------------------------------------------------------------------------------------------------------------------------| +| ------------------- | ---------- | ------------------------------------------------------------------------------------------------------------------------------------------------------- | | NULL FLAG | `-3` | This flag indicates the object is a null value. We don't use another byte to indicate REF, so that we can save one byte. | | REF FLAG | `-2` | This flag indicates the object is already serialized previously, and fory will write a ref id with unsigned varint format instead of serialize it again | | NOT_NULL VALUE FLAG | `-1` | This flag indicates the object is a non-null value and fory doesn't track ref for this type of object. | @@ -92,15 +92,15 @@ If schema consistent mode is enabled globally or enabled for current class, clas - If class is not registered: - If class is not an array, fory will write one byte `0bxxxxxxx1` first, then write class name. - The first little bit is `1`, which is different from first bit `0` of - encoded class id. Fory can use this information to determine whether to read class by class id for - deserialization. + encoded class id. Fory can use this information to determine whether to read class by class id for + deserialization. - If class is not registered and class is an array, fory will write one byte `dimensions << 1 | 1` first, then write - component - class subsequently. This can reduce array class name cost if component class is or will be serialized. + component + class subsequently. This can reduce array class name cost if component class is or will be serialized. - Class will be written as two enumerated fory unsigned by default: `package name` and `class name`. If meta share - mode is - enabled, - class will be written as an unsigned varint which points to index in `MetaContext`. + mode is + enabled, + class will be written as an unsigned varint which points to index in `MetaContext`. ### Schema evolution @@ -162,45 +162,45 @@ Meta header is a 64 bits number value encoded in little endian order. - num fields: encode `num fields << 1 | register flag(1 when class registered)` as unsigned varint. - If class is registered, then an unsigned varint class id will be written next, package and class name will be - omitted. + omitted. - If current class is schema consistent, then num field will be `0` to flag it. - If current class isn't schema consistent, then num field will be the number of compatible fields. For example, - users - can use tag id to mark some field as compatible field in schema consistent context. In such cases, schema - consistent - fields will be serialized first, then compatible fields will be serialized next. At deserialization, Fory will use - fields info of those fields which aren't annotated by tag id for deserializing schema consistent fields, then use - fields info in meta for deserializing compatible fields. + users + can use tag id to mark some field as compatible field in schema consistent context. In such cases, schema + consistent + fields will be serialized first, then compatible fields will be serialized next. At deserialization, Fory will use + fields info of those fields which aren't annotated by tag id for deserializing schema consistent fields, then use + fields info in meta for deserializing compatible fields. - Package name encoding(omitted when class is registered): - encoding algorithm: `UTF8/ALL_TO_LOWER_SPECIAL/LOWER_UPPER_DIGIT_SPECIAL` - - Header: `6 bits size | 2 bits encoding flags`. The `6 bits size: 0~63` will be used to indicate size `0~63`, - the value `63` the size need more byte to read, the encoding will encode `size - 63` as a varint next. + - Header: `6 bits size | 2 bits encoding flags`. The `6 bits size: 0~63` will be used to indicate size `0~63`, + the value `63` the size need more byte to read, the encoding will encode `size - 63` as a varint next. - Class name encoding(omitted when class is registered): - encoding algorithm: `UTF8/LOWER_UPPER_DIGIT_SPECIAL/FIRST_TO_LOWER_SPECIAL/ALL_TO_LOWER_SPECIAL` - - header: `6 bits size | 2 bits encoding flags`. The `6 bits size: 0~63` will be used to indicate size `0~63`, - the value `63` the size need more byte to read, the encoding will encode `size - 63` as a varint next. + - header: `6 bits size | 2 bits encoding flags`. The `6 bits size: 0~63` will be used to indicate size `0~63`, + the value `63` the size need more byte to read, the encoding will encode `size - 63` as a varint next. - Field info: - header(8 - bits): `3 bits size + 2 bits field name encoding + polymorphism flag + nullability flag + ref tracking flag`. - Users can use annotation to provide those info. + bits): `3 bits size + 2 bits field name encoding + polymorphism flag + nullability flag + ref tracking flag`. + Users can use annotation to provide those info. - 2 bits field name encoding: - encoding: `UTF8/ALL_TO_LOWER_SPECIAL/LOWER_UPPER_DIGIT_SPECIAL/TAG_ID` - If tag id is used, i.e. field name is written by an unsigned varint tag id. 2 bits encoding will be `11`. - size of field name: - - The `3 bits size: 0~7` will be used to indicate length `1~7`, the value `6` the size read more bytes, - the encoding will encode `size - 7` as a varint next. + - The `3 bits size: 0~7` will be used to indicate length `1~7`, the value `6` the size read more bytes, + the encoding will encode `size - 7` as a varint next. - If encoding is `TAG_ID`, then num_bytes of field name will be used to store tag id. - ref tracking: when set to 1, ref tracking will be enabled for this field. - nullability: when set to 1, this field can be null. - polymorphism: when set to 1, the actual type of field will be the declared field type even the type if - not `final`. + not `final`. - type id: - For registered type-consistent classes, it will be the registered class id. - Otherwise it will be encoded as `OBJECT_ID` if it isn't `final` and `FINAL_OBJECT_ID` if it's `final`. The - meta for such types is written separately instead of inlining here is to reduce meta space cost if object of - this type is serialized in current object graph multiple times, and the field value may be null too. + meta for such types is written separately instead of inlining here is to reduce meta space cost if object of + this type is serialized in current object graph multiple times, and the field value may be null too. - Field name: If type id is set, type id will be used instead. Otherwise meta string encoding length and data will - be written instead. + be written instead. Field order are left as implementation details, which is not exposed to specification, the deserialization need to resort fields based on Fory field comparator. In this way, fory can compute statistics for field names or types and @@ -215,9 +215,9 @@ Same encoding algorithm as the previous layer except: - If package name has been written before: `varint index + sharing flag(set)` will be written - If package name hasn't been written before: - If meta string encoding is `LOWER_SPECIAL` and the length of encoded string `<=` 64, then header will be - `6 bits size + encoding flag(set) + sharing flag(unset)`. + `6 bits size + encoding flag(set) + sharing flag(unset)`. - Otherwise, header will - be `3 bits unset + 3 bits encoding flags + encoding flag(unset) + sharing flag(unset)` + be `3 bits unset + 3 bits encoding flags + encoding flag(unset) + sharing flag(unset)` ## Meta String @@ -227,16 +227,16 @@ Meta string is mainly used to encode meta strings such as class name and field n String binary encoding algorithm: -| Algorithm | Pattern | Description | -|---------------------------|---------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| -| LOWER_SPECIAL | `a-z._$\|` | every char is written using 5 bits, `a-z`: `0b00000~0b11001`, `._$\|`: `0b11010~0b11101`, prepend one bit at the start to indicate whether strip last char since last byte may have 7 redundant bits(1 indicates strip last char) | -| LOWER_UPPER_DIGIT_SPECIAL | `a-zA-Z0~9._` | every char is written using 6 bits, `a-z`: `0b00000~0b11001`, `A-Z`: `0b11010~0b110011`, `0~9`: `0b110100~0b111101`, `._`: `0b111110~0b111111`, prepend one bit at the start to indicate whether strip last char since last byte may have 7 redundant bits(1 indicates strip last char) | -| UTF-8 | any chars | UTF-8 encoding | +| Algorithm | Pattern | Description | +| ------------------------- | ------------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | +| LOWER_SPECIAL | `a-z._$\|` | every char is written using 5 bits, `a-z`: `0b00000~0b11001`, `._$\|`: `0b11010~0b11101`, prepend one bit at the start to indicate whether strip last char since last byte may have 7 redundant bits(1 indicates strip last char) | +| LOWER_UPPER_DIGIT_SPECIAL | `a-zA-Z0~9._` | every char is written using 6 bits, `a-z`: `0b00000~0b11001`, `A-Z`: `0b11010~0b110011`, `0~9`: `0b110100~0b111101`, `._`: `0b111110~0b111111`, prepend one bit at the start to indicate whether strip last char since last byte may have 7 redundant bits(1 indicates strip last char) | +| UTF-8 | any chars | UTF-8 encoding | Encoding flags: | Encoding Flag | Pattern | Encoding Algorithm | -|---------------------------|---------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------| +| ------------------------- | ------------------------------------------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------- | | LOWER_SPECIAL | every char is in `a-z._$\|` | `LOWER_SPECIAL` | | FIRST_TO_LOWER_SPECIAL | every char is in `a-z[c1,c2]` except first char is upper case | replace first upper case char to lower case, then use `LOWER_SPECIAL` | | ALL_TO_LOWER_SPECIAL | every char is in `a-zA-Z[c1,c2]` | replace every upper case char by `\|` + `lower case`, then use `LOWER_SPECIAL`, use this encoding if it's smaller than Encoding `LOWER_UPPER_DIGIT_SPECIAL` | @@ -324,7 +324,7 @@ If string has been written before, the data will be written as follows: - size: 1~9 byte - Fory PVL(Progressive Variable-length Long) Encoding: - positive long format: first bit in every byte indicates whether to have the next byte. If first bit is set - i.e. `b & 0x80 == 0x80`, then the next byte should be read until the first bit is unset. + i.e. `b & 0x80 == 0x80`, then the next byte should be read until the first bit is unset. #### Signed long @@ -334,7 +334,7 @@ If string has been written before, the data will be written as follows: - Otherwise write as 9 bytes: `| 0b1 | little-endian 8 bytes long |` - Fory PVL(Progressive Variable-length Long) Encoding: - First convert the number into positive unsigned long by `(v << 1) ^ (v >> 63)` ZigZag algorithm to reduce cost of - small negative numbers, then encoding it as an unsigned long. + small negative numbers, then encoding it as an unsigned long. #### Float diff --git a/docs/specification/xlang_serialization_spec.md b/docs/specification/xlang_serialization_spec.md index aeaa0f8d68..debfaf926b 100644 --- a/docs/specification/xlang_serialization_spec.md +++ b/docs/specification/xlang_serialization_spec.md @@ -191,7 +191,7 @@ corresponding flags and maintaining internal state. Reference flags: | Flag | Byte Value | Description | -|---------------------|------------|---------------------------------------------------------------------------------------------------------------------------------------------------------| +| ------------------- | ---------- | ------------------------------------------------------------------------------------------------------------------------------------------------------- | | NULL FLAG | `-3` | This flag indicates the object is a null value. We don't use another byte to indicate REF, so that we can save one byte. | | REF FLAG | `-2` | This flag indicates the object is already serialized previously, and fory will write a ref id with unsigned varint format instead of serialize it again | | NOT_NULL VALUE FLAG | `-1` | This flag indicates the object is a non-null value and fory doesn't track ref for this type of object. | @@ -243,7 +243,7 @@ differently. - If schema evolution mode is enabled globally when creating fory, and current class is configured to use schema consistent mode like `struct` vs `table` in flatbuffers: - Type meta will be add to `captured_type_defs`: `captured_type_defs[type def stub] = map size` ahead when - registering type. + registering type. - Get index of the meta in `captured_type_defs`, write that index as `| unsigned varint: index |`. ### Struct Schema evolution @@ -252,10 +252,12 @@ If schema evolution mode is enabled globally when creating fory, and enabled for using one of the following mode. Which mode to use is configured when creating fory. - Normal mode(meta share not enabled): + - If type meta hasn't been written before, add `type def` - to `captured_type_defs`: `captured_type_defs[type def] = map size`. + to `captured_type_defs`: `captured_type_defs[type def] = map size`. - Get index of the meta in `captured_type_defs`, write that index as `| unsigned varint: index |`. - After finished the serialization of the object graph, fory will start to write `captured_type_defs`: + - Firstly, set current to `meta start offset` of fory header - Then write `captured_type_defs` one by one: @@ -270,31 +272,33 @@ using one of the following mode. Which mode to use is configured when creating f - Meta share mode: the writing steps are same as the normal mode, but `captured_type_defs` will be shared across multiple serializations of different objects. For example, suppose we have a batch to serialize: - ```python - captured_type_defs = {} - stream = ... - # add `Type1` to `captured_type_defs` and write `Type1` - fory.serialize(stream, [Type1()]) - # add `Type2` to `captured_type_defs` and write `Type2`, `Type1` is written before. - fory.serialize(stream, [Type1(), Type2()]) - # `Type1` and `Type2` are written before, no need to write meta. - fory.serialize(stream, [Type1(), Type2()]) - ``` + ```python + captured_type_defs = {} + stream = ... + # add `Type1` to `captured_type_defs` and write `Type1` + fory.serialize(stream, [Type1()]) + # add `Type2` to `captured_type_defs` and write `Type2`, `Type1` is written before. + fory.serialize(stream, [Type1(), Type2()]) + # `Type1` and `Type2` are written before, no need to write meta. + fory.serialize(stream, [Type1(), Type2()]) + ``` - Streaming mode(streaming mode doesn't support meta share): + - If type meta hasn't been written before, the data will be written as: - ``` - | unsigned varint: 0b11111111 | type def | - ``` + ``` + | unsigned varint: 0b11111111 | type def | + ``` - If type meta has been written before, the data will be written as: - ``` - | unsigned varint: written index << 1 | - ``` + ``` + | unsigned varint: written index << 1 | + ``` + + `written index` is the id in `captured_type_defs`. - `written index` is the id in `captured_type_defs`. - With this mode, `meta start offset` can be omitted. > The normal mode and meta share mode will forbid streaming writing since it needs to look back for update the start @@ -365,8 +369,8 @@ Detailed spec: - encoding: `UTF8/ALL_TO_LOWER_SPECIAL/LOWER_UPPER_DIGIT_SPECIAL/TAG_ID` - If tag id is used, field name will be written by an unsigned varint tag id, and 2 bits encoding will be `11`. - size of field name: - - The `4 bits size: 0~14` will be used to indicate length `1~15`, the value `15` indicates to read more bytes, - the encoding will encode `size - 15` as a varint next. + - The `4 bits size: 0~14` will be used to indicate length `1~15`, the value `15` indicates to read more bytes, + the encoding will encode `size - 15` as a varint next. - If encoding is `TAG_ID`, then num_bytes of field name will be used to store tag id. - ref tracking: when set to 1, ref tracking will be enabled for this field. - nullability: when set to 1, this field can be null. @@ -411,7 +415,7 @@ List/Set/Map nested type spec: ###### Field Name -If tag id is set, tag id will be used instead. Otherwise meta string of field name will be written instead. +If tag id is set, tag id will be used instead. Otherwise meta string of field name will be written instead. ###### Field order @@ -468,16 +472,16 @@ Meta string is mainly used to encode meta strings such as field names. String binary encoding algorithm: -| Algorithm | Pattern | Description | -|---------------------------|---------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| -| LOWER_SPECIAL | `a-z._$\|` | every char is written using 5 bits, `a-z`: `0b00000~0b11001`, `._$\|`: `0b11010~0b11101`, prepend one bit at the start to indicate whether strip last char since last byte may have 7 redundant bits(1 indicates strip last char) | -| LOWER_UPPER_DIGIT_SPECIAL | `a-zA-Z0~9._` | every char is written using 6 bits, `a-z`: `0b00000~0b11001`, `A-Z`: `0b11010~0b110011`, `0~9`: `0b110100~0b111101`, `._`: `0b111110~0b111111`, prepend one bit at the start to indicate whether strip last char since last byte may have 7 redundant bits(1 indicates strip last char) | -| UTF-8 | any chars | UTF-8 encoding | +| Algorithm | Pattern | Description | +| ------------------------- | ------------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | +| LOWER_SPECIAL | `a-z._$\|` | every char is written using 5 bits, `a-z`: `0b00000~0b11001`, `._$\|`: `0b11010~0b11101`, prepend one bit at the start to indicate whether strip last char since last byte may have 7 redundant bits(1 indicates strip last char) | +| LOWER_UPPER_DIGIT_SPECIAL | `a-zA-Z0~9._` | every char is written using 6 bits, `a-z`: `0b00000~0b11001`, `A-Z`: `0b11010~0b110011`, `0~9`: `0b110100~0b111101`, `._`: `0b111110~0b111111`, prepend one bit at the start to indicate whether strip last char since last byte may have 7 redundant bits(1 indicates strip last char) | +| UTF-8 | any chars | UTF-8 encoding | Encoding flags: | Encoding Flag | Pattern | Encoding Algorithm | -|---------------------------|----------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------| +| ------------------------- | -------------------------------------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------- | | LOWER_SPECIAL | every char is in `a-z._\|` | `LOWER_SPECIAL` | | FIRST_TO_LOWER_SPECIAL | every char is in `a-z._` except first char is upper case | replace first upper case char to lower case, then use `LOWER_SPECIAL` | | ALL_TO_LOWER_SPECIAL | every char is in `a-zA-Z._` | replace every upper case char by `\|` + `lower case`, then use `LOWER_SPECIAL`, use this encoding if it's smaller than Encoding `LOWER_UPPER_DIGIT_SPECIAL` | @@ -546,7 +550,7 @@ Notes: - Otherwise write as 9 bytes: `| 0b1 | little-endian 8 bytes long |` - Fory PVL(Progressive Variable-length Long) Encoding: - positive long format: first bit in every byte indicates whether to have the next byte. If first bit is set - i.e. `b & 0x80 == 0x80`, then the next byte should be read until the first bit is unset. + i.e. `b & 0x80 == 0x80`, then the next byte should be read until the first bit is unset. #### signed int64 @@ -561,7 +565,7 @@ Notes: - Otherwise write as 9 bytes: `| 0b1 | little-endian 8 bytes long |` - Fory PVL(Progressive Variable-length Long) Encoding: - First convert the number into positive unsigned long by `(v << 1) ^ (v >> 63)` ZigZag algorithm to reduce cost of - small negative numbers, then encoding it as an unsigned long. + small negative numbers, then encoding it as an unsigned long. #### float32