update performance doc: add different encryption schema comparison

Signed-off-by: mgqa34 <[email protected]>
FederatedAI · Mar 1, 2024 · 7a945d0 · 7a945d0
1 parent 629bd84
commit 7a945d0
Show file tree

Hide file tree

Showing 2 changed files with 17 additions and 5 deletions.
diff --git a/...ate/performance/peformance_comparision.md → ...ate/performance/performance_comparison.md b/...ate/performance/peformance_comparision.md → ...ate/performance/performance_comparison.md
diff --git a/doc/2.0/fate/performance/performance_multi_engines.md b/doc/2.0/fate/performance/performance_multi_engines.md
@@ -15,10 +15,22 @@ Testing configuration:
     * guest site: 10w * 30 dimensions, host size: 10w * 300 dimensions
 * Job Configuration:
   * computing_partitions: 16 
-
+  
 | Algorithm               | EggRoll      | Spark-Local | Standalone  |                 
 | ------------------------| -------------| ------------| ------------|
-| PSI                     | 7m43s        | 7m28s       | 11m57s      |    
-| Hetero-SSHE-LR          | 5m17s/epoch  | 6m4s/epoch  | 5m41s/epoch | 
-| Hetero-Coordinated-LR   | 2m22s/epoch  | 2m21s/epoch | 2m22s/epoch | 
-| Hetero-SecureBoost      | 2m11s/epoch  | 3m41s/epoch | 2m15s/epoch | 
+| PSI                     | 7m43s        | 7m28s       | 7m10s       |    
+| Hetero-SSHE-LR          | 5m17s/epoch  | 6m4s/epoch  | 5m34s/epoch | 
+| Hetero-Coordinated-LR   | 2m22s/epoch  | 2m21s/epoch | 2m19s/epoch | 
+| Hetero-SecureBoost      | 2m11s/epoch  | 3m41s/epoch | 1m54s/tree  | 
+
+
+Base on the same testing configuration，we have also tested on different encryption schemas.
+* algorithm parameters:
+  * he_params: tested on `he_param(kind="paillier")` and `he_param(kind="mock")`, mock stands for plaintext. 
+* other configurations: same with `Testing configuration` list above
+
+| Algorithm               | EggRoll(Paillier) | EggRoll(Mock) | Spark-Local(Paillier) | Spark-Local(Mock) | Standalone(Paillier)  | Standalone(Mock) |                
+| ------------------------| ------------------| ------------- | --------------------- | ----------------- | --------------------- | ---------------- |
+| Hetero-Coordinated-LR   | 2m22s/epoch       | 19s/epoch     | 2m21s/epoch           | 20s/epoch         | 2m19s/epoch           | 19s/epoch        |
+| Hetero-SecureBoost      | 2m11s/epoch       | 1m36s/epoch   | 3m41s/epoch           | 2m57s/epoch       | 1m54s/epoch           | 1m17s/epoch      |
+