Skip to content

Commit

Permalink
Merge pull request #5518 from FederatedAI/feature-2.1.0-update_dag_doc
Browse files Browse the repository at this point in the history 
fix performance doc
  • Loading branch information
@mgqa34
mgqa34 authored Mar 1, 2024
2 parents a733743 + 7a945d0 commit 2d282d8
Show file tree
Hide file tree
Showing 2 changed files with 21 additions and 11 deletions.
0 ...ate/performance/peformance_comparision.md → ...ate/performance/performance_comparison.md
View file
File renamed without changes.
32 changes: 21 additions & 11 deletions doc/2.0/fate/performance/performance_multi_engines.md
View file
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
## Performance
This document mainly introduces the performance of main algorithm in FATE-v2.0 running of different computing engines
This document mainly introduces the performance of main algorithms in FATE-v2.0 running on different computing engines

Testing configuration:
* 2 hosts with same machine configuration
Expand All @@ -10,17 +10,27 @@ Testing configuration:
* Network: Lan, 1Gb
* use 16 cores on each host
* Dataset:
* PSI-10M: PSI algorithm, input data is 10 million, result size is 10 million
* PSI-100M: PSI algorithm, input data is 100 million, result size is 100 million
* PSI: PSI algorithm, input data is 10 million, result size is 10 million
* Other Algorithms:
* guest site: 10w * 30 dimensions, host size: 10w * 300 dimensions
* Job Configuration:
* computing_partitions: Kp represents `computing_partitions` is K
* computing_partitions: 16

| Algorithm | EggRoll | Spark-Local | Standalone |
| ------------------------| -------------| ------------| ------------|
| PSI | 7m43s | 7m28s | 7m10s |
| Hetero-SSHE-LR | 5m17s/epoch | 6m4s/epoch | 5m34s/epoch |
| Hetero-Coordinated-LR | 2m22s/epoch | 2m21s/epoch | 2m19s/epoch |
| Hetero-SecureBoost | 2m11s/epoch | 3m41s/epoch | 1m54s/tree |


Base on the same testing configuration，we have also tested on different encryption schemas.
* algorithm parameters:
* he_params: tested on `he_param(kind="paillier")` and `he_param(kind="mock")`, mock stands for plaintext.
* other configurations: same with `Testing configuration` list above

| Algorithm | EggRoll(Paillier) | EggRoll(Mock) | Spark-Local(Paillier) | Spark-Local(Mock) | Standalone(Paillier) | Standalone(Mock) |
| ------------------------| ------------------| ------------- | --------------------- | ----------------- | --------------------- | ---------------- |
| Hetero-Coordinated-LR | 2m22s/epoch | 19s/epoch | 2m21s/epoch | 20s/epoch | 2m19s/epoch | 19s/epoch |
| Hetero-SecureBoost | 2m11s/epoch | 1m36s/epoch | 3m41s/epoch | 2m57s/epoch | 1m54s/epoch | 1m17s/epoch |

| Algorithm | EggRoll-16p | EggRoll-32p | EggRoll-64p | Spark-Local-16p | Spark-Local-32p | Spark-Local-64p | Standalone-16p | Standalone-32p | Standalone-64p |
| ------------------------| -------------| ------------- | ------------ | -----------------| ---------------- | ---------------- | --------------- | --------------- | --------------- |
| PSI-10M | 7m43s | 8m13 | 7m56s | 7m28s | 7m13s | 8m10s | 11m57s | 11m57s | 11m47s |
| PSI-100M | | | | 62m | 69m | 75m | 71m | | |
| Hetero-SSHE-LR | 5m17s/epoch | 5m24s/epoch | 5m21s/epoch | 6m4s/epoch | 6m11s/epoch | 6m39s/epoch | 5m41s/epoch | 5m33s/epoch | 5m42s/epoch |
| Hetero-Coordinated-LR | 2m22s/epoch | 2m22s/epoch | 2m23s/epoch | 2m21s/epoch | 2m34s/epoch | 2m28s/epoch | 2m22s/epoch | 2m20s/epoch | 2m23s/epoch |
| Hetero-SecureBoost | 2m11s/epoch | 2m10s/epoch | 2m9s/epoch | 3m41s/epoch | 5m16s/epoch | 8m23s/epoch | 2m15s/epoch | 2m17s/epoch | 2m15s/tree |

0 comments on commit 2d282d8

Please sign in to comment.