-
Notifications
You must be signed in to change notification settings - Fork 11
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
f33c1e1
commit ac100fc
Showing
3 changed files
with
23 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
# Design Notes | ||
|
19 changes: 19 additions & 0 deletions
19
social-registry/developer-zone/design-notes/data-sharing.md
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,19 @@ | ||
--- | ||
description: Discussion | ||
--- | ||
|
||
# Data Sharing | ||
|
||
Today, SR offers an API-based data sharing mechanism. Alternate data-sharing mechanisms are being considered for large-volume data sharing across networks. | ||
|
||
While Kafka can be used for data sharing it has the following limitations: | ||
|
||
* It recreates partitions if the the TCP connection drops (explain) | ||
* Accessing Kafka across networks on the Internet is a challenge as it does not run on standard ports like 80,443. This makes it hard to make it work across systems as firewall rules prevent access to non-standard ports. | ||
|
||
So Kafka is a great option for sharing data within a network, or data center but not for sharing data across data centers. | ||
|
||
Another option is to consider the WebSub system used by MOSIP. The consumers of WebSub connect to the same via HTTP. WebSub is being used for sharing ID data for printing of ID cards. | ||
|
||
In OpenG2P we are considering similar system for sharing registry data for printing of social ID cards. | ||
|