Indexing content addressable and linked data

[gpestana]

P2P networks, the content addressable and linked data web can shift the processing responsibility to local peers. Instead of only relying on centralised search engines to crawl and index huge amounts of data and websites, peers can store data which is relevant to them locally and perform the crawling and indexing locally. The benefits are locallity - no need to rely on the network and centralized services to process and access their data -, personalization - peers can choose which startegies to apply on the data (e.g. which indexing algorithms).

Indexing and storing content locally is an interesting implication of the content addressable and linked web in that the indexes can also be content addressable and are 1st citizen data types. This means indexes of data have all the properties of the content addressable and linked data and can be further indexed. This can have major implications in the way we organize and find content online.

[gpestana]

Search engine thread on (IPFS)

Search the DHT based on content proximity (IPFS)

IPFS search

How-to automatically identify similar images using pHash