Distributed Systems

ID2201

peer-to-peer Johan Montelius

Distributed Systems ID2201

Ida
use resources in edge of net or! " computing " storage " communication

Distributed Systems ID2201

$omputing

Distributed Systems ID2201

seti&home
central ser'er " millions of clients " hundred of thousands acti'e super computer " hundreds of (era)*+,S " one of the largest computations performed continued in the -+I.$ pro/ect

Distributed Systems ID2201

)ile sharing

Distributed Systems ID2201

.apster
)irst large scale peer-to-peer file sharing system - 1222 3sed a central ser'er to store inde4 of all files5 $lients copied files peer-to-peer5

Distributed Systems ID2201

.apster
H E 5: I share #265763 A C B D 3: give me #265763 1: who has Madonna 2: try B, D, G...

Distributed Systems ID2201

.apster
$entral ser'er " !no s e'erything " needs to be ali'e " can easily be replicated )ile transfer " limited by client upload capacity ,roblems " copyright issues " hy share " is it the correct file
Distributed Systems ID2201
7

.e4t step

Distributed Systems ID2201

8a9aa

central server

super nodes

Distributed Systems ID2201

10

8a9aa
)ast(rac! :closed protocol; " super nodes< responsible for inde4ing " central ser'er< blac!list of super nodes " regular nodes< connects to local super node Integrity is chec!ed by hash function5 " not 'ery strong Money made on " ad'ertising " 555
Distributed Systems ID2201
11

(ime of the pirates

Distributed Systems ID2201

12

-it(orrent
search for torrents 1 torrents and description of content

find peers tracker, who wants to participate

3 share file

Distributed Systems ID2201

1#

-it(orrent
torrent " trac!ers to use " name of content " si9e and number of segments " hash codes of segments trac!er " pro'ides list of peers " could be helpful in suggesting net or! close peers
1%

Distributed Systems ID2201

-it(orrent
=uery peers to find ho has hat5 (it-for-tat " per file< not on total " if you don>t get something< hy share ?arest first " rare segments are 'aluable Multiple peers " change if connection is slo " cho!e if you don>t get anything bac!
Distributed Systems ID2201
10

Magnet lin!s and D@(

magnet:? xt=urn:btih:d2438d70a205566b2baf8eb45 4c1270237b1dbcf& dn=Rick+Astley+Never+Gonna+Give+You+U p.mp3& tr=udp%3A%2F%2Ftracker.ccc.de%3A80

Distributed Systems ID2201

11

All the music< all the time5

Distributed Systems ID2201

16

Spotify

peers %0B

ser'er10B o n cache 00B

17

Distributed Systems ID2201

Some pri'acy

Distributed Systems ID2201

12

(or " anonymous routing

Distributed Systems ID2201

20

,2, middle are

)unction " add< remo'e< locate and communicate ith resources in a net or! ?eCuirements " global scale< millions of nodes " dynamic a'ailability " integrity< pri'acy< anonymity< deniability

Distributed Systems ID2201

21

+b/ects and routing

Dhy not use I,E " scaleF 2#2 nodes " structured net or!< costly to add ne ob/ects " slo updates " no mobility : ell Ip'1; " trust< pri'acy

Distributed Systems ID2201

22

+'erlay routing
name spaceF global uniCue identifier :G3ID; structured or unstructured " pay hen you add nodes and ob/ects " pay hen you search for ob/ects fault tolerance and consistency " replication

Distributed Systems ID2201

2#

structured o'erlay
62 44 71 59 34

27

12

Distributed Systems ID2201

2%

,astry routing
0#2

:e4ample

ith !H% not 11; ### #21

110 #12 #11

second row of 311 holds entries for each of the three other sub segments
21#
Distributed Systems ID2201

#02

20

Distributed +b/ect *ocation and ?outing :D+*?; :(apestry;

(he ob/ect is stored by the creator of the ob/ect5 A hash !ey is computed and the ob/ect is published under the !ey5 A,IF " publish:guid;F ob/ect already created " unpublish:guid;F remo'e connection " send:msg< guid< InJ;F send a message to the ob/ect

Distributed Systems ID2201

21

(apestry routing
412 415 381 475 publish(413) 123 413 434 244 lookup(413) 237

Distributed Systems ID2201

26

unstructured o'erlay
62 44 71 59 34

27

12

Distributed Systems ID2201

27

3nstructured
.o net or! structure5 Kou !no some other nodes5 .o fi4ed location of ob/ects Lasy to /oin5 @ard to search5 .o guarantees

Distributed Systems ID2201

22

Searching
)lood the net or! " there should be a limitM L4panding ring " iterati'e flooding ?andom al! " se'eral independent searchers Gossip " hopefully they ill !no

Distributed Systems ID2201

#0

Summary
,eer2,eer systems should scale ith the number of clients by ma!ing the clients part of the ser'ice5 Structured o'erlay
" D@(< routing< ho to /oin and lea'e< replication

3nstructured o'erlay
" group of peers< searching for content

Distributed Systems ID2201

#1