Secure Distributed File System
In general, the idea appeared quite a long time ago. Maybe a year ago I came across a mention of such a development, but I don’t know how to search now. Maybe my idea is not new and banal. So…
Torrent Secure Distributed File System. Sounds, of course, pathetic.
')
The bottom line:
1. The file system is a network distributed file system, with redundant duplication, encryption, block-by-section splitting of each file across multiple network nodes. Roughly speaking, network RAID, where a separate physical disk volume group is the space allocated by an individual user. User space can be either shared by a user group or private.
2. To work fs need constant access to the Internet, and the greater the speed of the connection - the better. It is possible to impose restrictions on the entrance to the network in speed. You do not want to wait for the launch of your favorite program for 2 hours? :) It is possible to build a FS based on a local network, then the issue of speed is solved more easily. But rarely you can find such a large network that can ensure the continued availability of all files.
3. Have 1-2 -... n trackers to coordinate users.
4. Each user allocates space for data storage, say, from 1GB to infinity. At the same time, you can impose a limit on the amount of disk for the user, taking into account the amount allocated to them for network storage and the availability of free space in the distributed network.
5. Undoubtedly, a distributed network should have at least 15-20 people (ideally, we are talking about thousands), to split a file sufficiently, say, 5 parts (a part does not mean a linear copy of 1/5 file, as well as during transmission in torrents 20% of data in shuffle form, with each part duplicated in at least 3-4 storage nodes.
6. It is possible to allocate a cache on the user's disk, the 2nd section in which the last whole files received from the network are stored. The partition files are encrypted with a randomly generated key when starting the session of the FS communication, the key is stored in RAM until the end of the session. Accordingly, in a critical situation (session break \ reset \ equipment removal) access to the cached data will be permanently closed.
Do you think that such a system has the right to life?
PS Of course, users can use this kind of development for any purpose, including for storing illegal content. But, I first of all described the system that allows you to have your files always online, and be sure that the storage is available only for you alone (in comparison with services that provide network drives, where the guarantee that your files are visible, only you are once viewed html page with some kind of agreement)
')
The bottom line:
1. The file system is a network distributed file system, with redundant duplication, encryption, block-by-section splitting of each file across multiple network nodes. Roughly speaking, network RAID, where a separate physical disk volume group is the space allocated by an individual user. User space can be either shared by a user group or private.
2. To work fs need constant access to the Internet, and the greater the speed of the connection - the better. It is possible to impose restrictions on the entrance to the network in speed. You do not want to wait for the launch of your favorite program for 2 hours? :) It is possible to build a FS based on a local network, then the issue of speed is solved more easily. But rarely you can find such a large network that can ensure the continued availability of all files.
3. Have 1-2 -... n trackers to coordinate users.
4. Each user allocates space for data storage, say, from 1GB to infinity. At the same time, you can impose a limit on the amount of disk for the user, taking into account the amount allocated to them for network storage and the availability of free space in the distributed network.
5. Undoubtedly, a distributed network should have at least 15-20 people (ideally, we are talking about thousands), to split a file sufficiently, say, 5 parts (a part does not mean a linear copy of 1/5 file, as well as during transmission in torrents 20% of data in shuffle form, with each part duplicated in at least 3-4 storage nodes.
6. It is possible to allocate a cache on the user's disk, the 2nd section in which the last whole files received from the network are stored. The partition files are encrypted with a randomly generated key when starting the session of the FS communication, the key is stored in RAM until the end of the session. Accordingly, in a critical situation (session break \ reset \ equipment removal) access to the cached data will be permanently closed.
Do you think that such a system has the right to life?
PS Of course, users can use this kind of development for any purpose, including for storing illegal content. But, I first of all described the system that allows you to have your files always online, and be sure that the storage is available only for you alone (in comparison with services that provide network drives, where the guarantee that your files are visible, only you are once viewed html page with some kind of agreement)
Source: https://habr.com/ru/post/63300/
All Articles