Samsung's DeepSort ranked first in the Sort Benchmark 2014 competition
Good afternoon, Habr!
The Samsung Electronics DeepSort data sorting system won first place in the Sort Benchmark competition, known as the World Cup in data sorting. Having surpassed the competitive decisions of leading technology companies and research institutes, the Samsung system was able to analyze and reorganize 3.7 TB of data in 60 seconds. This is more than double the previous 1.5 TB record from the MinuteSort Benchmark performance test, which is the industry standard for sorting data per minute.
DeepSort was tested in a network environment consisting of 384 servers. In order to more accurately assess the actual performance of the system, throughout the test, moderate hardware and software parameters were used. For example, parameters such as the number of servers, memory (64 GB) and computing power (2.1 GHz) of each of the servers were significantly lower compared to the parameters that were used by Samsung’s main competitors in the Sort Benchmark 2014 competition. time, instead of much faster solid-state drives (SSD), conventional hard drives (HDD) were used for the test.
')
Such a high performance of DeepSort is due to the fine tuning of a number of key elements to accelerate the processing speed, which is carried out during the entire sorting process. Among other things, it is prevention of additional waiting time for servers with higher load (even load distribution among all servers), ensuring the simultaneous processing, transfer and storage of data (the system is capable of processing several thousand threads in parallel), as well as minimizing the buffering time in server servers. HDD by maximizing the use of cache memory.
As expected, the DeepSort system, jointly developed by Samsung Software Center in Korea and Samsung Research America in Silicon Valley, will be implemented in a number of Samsung services and mobile applications, including search functions.
The success of DeepSort took place against the background of Samsung’s focus on software innovation. In the development of this initiative, the company has invested significant financial and professional resources involving more than 40,000 developers.
The Samsung Electronics DeepSort data sorting system won first place in the Sort Benchmark competition, known as the World Cup in data sorting. Having surpassed the competitive decisions of leading technology companies and research institutes, the Samsung system was able to analyze and reorganize 3.7 TB of data in 60 seconds. This is more than double the previous 1.5 TB record from the MinuteSort Benchmark performance test, which is the industry standard for sorting data per minute.
DeepSort was tested in a network environment consisting of 384 servers. In order to more accurately assess the actual performance of the system, throughout the test, moderate hardware and software parameters were used. For example, parameters such as the number of servers, memory (64 GB) and computing power (2.1 GHz) of each of the servers were significantly lower compared to the parameters that were used by Samsung’s main competitors in the Sort Benchmark 2014 competition. time, instead of much faster solid-state drives (SSD), conventional hard drives (HDD) were used for the test.
')
Such a high performance of DeepSort is due to the fine tuning of a number of key elements to accelerate the processing speed, which is carried out during the entire sorting process. Among other things, it is prevention of additional waiting time for servers with higher load (even load distribution among all servers), ensuring the simultaneous processing, transfer and storage of data (the system is capable of processing several thousand threads in parallel), as well as minimizing the buffering time in server servers. HDD by maximizing the use of cache memory.
As expected, the DeepSort system, jointly developed by Samsung Software Center in Korea and Samsung Research America in Silicon Valley, will be implemented in a number of Samsung services and mobile applications, including search functions.
The success of DeepSort took place against the background of Samsung’s focus on software innovation. In the development of this initiative, the company has invested significant financial and professional resources involving more than 40,000 developers.
Source: https://habr.com/ru/post/244511/
All Articles