DataPro Data Center: cooling and fire suppression systems
A bit about the DataPro project. In the previous article, we talked about the uninterruptible power supply and diesel-rotary UPS systems (DRUPS) of the DataPro data center, which has a certificate of compliance with the availability level of the Tier III Uptime Institute. DRUPS almost completely eliminate the possibility of failure of the backup power supply system and reach the operating capacity in just a few seconds.
Now we will talk about the cooling and fire suppression systems used in DataPro. Under the cut there are more details and a video of the response of the gas extinguishing system during the test trials.
In a typical data center, the value of PUE (Power Usage Effectiveness — defined as the ratio of the power consumed by the entire data center to the power consumed by IT equipment) reaches an average of 1.6–2 due to the power supply of the cooling systems. Therefore, manufacturers of this equipment have long been trying to develop more efficient systems. One of these solutions was a modular system of free cooling (free cooling) with additional irrigation - EcoBreeze.
The DataPro data processing center houses one of the first and largest EcoBreeze cooling system installations from Schneider Electric in Russia.
')
In 2010, American Power Conversion (APC), which later became part of Schneider Electric, introduced the first air-conditioning data center air conditioning system with an economizer separating the internal and external air flows. This system has been designed to meet the increasing demands for data center energy efficiency. It uses “natural” cooling (“indirect” free cooling).
EcoBreeze applies the principle of indirect evaporative air cooling. Warm air from the racks in the data center rises and through the duct enters the heat exchanger of the air conditioner outside the data center. The heat exchanger is purged with outdoor air, the hot air is cooled and fed back to the data center.
EcoBreeze uses several methods to transfer heat from the data center to the environment. Unlike other free cooling systems, two methods of free cooling are used here:
1. Cooling of air flow, during which there is a heat exchange between the cool outside air and the hot air from the data center premises, without mixing them. In the heat exchanger, improved materials are used to transfer heat from one air stream to another.
2. If the outside air temperature is not low enough for cooling, the system switches to the additional irrigation mode - the surface of the heat exchanger is covered with a thin layer of water.
In an extreme case, when the irrigation system is not enough, EcoBreeze has a third mode of operation - the freon cycle with a variable performance compressor. In essence, this is a classic freon air conditioner, designed to provide year-round cooling.
EcoBreeze solutions are installed outside the data center, without occupying a usable space in it. After the factory assembly, the system modules are pre-tested and mounted on the object.
The air conditioning system of the data center EcoBreeze is supplied as 50 kW modules, which can be combined into groups of up to four (200 kW) or eight (400 kW) modules. The modular design allows the system to scale for cooling capacity. This approach allows you to purchase equipment that meets current requirements for data center air conditioning, to save both initial investment and operating costs. In addition, the modularity of the system provides redundancy at the module level and its operability during maintenance or repair.
We now consider in more detail how it all works. Released in 2010, the system today continues to be an advanced solution. In 2014, Schneider Electric began mass production of EcoBreeze. So far around the world mounted a little more than two dozen systems.
So, for maximum energy efficiency, the data center EcoBreeze takes advantage of the climate, and it provides several cooling methods with the ability to automatically switch between them :
Thus, at low temperatures, the system dispenses with and without water, and without freon, working only from the surrounding air. When the ambient temperature rises, irrigation is activated, and if that is not enough, compressors are used.
In our climate, most of the year EcoBreeze can cool the IT load without turning on the freon circuit, spending a minimum of electricity. It is believed that the use of EcoBreeze in conjunction with other energy-efficient components of the engineering infrastructure of the data center allows for an average annual PUE of 1.25–1.3.
Outside air does not mix with air from the data center, water and freon are not allowed into the machine room. And to increase capacity, you can simply add EcoBreeze modules.
The intelligent control system and redundant EcoBreeze air economizer components are designed to ensure high reliability and availability of the data center cooling system.
The EcoBreeze system provides indirect freaking (i.e., the outside and inside air are not mixed) with additional irrigation of the air-to-air heat exchanger: evaporating, the water cools the outside air, the cooling tubes through which the internal circuit air is transmitted.
The entire data center air conditioning system is located outside of it. In DataPro, it is mounted on the roof of a building. Five such systems are now installed with eight modules each.
This technology allows a significant part of the year to spend electricity only to power the fans that supply air from the data center and back, as well as the fans that blow air through the heat exchanger. For systems like EcoBreeze, the efficiency ratio (Coefficient of Performance, COP) may be several times higher than the best classical chiller systems. In addition to energy savings, the area gain is also achieved: alternative solutions take up twice the space.
According to experts, for the Moscow climate, the power consumption of the EcoBreeze system is about three times lower than that of a chilled-water system, and about six times lower than the power consumption of a freon system. In addition, due to the possibility of redirecting air flows generated by EcoBreeze from one machine room to another, DataPro managed to increase the utilization rate of the cooling system's power to 80% in the DataPro data center. For 3-4 months in a year, EcoBreeze works “in full force”, the rest of the time it operates in free cooling mode.
Two 260 m3 fire tanks are used as reserve water tanks, which can be used for problems in the urban water supply system. Water is recycled, but requires regular updating due to pollution. In the summer, about 200 m3 of water a month is spent. Normal consumption is only 20-30 m3 per month.
Another feature of DataPro data center: the connection of freon tracks of air conditioners in it is made without soldering, using fittings. This implementation allows for rapid installation and repair without performing flammable work.
An example of the data center cooling system operation with display in the dispatch system.
Now the calculated load on each hall is 260 kW. Design load on the hall - 360 kW. In the course of certification on Uptime Tier III, one EcoBreeze system was turned off completely, and all the machines operated at full design load (5 halls of 360 kW each). If more than two EcoBreeze modules fail, backup freon air conditioners will start.
Detailed information on EcoBreeze. The numbers show the actual loading of the modules. Indicators show when to change or clean air filters.
Why, in the DataPro Data Center, are freon air conditioners also used? In fact, they have a double function: in addition to redundancy, they serve to maintain the desired level of humidity. In addition, to maintain the required level of humidity, a separate adiabatic humidification system is installed in the machine rooms of the data center.
EcoBreeze control panels in the DataPro data center control center.
It was originally planned to deploy 26 EcoBreeze installations with a cooling capacity of 350 kW each in the DataPro Data Center. This would be one of the largest installations of the system in Europe. However, to date, mounted eight systems EcoBreeze.
The scheme of cooling machine rooms.
The system made it possible to carry out a phased deployment and achieve a high energy efficiency ratio.
EcoBreeze system is not suitable for all data centers. The fact is that for its placement a considerable area will be required, during commissioning it may be necessary to make certain “improvements”, and its maintenance places high demands on the qualifications of personnel. The next point we talked about earlier is that EcoBreeze should be used in large-scale projects with a load close to 100%. It is in such conditions that the system demonstrates the best PUE indicator, in the calculation of which it is necessary to take into account, among other things, the flow rate for the water supply that requires “water treatment” - reducing the level of hardness. You should also pay attention to the high capital costs for the purchase and installation of modules compared to freon air conditioners of equivalent capacity. Separate nuance for data centers located in the city - requires regular replacement of HEPA air filters in the system of direct free cooling, which in some cases may cost more than the electricity saved by it.
Thoughtful planning will always help to evaluate the prospects of a project, as well as to find possible ways of leveling the minuses. For example, DataPro provided for almost everything, in particular, to optimize operating costs, instead of branded air filters from an equipment manufacturer, they use their own production of non-woven filter material.
The fire safety system in the DataPro data center is implemented using Autronica’s Vesda equipment, and biologically safe gas, freon 227, is selected as the fire extinguishing agent for the gas extinguishing system. The freon is distributed to the protected volume of the premises using piping and radial nozzles. The extinguishing agent is placed in gas extinguishing modules.
The machine room is equipped with the Vesda super early smoke detection system, which uses a laser gas analyzer to monitor the hot corridor air. Using a gas analyzer, an early fire and smoke detection system constantly analyzes the composition of the air. Unlike conventional office smoke detectors, this makes it possible to detect signs of fire at the earliest stages and prevent damage from fire.
The gas analyzer detects the presence of impurities that are typical for burning plastic or insulation. When such impurities are detected, an alarm message is given. To avoid false alarms, the gas extinguishing system operates in manual mode, that is, it is started by the engineer on duty and the security officer with a significant fire.
When an alarm message is received, the personnel, acting according to a predetermined plan, checks for the presence of a fire source and, if detected, activates a fire extinguishing system or simply uses a fire extinguisher, de-energizing the corresponding server or rack. This allows you to avoid accidental operation of the system and adequately respond to events such as the appearance of smoke from a faulty capacitor in the server.
If, for example, a high carbon concentration is detected, the system gives an alarm signal to the control center of the data center and to the security desk, indicating a possible fire on the corresponding indicator. The numbers on the fire alarm system panels show the level of the laser signal.
Unlike most other data centers, the fire extinguishing system in the DataPro data center was tested in a “combat” mode: a fire was simulated, as a result of the system’s operation after the personnel evacuated, the machine hall was filled with carbon dioxide, the fire in the absence of oxygen was quenched, and carbon dioxide was pumped out of the hall . In addition, regular exercises and staff training are held.
How did the test fire extinguishing system. We recommend to reduce the sound, because the alarm is impossible not to hear.
Additionally installed Bosch fire alarm system. Some DataPro customers, in accordance with their corporate standards, require the installation of additional fire protection equipment, in which case the systems necessary for them are installed.
All data center equipment and client equipment is insured.
One of the data center clients initiated an external audit of the data center. According to the results of the audit, an automatic gas fire extinguishing system was additionally installed in the RP-10 kV room especially for this client. In the initial project, the installation of this system in the RP was not envisaged.
Currently, gas fire extinguishing is provided in all machine rooms, rooms of cross-over and diesel-rotary UPS. The system is able to cope with a fire at the same time in two engine rooms and has a 100% reserve, which will allow it to stop the fire in two more rooms within a minute. After that, recharge cylinders will be required.
Corporate data centers for "monoclients" today learned how to build many Russian integrators. Commercial data center is a completely different story, here are several different requirements for life support systems. We will continue the story about this in our next materials on DataPro data center.
DataPro places projects from one rack, and the client should also independently agree on cooperation with telecom operators.
HOSTKEY is the official retail partner of DataPro. If you need to place equipment, rent dedicated servers or implement a complex converged project under a high SLA in a DataPro certified Tier III data center, please contact us.
Placing 1U equipment in our racks (modern server with any power supply, not twin) with a reserved dedicated Internet access channel of 100 Mbit / s costs 4,000 rubles. per month, including VAT or only 40,000 rubles. in year. You can rent the whole rack, 1/2 or a quarter of the standard rack, including under the seal. We will help with the installation, connection and pre-configuration of the transferred equipment.
We offer for rent in DataPro any dedicated Supermicro or HP servers , HP / Dell disk shelves and network infrastructure (VLAN) from 100 Mbit / s to 10 Gbit / s (including protection and routers) at reasonable prices. You can create a hybrid solution consisting of your servers, leased servers and network infrastructure. HOSTKEY provides the highest SLA for servicing customers' own equipment.
Now we will talk about the cooling and fire suppression systems used in DataPro. Under the cut there are more details and a video of the response of the gas extinguishing system during the test trials.
EcoBreeze cooling system
In a typical data center, the value of PUE (Power Usage Effectiveness — defined as the ratio of the power consumed by the entire data center to the power consumed by IT equipment) reaches an average of 1.6–2 due to the power supply of the cooling systems. Therefore, manufacturers of this equipment have long been trying to develop more efficient systems. One of these solutions was a modular system of free cooling (free cooling) with additional irrigation - EcoBreeze.
The DataPro data processing center houses one of the first and largest EcoBreeze cooling system installations from Schneider Electric in Russia.
')
In 2010, American Power Conversion (APC), which later became part of Schneider Electric, introduced the first air-conditioning data center air conditioning system with an economizer separating the internal and external air flows. This system has been designed to meet the increasing demands for data center energy efficiency. It uses “natural” cooling (“indirect” free cooling).
EcoBreeze uses several methods to transfer heat from the data center to the environment. Unlike other free cooling systems, two methods of free cooling are used here:
1. Cooling of air flow, during which there is a heat exchange between the cool outside air and the hot air from the data center premises, without mixing them. In the heat exchanger, improved materials are used to transfer heat from one air stream to another.
2. If the outside air temperature is not low enough for cooling, the system switches to the additional irrigation mode - the surface of the heat exchanger is covered with a thin layer of water.
In an extreme case, when the irrigation system is not enough, EcoBreeze has a third mode of operation - the freon cycle with a variable performance compressor. In essence, this is a classic freon air conditioner, designed to provide year-round cooling.
EcoBreeze solutions are installed outside the data center, without occupying a usable space in it. After the factory assembly, the system modules are pre-tested and mounted on the object.
The air conditioning system of the data center EcoBreeze is supplied as 50 kW modules, which can be combined into groups of up to four (200 kW) or eight (400 kW) modules. The modular design allows the system to scale for cooling capacity. This approach allows you to purchase equipment that meets current requirements for data center air conditioning, to save both initial investment and operating costs. In addition, the modularity of the system provides redundancy at the module level and its operability during maintenance or repair.
How does she work?
We now consider in more detail how it all works. Released in 2010, the system today continues to be an advanced solution. In 2014, Schneider Electric began mass production of EcoBreeze. So far around the world mounted a little more than two dozen systems.
So, for maximum energy efficiency, the data center EcoBreeze takes advantage of the climate, and it provides several cooling methods with the ability to automatically switch between them :
- With direct air heat exchange, only electronically-switched fans are used for cooling, and the EcoBreeze air economizer operates in a heat exchanger mode. In direct air heat transfer mode, hot air is pumped by electronically switched fans through indirect evaporative cooler (IEC) channels. After the initial cooling, the air leaves the IEC, passes through the air-conditioning system and returns to the data center.
- If the ambient temperature exceeds the threshold of + 7 ° C (this value can be adjusted), additional irrigation is activated. Indirect evaporative cooling is used: air is cooled due to the evaporation of water from the outer side of the heat exchanger channels.
- At high ambient temperatures (+ 27 ° C and above), the freon circuit is connected, the compressor of which has frequency regulation.
Thus, at low temperatures, the system dispenses with and without water, and without freon, working only from the surrounding air. When the ambient temperature rises, irrigation is activated, and if that is not enough, compressors are used.
In our climate, most of the year EcoBreeze can cool the IT load without turning on the freon circuit, spending a minimum of electricity. It is believed that the use of EcoBreeze in conjunction with other energy-efficient components of the engineering infrastructure of the data center allows for an average annual PUE of 1.25–1.3.
Outside air does not mix with air from the data center, water and freon are not allowed into the machine room. And to increase capacity, you can simply add EcoBreeze modules.
The intelligent control system and redundant EcoBreeze air economizer components are designed to ensure high reliability and availability of the data center cooling system.
The EcoBreeze system provides indirect freaking (i.e., the outside and inside air are not mixed) with additional irrigation of the air-to-air heat exchanger: evaporating, the water cools the outside air, the cooling tubes through which the internal circuit air is transmitted.
The entire data center air conditioning system is located outside of it. In DataPro, it is mounted on the roof of a building. Five such systems are now installed with eight modules each.
What does this give?
This technology allows a significant part of the year to spend electricity only to power the fans that supply air from the data center and back, as well as the fans that blow air through the heat exchanger. For systems like EcoBreeze, the efficiency ratio (Coefficient of Performance, COP) may be several times higher than the best classical chiller systems. In addition to energy savings, the area gain is also achieved: alternative solutions take up twice the space.
According to experts, for the Moscow climate, the power consumption of the EcoBreeze system is about three times lower than that of a chilled-water system, and about six times lower than the power consumption of a freon system. In addition, due to the possibility of redirecting air flows generated by EcoBreeze from one machine room to another, DataPro managed to increase the utilization rate of the cooling system's power to 80% in the DataPro data center. For 3-4 months in a year, EcoBreeze works “in full force”, the rest of the time it operates in free cooling mode.
Two 260 m3 fire tanks are used as reserve water tanks, which can be used for problems in the urban water supply system. Water is recycled, but requires regular updating due to pollution. In the summer, about 200 m3 of water a month is spent. Normal consumption is only 20-30 m3 per month.
Another feature of DataPro data center: the connection of freon tracks of air conditioners in it is made without soldering, using fittings. This implementation allows for rapid installation and repair without performing flammable work.
An example of the data center cooling system operation with display in the dispatch system.
Now the calculated load on each hall is 260 kW. Design load on the hall - 360 kW. In the course of certification on Uptime Tier III, one EcoBreeze system was turned off completely, and all the machines operated at full design load (5 halls of 360 kW each). If more than two EcoBreeze modules fail, backup freon air conditioners will start.
Detailed information on EcoBreeze. The numbers show the actual loading of the modules. Indicators show when to change or clean air filters.
Why, in the DataPro Data Center, are freon air conditioners also used? In fact, they have a double function: in addition to redundancy, they serve to maintain the desired level of humidity. In addition, to maintain the required level of humidity, a separate adiabatic humidification system is installed in the machine rooms of the data center.
EcoBreeze control panels in the DataPro data center control center.
It was originally planned to deploy 26 EcoBreeze installations with a cooling capacity of 350 kW each in the DataPro Data Center. This would be one of the largest installations of the system in Europe. However, to date, mounted eight systems EcoBreeze.
The scheme of cooling machine rooms.
The system made it possible to carry out a phased deployment and achieve a high energy efficiency ratio.
EcoBreeze Operation Specific
EcoBreeze system is not suitable for all data centers. The fact is that for its placement a considerable area will be required, during commissioning it may be necessary to make certain “improvements”, and its maintenance places high demands on the qualifications of personnel. The next point we talked about earlier is that EcoBreeze should be used in large-scale projects with a load close to 100%. It is in such conditions that the system demonstrates the best PUE indicator, in the calculation of which it is necessary to take into account, among other things, the flow rate for the water supply that requires “water treatment” - reducing the level of hardness. You should also pay attention to the high capital costs for the purchase and installation of modules compared to freon air conditioners of equivalent capacity. Separate nuance for data centers located in the city - requires regular replacement of HEPA air filters in the system of direct free cooling, which in some cases may cost more than the electricity saved by it.
Thoughtful planning will always help to evaluate the prospects of a project, as well as to find possible ways of leveling the minuses. For example, DataPro provided for almost everything, in particular, to optimize operating costs, instead of branded air filters from an equipment manufacturer, they use their own production of non-woven filter material.
Vesda fire extinguishing system
The fire safety system in the DataPro data center is implemented using Autronica’s Vesda equipment, and biologically safe gas, freon 227, is selected as the fire extinguishing agent for the gas extinguishing system. The freon is distributed to the protected volume of the premises using piping and radial nozzles. The extinguishing agent is placed in gas extinguishing modules.
The machine room is equipped with the Vesda super early smoke detection system, which uses a laser gas analyzer to monitor the hot corridor air. Using a gas analyzer, an early fire and smoke detection system constantly analyzes the composition of the air. Unlike conventional office smoke detectors, this makes it possible to detect signs of fire at the earliest stages and prevent damage from fire.
The gas analyzer detects the presence of impurities that are typical for burning plastic or insulation. When such impurities are detected, an alarm message is given. To avoid false alarms, the gas extinguishing system operates in manual mode, that is, it is started by the engineer on duty and the security officer with a significant fire.
When an alarm message is received, the personnel, acting according to a predetermined plan, checks for the presence of a fire source and, if detected, activates a fire extinguishing system or simply uses a fire extinguisher, de-energizing the corresponding server or rack. This allows you to avoid accidental operation of the system and adequately respond to events such as the appearance of smoke from a faulty capacitor in the server.
If, for example, a high carbon concentration is detected, the system gives an alarm signal to the control center of the data center and to the security desk, indicating a possible fire on the corresponding indicator. The numbers on the fire alarm system panels show the level of the laser signal.
How did the test fire extinguishing system. We recommend to reduce the sound, because the alarm is impossible not to hear.
Additionally installed Bosch fire alarm system. Some DataPro customers, in accordance with their corporate standards, require the installation of additional fire protection equipment, in which case the systems necessary for them are installed.
All data center equipment and client equipment is insured.
One of the data center clients initiated an external audit of the data center. According to the results of the audit, an automatic gas fire extinguishing system was additionally installed in the RP-10 kV room especially for this client. In the initial project, the installation of this system in the RP was not envisaged.
Currently, gas fire extinguishing is provided in all machine rooms, rooms of cross-over and diesel-rotary UPS. The system is able to cope with a fire at the same time in two engine rooms and has a 100% reserve, which will allow it to stop the fire in two more rooms within a minute. After that, recharge cylinders will be required.
Corporate data centers for "monoclients" today learned how to build many Russian integrators. Commercial data center is a completely different story, here are several different requirements for life support systems. We will continue the story about this in our next materials on DataPro data center.
DataPro places projects from one rack, and the client should also independently agree on cooperation with telecom operators.
HOSTKEY is the official retail partner of DataPro. If you need to place equipment, rent dedicated servers or implement a complex converged project under a high SLA in a DataPro certified Tier III data center, please contact us.
Placing 1U equipment in our racks (modern server with any power supply, not twin) with a reserved dedicated Internet access channel of 100 Mbit / s costs 4,000 rubles. per month, including VAT or only 40,000 rubles. in year. You can rent the whole rack, 1/2 or a quarter of the standard rack, including under the seal. We will help with the installation, connection and pre-configuration of the transferred equipment.
We offer for rent in DataPro any dedicated Supermicro or HP servers , HP / Dell disk shelves and network infrastructure (VLAN) from 100 Mbit / s to 10 Gbit / s (including protection and routers) at reasonable prices. You can create a hybrid solution consisting of your servers, leased servers and network infrastructure. HOSTKEY provides the highest SLA for servicing customers' own equipment.
Source: https://habr.com/ru/post/281457/
All Articles