Relive vacation
Many in our area do not really like to relax. The Internet is developing by leaps and bounds, sometimes a 2-week vacation can turn into a "late" start of the next project and as a result - the loss of money.
However, personally, I am sure that this holiday is sacred =) I don’t really like the sea and the beaches, but I enjoy staying in the pool with pleasure, I drink Turkish viskar and play table tennis. (I will immediately make a reservation, further in the context of Turkey = vacation)
And then another problem arises, how to support projects when no one is around? From Turkey to the Internet cafe is not an option. For then I will hang around there for days, meaning to go on vacation? Asking friends out, of course, but we live in the 21st century pancake.
I'll tell you how I set sail for 2 weeks and left my basher.ru to develop, which makes no sense without daily updates ...
Let me remind you that basher.ru is an aggregator of such resources as bash.org.ru , quotes.dirty.ru , ibash.org.ru , lorquotes.ru and some others. Accordingly, for the life of the project it is important that the updates are timely. I have written not complicated parsers that collect quotes with a certain periodicity. However, the guys from bash.org.ru immediately banned the ip server and from there quotations stopped collecting. There was a vacation on the nose and it was necessary to think something and somehow solve the problem.
The solution was found quite quickly - to raise the proxy on the local machine and bots on the server are knocking through the proxy.
No sooner said than done. We swing 3proxy under the axis we need and configure it. My config looks very simple:
Initially, we specify the dns server and cache location, the service command indicates the installation of a proxy as a service (for weak windows axes or one-time use, you can also run as an application. Similarly for nix). auth iponly - start only from certain ip, which are listed below (respectively, 217.65.2.216 server address, 192.168. * - lokalka). -a flag says 3proxy about complete anonymity; no headers like X_FORWARDED_FOR and so on will be transmitted.
That's all. After writing the config, install 3proxy and you're done.
The second problem is dynamic ip. At first, it seemed to be a minus, because for a few hours I could not remember the magic service dyndns.com. Now I understand that this is a huge plus. After all, to get rid of my bots, "honest" resource owners will have to ban the entire Stream ...
But now is not about that. The Internet gives me a magic device from ZyXel . To my surprise, it was already able to work with the dyndns.com service, it had detailed instructions for working with it and a user-friendly interface. Let me remind you that dyndns.com is a service that distributes third-level domains with dynamic ip. It's simple, you register, choose a domain for yourself, install their software, which with each connection reports your ip, and have a third level domain. Those. Once you are logged in, dyndns.com updates the location of the blablabal.blogdns.net computer, for example, and any user of the network can contact your computer by domain.
So, in my case, I didn’t even have to install the software, I just fed Zuksel with the access details on dyndns.com and configured NAT to my internal ip (all the details and subtleties are on their Russian-language forum).
That's all. It remained to feed the script the address (domain) and the port for the proxy and now the server bots follow the proxy quotes, i.e. through local comp. Yes, the computer requires to be constantly on and on the network for this scheme to work. But in fact, I don’t remember when I last turned off the computer. In extreme cases, you can go to the market, buy an old stub for 1000 rubles, put it behind the cabinet and stick fiber into it. But not the point.
For greater loyalty in the BIOS, I set up an "alarm clock" for the company at 7 am every day. Little did the electricity go down and left with a calm soul.
')
It remained to solve only one problem, how to drag it all to the plane:
However, personally, I am sure that this holiday is sacred =) I don’t really like the sea and the beaches, but I enjoy staying in the pool with pleasure, I drink Turkish viskar and play table tennis. (I will immediately make a reservation, further in the context of Turkey = vacation)
And then another problem arises, how to support projects when no one is around? From Turkey to the Internet cafe is not an option. For then I will hang around there for days, meaning to go on vacation? Asking friends out, of course, but we live in the 21st century pancake.
I'll tell you how I set sail for 2 weeks and left my basher.ru to develop, which makes no sense without daily updates ...
Let me remind you that basher.ru is an aggregator of such resources as bash.org.ru , quotes.dirty.ru , ibash.org.ru , lorquotes.ru and some others. Accordingly, for the life of the project it is important that the updates are timely. I have written not complicated parsers that collect quotes with a certain periodicity. However, the guys from bash.org.ru immediately banned the ip server and from there quotations stopped collecting. There was a vacation on the nose and it was necessary to think something and somehow solve the problem.
The solution was found quite quickly - to raise the proxy on the local machine and bots on the server are knocking through the proxy.
No sooner said than done. We swing 3proxy under the axis we need and configure it. My config looks very simple:
nserver 192.168.1.1
nscache 65536
service
log c:\3p\bin\3proxy.log
logformat "L%C - %U [%d/%o/%Y:%H:%M:%S %z] ""%T"" %E %I %O %N/%R:%r"
auth iponly
deny all
allow * 217.65.2.216
allow * 192.168.*
proxy -a
Initially, we specify the dns server and cache location, the service command indicates the installation of a proxy as a service (for weak windows axes or one-time use, you can also run as an application. Similarly for nix). auth iponly - start only from certain ip, which are listed below (respectively, 217.65.2.216 server address, 192.168. * - lokalka). -a flag says 3proxy about complete anonymity; no headers like X_FORWARDED_FOR and so on will be transmitted.
That's all. After writing the config, install 3proxy and you're done.
The second problem is dynamic ip. At first, it seemed to be a minus, because for a few hours I could not remember the magic service dyndns.com. Now I understand that this is a huge plus. After all, to get rid of my bots, "honest" resource owners will have to ban the entire Stream ...
But now is not about that. The Internet gives me a magic device from ZyXel . To my surprise, it was already able to work with the dyndns.com service, it had detailed instructions for working with it and a user-friendly interface. Let me remind you that dyndns.com is a service that distributes third-level domains with dynamic ip. It's simple, you register, choose a domain for yourself, install their software, which with each connection reports your ip, and have a third level domain. Those. Once you are logged in, dyndns.com updates the location of the blablabal.blogdns.net computer, for example, and any user of the network can contact your computer by domain.
So, in my case, I didn’t even have to install the software, I just fed Zuksel with the access details on dyndns.com and configured NAT to my internal ip (all the details and subtleties are on their Russian-language forum).
That's all. It remained to feed the script the address (domain) and the port for the proxy and now the server bots follow the proxy quotes, i.e. through local comp. Yes, the computer requires to be constantly on and on the network for this scheme to work. But in fact, I don’t remember when I last turned off the computer. In extreme cases, you can go to the market, buy an old stub for 1000 rubles, put it behind the cabinet and stick fiber into it. But not the point.
For greater loyalty in the BIOS, I set up an "alarm clock" for the company at 7 am every day. Little did the electricity go down and left with a calm soul.
')
It remained to solve only one problem, how to drag it all to the plane:
Source: https://habr.com/ru/post/15120/
All Articles