HTTP request via telnet
We take any forbidden site, for example hizb-ut-tahrir.info
We are trying to download the browser, curl and through telnet.
The curl and telnet results are different.
Why it happens? What is the difference between curl and telnet (with toggle crlf - the result does not change)? Provider - xs.
We are trying to download the browser, curl and through telnet.
The curl and telnet results are different.
Browser
Dear users!
We apologize, but access to the requested resource is limited.
Possible reasons for access restrictions:
')
Access is restricted by court order or for other reasons established by the legislation of the Russian Federation.
The index of the page and / or the domain name of the site, the network address are included in the Unified Registry of domain names, page indexes of the Internet sites and network addresses that allow identification of sites on the Internet that contain information whose distribution in the Russian Federation is prohibited.
You can check the availability of the domain name and (or) website page pointer, network address in the Unified Registry in the “Registry View” section on the eais.rkn.gov.ru website
The index of the page and / or the domain name, the network address are included in the Registry of domain names, web site indexes on the Internet and network addresses that allow identification of Internet sites containing information distributed in violation of exclusive rights.
You can check the availability of a domain name and (or) website page pointer, network address in the Registry in the "Registry View" section on nap.rkn.gov.ru/reestr
The index of the page and / or the domain name, the network address are included in the Registry of domain names, page indexes of sites on the Internet and network addresses that allow identification of sites on the Internet that contain calls for riots, extremist activities, participation in mass (public) events held in violation of the established procedure.
You can check the availability of a domain name and (or) website page pointer, network address in the Registry in the "Registry View" section of the site 398-fz.rkn.gov.ru
The index of the page and / or the domain name are included in the Register of information dissemination organizers on the Internet and websites (or) pages of websites on the Internet, which host publicly available information and access to which during the day is more than three thousand network users "The Internet".
You can check the availability of a domain name and (or) website page pointer in the Registry in the “Registry View” section of the site 97-fz.rkn.gov.ru
We apologize, but access to the requested resource is limited.
Possible reasons for access restrictions:
')
Access is restricted by court order or for other reasons established by the legislation of the Russian Federation.
The index of the page and / or the domain name of the site, the network address are included in the Unified Registry of domain names, page indexes of the Internet sites and network addresses that allow identification of sites on the Internet that contain information whose distribution in the Russian Federation is prohibited.
You can check the availability of the domain name and (or) website page pointer, network address in the Unified Registry in the “Registry View” section on the eais.rkn.gov.ru website
The index of the page and / or the domain name, the network address are included in the Registry of domain names, web site indexes on the Internet and network addresses that allow identification of Internet sites containing information distributed in violation of exclusive rights.
You can check the availability of a domain name and (or) website page pointer, network address in the Registry in the "Registry View" section on nap.rkn.gov.ru/reestr
The index of the page and / or the domain name, the network address are included in the Registry of domain names, page indexes of sites on the Internet and network addresses that allow identification of sites on the Internet that contain calls for riots, extremist activities, participation in mass (public) events held in violation of the established procedure.
You can check the availability of a domain name and (or) website page pointer, network address in the Registry in the "Registry View" section of the site 398-fz.rkn.gov.ru
The index of the page and / or the domain name are included in the Register of information dissemination organizers on the Internet and websites (or) pages of websites on the Internet, which host publicly available information and access to which during the day is more than three thousand network users "The Internet".
You can check the availability of a domain name and (or) website page pointer in the Registry in the “Registry View” section of the site 97-fz.rkn.gov.ru
Curl
The provider broke the headers in order to block access to the page.
# curl -v http://hizb-ut-tahrir.info * About to connect() to hizb-ut-tahrir.info port 80 (#0) * Trying 54.172.203.125... connected * Connected to hizb-ut-tahrir.info (54.172.203.125) port 80 (#0) > GET / HTTP/1.1 > User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.14.0.0 zlib/1.2.3 libidn/1.18 libssh2/1.4.2 > Host: hizb-ut-tahrir.info > Accept: */* > < HTTP/1.1 302 Found < Connection: close < Location: http://95.167.13.50/?id=11&st=0&dt=54.172.203.125&rs=hizb-ut-tahrir.info/ < 284 Connection: keep-alive Last-Modified: Sat, 11 May 2013 23:42:27 GMT ETag: "c11b41-8ec-4dc79d60a5ec0" Accept-Ranges: bytes Vary: Accept-Encoding <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> ... The provider broke the headers in order to block access to the page.
telnet
Outgoing headers copied from curl. The provider was powerless.
# telnet hizb-ut-tahrir.info 80 Trying 54.172.203.125... Connected to hizb-ut-tahrir.info. Escape character is '^]'. GET / HTTP/1.1 User-Agent: curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.14.0.0 zlib/1.2.3 libidn/1.18 libssh2/1.4.2 Host: hizb-ut-tahrir.info Accept: */* HTTP/1.1 200 OK Server: nginx/1.4.6 (Ubuntu) Date: Tue, 28 Jul 2015 13:37:21 GMT Content-Type: text/html Content-Length: 2284 Connection: keep-alive Last-Modified: Sat, 11 May 2013 23:42:27 GMT ETag: "c11b41-8ec-4dc79d60a5ec0" Accept-Ranges: bytes Vary: Accept-Encoding <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> ... Outgoing headers copied from curl. The provider was powerless.
Why it happens? What is the difference between curl and telnet (with toggle crlf - the result does not change)? Provider - xs.
Source: https://habr.com/ru/post/367801/
All Articles