Documentation for Grab - library for parsing sites

I previously told in Habré about Grab - a library for parsing websites and Spider - an asynchronous module for parsing. I am glad to announce that I finally added the Grab documentation . I decided to write everything in Russian because in English it is more difficult for me to express thoughts. In fact, the scribbling turned out to be much more than it seemed at the beginning, but I did describe almost all the functions of the library. I decided to just insert the table of contents here, click on the interesting section and read about the possibilities of Grab:

• Introduction to Grab
• Installing the Grab Library
  • Dependencies
  • Installation for Linux
  • Installation under Windows
• Configuring a Grab Object
  • Ways to specify settings
  • Cloning
• Debugging requests
  • Using the logging system
  • Query numbering
  • Saving requests and responses to files
• Full list of settings
  • Settings
• Configure HTTP Headers
  • Modifying HTTP Headers
  • Configure User-Agent Header
  • Setting Referer Header
• HTTP request methods
  • Method selection
  • POST request
  • Sending files
• Other features
  • Limiting response body
  • Compression response
  • HTTP Authorization
  • Work with pycurl descriptor
  • 301 and 302 redirects
  • Meta Refresh Redirects
• Document encoding
  • What you need to know the encoding
  • Encoding Definition Algorithm
  • Encoding job option
• Cookies
  • Cookies setting
  • Cookies file management
• Handling network errors, timeouts
  • Network errors
  • Timeouts
  • Repeat request mode
• Work with proxy servers
  • Proxy Configuration
  • Work with proxy lists
• Work with answer
  • Reponse object
• Technical details of the device Grab
  • Used libraries
  • Extension structure
  • Python 3 support
• Working with forms
  • Automatic form processing
  • Form submission
  • Sending files
• Work with a DOM tree
  • Interface to the LXML library
  • Dom tree
  • XPATH methods
  • CSS methods
  • Exception Handling
• Search in the text of the document
  • Search strings
  • Regular expression search
• Other extensions
  • Django extension
  • PyQuery extension
  • BeautifulSoup extension
• Network transports
  • What is transport
  • Pycurl vehicles
  • Urllib transport
  • Selenium transport
• Useful Utilities
  • Task pool
  • File lock
  • Logging Grab-activity to a file
  • Filter lines in file
  • HTML processing
  • Working with LXML elements
  • Working with regular expressions
  • Work with text

By the way, I prepared the HTML code for the table of contents using a script using Grab:
')

# coding: utf-8 from grab import Grab from lxml.html import tostring g = Grab() g.go('http://grablib.org/docs/') g.tree.make_links_absolute('http://grablib.org/docs') elem = g.xpath(u'//h3[text()=" "]/following-sibling::ul[1]') toc = tostring(elem, encoding='utf-8') print toc 

The official website of the grab library: grablib.org
Questions on the use of grab should not be written to me in skype / jabber, but to the email list: groups.google.com/group/python-grab
I also remind you that we (GrabLab) are engaged in parsing websites to order, if you need to collect and process data - please contact us.

Next, I plan to do the documentation of the asynchronous spider module.