They say that in order to “be in trend,” you need to follow the news in the world. This concerns not only fashion, but also IT.
')
I will give a brief insight into what is happening in the Python universe now, what interesting topics you can find in it and where to dig if you want to do something in Python, but it's hard to choose which one.
I will talk about how we use Python in Yandex.Disk, what libraries and frameworks we use, what tasks we solve and what problems we encounter. I will also touch upon the topic of logging and processing asynchronous operations.
Having written a web service, it can be nice to document it: describe what resources are available, what requests they accept and what answer to expect from them in one way or another. And preferably with examples so that you can visualize what it is about. But how to be sure that the examples will remain relevant tomorrow, in a week, with the next release?
I will talk about documenting the HTTP API using Sphinx and how we developed a module to automate the testing of HTTP requests and responses given in the documentation.
In our times of clouds and Big Data it is difficult to imagine a project without a data warehouse. And there seems to be no difficulty with it — set it up, set it up and forget it. But what if the storage lives simultaneously in several data centers, it has 4 petabytes of data, the quality of hardware and the network leaves much to be desired, and the number of system administrators is limited?
In the report, I will talk about our solution to this problem, which we called Mastermind, how the fantasy of sysadmins works when a convenient tool falls into their hands, and what problems we encountered in a distributed environment.
Source: https://habr.com/ru/post/227359/
All Articles