Highload ++ is close. This (the eleventh!) Time in Skolkovo will gather 2700 developers of highly loaded systems in order to exchange experience in building and developing the architecture of large projects, about databases, storage systems, system administration, load testing, operating large projects and other areas related to high loaded systems. We traditionally take an active part in Highload ++ and today we will tell what we have prepared for its participants this time.

Content

1. Reports
1.1 November 7
1.2 November 8
2. Workshops
3. Activities
4. Professional communication

Reports

For the conference, our colleagues prepared four reports - you will be able to meet them in the Congress Hall, in the halls of Singapore, Beijing and Shanghai, on November 7 and 8. Or ask them your questions at the Avito stand or in our meeting room. Details below.

November 7

“Avito data warehouse: analytics for microservice architecture” . Artyom Danilov, Avito Data Warehouse Architect

Time: 12:00
Venue: Congress Hall (online broadcast will be available on the conference website)

A large number of modern web projects are switching to microservice architecture. It solves a huge number of problems inherent in monolithic systems, however, it imposes qualitatively new requirements, including on data analytics. The report will tell you about the challenges and opportunities Avito microservice architecture presented, and also show how Clickstream can be useful not only for analysts, but also for developers.

"Customizing kubernetes: tips and tricks . " Mikhail Prokopchuk, Avito Server Lead Developer

Time: 15:00
Place: Halls "Beijing" and "Shanghai"

We at Avito have been using Kubernetes for more than a year as a microservice platform. In the report, Mikhail will share his experience in solving problems and setting up a cluster to ensure its efficient operation (low and stable latency for services, use of CPU, RAM resources): hardware settings (network, CPU), OS, settings of the kubernetes infrastructure components themselves and tell about what and how to monitor.

November 8

"Quality control of high-loaded systems . " Andrei Drozdov, developer of the server part in Avito

Time: 12:00
Location: Congress Hall (online broadcast will be available on the conference website)

Development of any high-loaded service is not complete without load tests. In many projects, the process of analyzing the work of the system is weakly structured or is carried out directly in combat. There are lots of articles and recipes for the use of certain tools, but the most important questions are not fully revealed: what exactly should we measure, whether we interpret the results correctly and how to catch bugs that appear only under high load. In his report, Andrew will talk about how to build a quality control process for highload services from scratch.

"Lambda architecture for realtime analytics - risks and benefits . " Nikolay Golov, Head of Avito Database Development

Time: 5:00 pm
Location: Singapore Hall

In 2017, building analytics on big data is no longer an achievement. Showcases lagging by the day are already old. Lagging for an hour is not bad. Achievement for 2017 is real-time BigData, a wide range of analytical data lagging behind reality by seconds (milliseconds!). Millisecond lag means in-memory. BigData means that everything will not fit into the RAM. So you need to combine. This concept is called Lambda Architecture.
In Avito, a similar scheme is constructed by combining HP Vertica (bulk historical data) + Redis / Tarantool (realtime data cache). Come to the report of Nicholas to hear the details and ask your questions.

Master Classes

"Logical Replication and Avito" . Konstantin Evteev, Mikhail Tyurin, Sergey Burladyan

Date: November 7
Time: 12:00 - 14:00
Location: Cape Town Hall

In Avito, ads are stored in Postgres databases. At the same time, logical replication has been actively used for many years. With the help of it, the issues of data volume growth and the number of requests to them, scaling and load distribution, data delivery to DWH and search subsystems, interbase and interservice data synchronization, etc. are successfully solved. own add-ins and extensions. The following topics will be covered at the master class.

1. The need for logical replication in general and Avito cases.
2. The evolution and working principle of trigger solutions from Postgres 7.0: RServ Vadim Mikheev (Vadim Mikheev, author of MVCC), Elephants (Slony), Elephant "Londiste" (PgQ) from Skype.
3. Out-of-box logical replication architecture: Logical Replication in PostgreSQL 10 & PGLogical.
4. Examples of the use of replication and its extensions in Avito.
5. Questions and wishes addressed to the community.

You can prepare for the master class in advance. Here is the image of the virtual machine on which the practical part is conducted. On the eve of the event materials for the master class will be available here . And here are a couple of links:

• version of skytools Avito c undo and a few other buns;
• PgQ based RPC .

"Load testing web service." Andrey Drozdov

Date: November 8
Time: 15:00 - 17:00
Location: Meeting Room A1.2 (“Africa”)

In the course of the report on stress and integration tests, it will be interesting to try all this live. Participants of the master class will study the yandex tank, pstack, pprof and other tools, look at the example of the finished amusement park. After that, several web services on Go will be offered to analyze performance problems (you can choose any other language at will). Important: for full participation, you must have a configured minikube on your computer or be ready to start a virtual machine.

Activities

AvitoQuiz: prize, please!

In general, for Highload ++ we have invented and prepared a lot of cool gifts. One of the ways to win them is to take part in the AvitoQuiz quiz. You will need to pass a test in one of the programming languages ​​(Python, Go, PHP) or a test for DevOps. The best 50 participants of each test we will give t-shirts and other cool souvenirs.
Those who pass more than one test and score the maximum number of points, we will give the main prize - an electric scooter! Details are on our stand.

PGHACK Lite

There is another way to win prizes. Some of you may have already heard about our PGHACK competition . Of course, we made its version for the conference. This is how it was in our office. (And you can see the details in the photo album on FB ).

(With this frame we say hello to envek , our winner!)

The abbreviated blitz version of our Postgres Health Recovery Competition will be held on November 7 from 12:00 to 18:00 in the gaming zone (Singapore Foyer). On November 8, it will be possible to participate in PGHACK from 12:00 to 15:00. Details and schedule of tours - on the spot. We are waiting for the competition of specialists working with databases: developers, programmers, administrators. DevOps engineers and full-stack developers with a large knowledge base on the topic will be able to participate. And of course, this is not only a competition, but also professional communication! We will award the best players with prizes and cool T-shirts like kevteev in this photo:

To take part in the blitz version of PGHACK, you need a laptop with VirtualBox (version 5.1.24 or newer), 10Gb of free hard disk space and 3GB of RAM. You can also download a gaming virtual machine in advance. pkorobeinikov and my colleagues will be waiting for you to do PGHACK on Highload together!

Professional communication

And of course, our stand will work without interruption all two days of the conference. There you can chat with speakers, learn about Avito vacancies. Replenish the slots of the stickers for the traditional “Curiosity” and take pictures with Gopher, Docker, Python or Elephant.

For those who cannot be on November 7 and 8 on Highload ++, we will conduct live reports on our social networks: on the AvitoTech Facebook page , on the telegram channel , on VKontakte, and on Twitter .