New in our big data program and three scholarships for training
Habr, hello! Soon, on October 5th, the fifth batch of the Big Data Specialist program will start here. Now an active stage of preparation for the organization of this 3-month marathon is underway, and my colleagues and I wondered what would be new in this set.
The program already exists on the market for 1.5 years, it has been tested and worked out from different sides, but there are important changes due to the fact that the technologies are not standing still.
The entire second module of our program, which is devoted to the development of recommender systems, is based on Apache Spark. On the first set, we used version 1.3. In a relatively short time, Spark managed to go from a tool that is constantly falling for unknown reasons, to a solution that many companies have implemented as their core business . We always keep our finger on the pulse and use the latest version of Spark on our cluster. The new version has a lot of improvements and changes in the field of working with the tool itself, so this will be covered in our program.
')
These two lessons were experimental in the previous sets. Practice has shown that it is very interesting and useful for listeners. The master class is our graduate and data engineer from E-Contenta, which is our partner. He talks about how they apply Spark Streaming to online recommendations of video content. At the seminar we analyze several practical cases, including the analysis of the content of tweets in real time.
This activity was also experimental in the past. We are going to meet our listeners if they have any special request for a particular topic. Last time, many wanted to hear about deep learning: what it is, what modern achievements, what is under the hood, what intuition is behind this tool, etc. This master class does not provide practical skills in working with deep neural networks. If there is such a need, it is better to use our special short program on this topic, which we announced at Data Science Week 2016. Presentation by reference.
Estimates for this lesson were very high, so we decided to leave it in the program.
Our main communication platform during the program is Slack. In it, students can effectively communicate with each other, with our teachers, ask questions during the online broadcast, and of course ask the organizers questions.
Most of the questions to the organizers are related to laboratory work, which the guys perform mostly at home. There are incomprehensible things, sometimes it seems that something does not work, etc. Approximately 80% of the questions are repeated among listeners, and from set to set, so it is logical to optimize it using modern technology. This time we will use the chat bot in Slack, which will slightly relieve our coordinator and technical team.
Microsoft is a partner of the New Professions Lab in big data education. This partnership brings the entire range of Microsoft cloud technologies to work with data to the educational program.
The scholarship covers half the cost of education (90 thousand out of 180 thousand rubles). A total of three scholarships are offered. A candidate for a scholarship should already have at least one year of experience, while at the same time he or she should be motivated to master the field of big data.
To get a scholarship, you must:
a) Be no older than 28 years old at the time of application.
b) Write a motivation letter. Be sure to include information about your education, work experience, projects you have been working on (supplemented with links to the product or fragments of program code), your career plans for the next 3-5 years.
c) Solve the competitive task
d) Send the completed task, resume and letter to info@newprolab.ru by September 26.
Results will be announced within a week after the deadline.
Come, it will be interesting! And, of course, we will be happy to answer your questions.
The program already exists on the market for 1.5 years, it has been tested and worked out from different sides, but there are important changes due to the fact that the technologies are not standing still.
1. Apache Spark 2.x
The entire second module of our program, which is devoted to the development of recommender systems, is based on Apache Spark. On the first set, we used version 1.3. In a relatively short time, Spark managed to go from a tool that is constantly falling for unknown reasons, to a solution that many companies have implemented as their core business . We always keep our finger on the pulse and use the latest version of Spark on our cluster. The new version has a lot of improvements and changes in the field of working with the tool itself, so this will be covered in our program.
')
2. Spark Streaming Workshop and Workshop
These two lessons were experimental in the previous sets. Practice has shown that it is very interesting and useful for listeners. The master class is our graduate and data engineer from E-Contenta, which is our partner. He talks about how they apply Spark Streaming to online recommendations of video content. At the seminar we analyze several practical cases, including the analysis of the content of tweets in real time.
3. Deep Learning Master Class
This activity was also experimental in the past. We are going to meet our listeners if they have any special request for a particular topic. Last time, many wanted to hear about deep learning: what it is, what modern achievements, what is under the hood, what intuition is behind this tool, etc. This master class does not provide practical skills in working with deep neural networks. If there is such a need, it is better to use our special short program on this topic, which we announced at Data Science Week 2016. Presentation by reference.
Estimates for this lesson were very high, so we decided to leave it in the program.
4. Chat bot in Slack
Our main communication platform during the program is Slack. In it, students can effectively communicate with each other, with our teachers, ask questions during the online broadcast, and of course ask the organizers questions.
Most of the questions to the organizers are related to laboratory work, which the guys perform mostly at home. There are incomprehensible things, sometimes it seems that something does not work, etc. Approximately 80% of the questions are repeated among listeners, and from set to set, so it is logical to optimize it using modern technology. This time we will use the chat bot in Slack, which will slightly relieve our coordinator and technical team.
Now about scholarships
Microsoft is a partner of the New Professions Lab in big data education. This partnership brings the entire range of Microsoft cloud technologies to work with data to the educational program.
The scholarship covers half the cost of education (90 thousand out of 180 thousand rubles). A total of three scholarships are offered. A candidate for a scholarship should already have at least one year of experience, while at the same time he or she should be motivated to master the field of big data.
To get a scholarship, you must:
a) Be no older than 28 years old at the time of application.
b) Write a motivation letter. Be sure to include information about your education, work experience, projects you have been working on (supplemented with links to the product or fragments of program code), your career plans for the next 3-5 years.
c) Solve the competitive task
d) Send the completed task, resume and letter to info@newprolab.ru by September 26.
Results will be announced within a week after the deadline.
Come, it will be interesting! And, of course, we will be happy to answer your questions.
Source: https://habr.com/ru/post/310546/
All Articles