Hello everyone from the Toaster team! While working on improving our service, we are constantly studying web analytics data, collecting feedback from users through the support service or through the questions asked
by the “Toster.ru” tag . And when we need to make a more difficult decision or deeper understand the behavior and preferences of users, we conduct surveys. Today we just want to share with you the results of one of the surveys that we conducted recently.
We asked users about some of the principal innovations that we plan to introduce in the service, and also asked to compare Toster.ru and Stackoverflow.com for a number of parameters. More than 2.5 thousand people took part in the survey, of which two thirds are developers (moreover, 39% have the Senior or Lead qualification level, 38% - Middle, and 23% - Junior or Intern).

New features toaster
Let's start with innovations. Sometimes the old-timers of the “Toaster” reproach the service for asking too many basic questions and regularly asking them to divide them by difficulty. We included this problem in our survey and obtained the following results.
')

As you can see, the majority of respondents voted to divide questions into categories of complexity, that is, this idea is close not only to old-timers of the service. On the other hand, only every sixth person does not like this idea.
Taking this opportunity, we proposed several options for dividing questions by difficulty:

With a small margin won the option of dividing issues by difficulty from Intern to Senior. That is, in the same style in which it is customary to divide the developers themselves now by their qualifications.
The results of the survey convinced us that it was necessary to divide the questions according to complexity. We hope that very soon you will be able to see the embodiment of this idea on the “Toaster”.
Moving on. The next request, often voiced by users, is to give a negative rating to questions, answers and comments. Through the survey, we decided to find out how much this function is needed by a wide range of users:

As we see, opinions are divided here: the majority voted “in favor” of the introduction of such functionality, but every third person opposes.
So what about the introduction of negative marks, we still think carefully. For a start, let's see - suddenly, the introduction of the separation of questions by complexity will eliminate the desire to minus?
In the survey, we also decided to find out whether users are ready for the fact that it will be possible to “raise” the question and fix it on the first page of the issue, as well as whether they are ready to pay for it.

Opinions were divided approximately equally: a third was ready for such an opportunity, and a third reacted negatively to such an idea. Approximately also voices shared when answering the question about the willingness to pay for it themselves.
Again, we see a rather large share of dissenters, which means that we must also think about this functionality and communicate better about what can be bad in this opportunity (and what is good).
Then we asked if the users would like to see on the Toaster competition questions with a cash prize, which would receive the one whose answer was the first to be recognized as a solution?

Here, users were more unanimous: more than half met this idea warmly, only every fifth person did not like this idea.
Developing the topic of competitive questions, we asked further those who like this idea, are they ready to give answers in such questions? The vast majority were ready!

But when we clarified with the next question from them, and whether they are ready to create such questions themselves and spend real money to reward the respondent, we see that far from everything is already ready: however, almost 40% are ready!

In principle, a similar mechanism has already been implemented on Stackoverflow, but with the only difference that rating points, not money, act as a reward, we wanted to go a little further.
Integration of "Toaster" with other services TM
We are constantly thinking about how to increase the integration between the Toaster and other TM resources. We also constantly hear about this from users. In the survey, we decided to clarify this point in more specific and tangible forms. And received the following answers:
- 67% of respondents would like to be able to get a full account on Habrahabr for their activity on the "Toaster";
- 56% agreed that for proper activity on the “Toaster” it would be nice to get the opportunity to use the Freelance service for free: to place orders or respond to them;
- 46% agreed that it is cool to be able not only to help people find solutions, but also, as a bonus, to post vacancies on My Circle for free!
- No more than 10% spoke out against such possible bonuses.
We will not fully open the veil of secrecy over the future of the “Toaster”, however, we want to note that your opinion helped us a lot to correct the vector of further development of the project.
Toaster and StackOverflow
Since we are often compared with Stackoverflow, we decided not to miss the opportunity and asked the users what are the advantages of “Toaster” over Stackoverflow and vice versa, what are the advantages of Stackoverflow over “Toaster”?
The majority (about 40%) believe that asking a question or giving an answer is equally simple (difficult) on both resources. The opinion of the remaining divided so that twice as many respondents believe that it is easier to ask a question or give an answer to the "Toaster". But the Stackoverflow audience is considered more friendly than on the Toaster.
The question of the advantages of "Toaster" and StackOverflow, we left open, giving the opportunity to self-wording. We will not give all the answers here, because there are so many of them (and thank you for that!), But the top most popular answers look like this:
The main advantages of the "Toaster":- Russian language
- More pleasant interface
- Ability to create discussion questions
- Broader topics
- You can view all questions.
- Localization (specific software like 1C)
- Newsletter digest (this surprised us)
- Low entry threshold
The main advantages of SO:- Large audience
- More ready solutions
- No discussion
- The best moderation
- English speaking community
We by no means strive to make the second StackOverflow out of the Toaster, but from the answers we saw that our service has its convincing advantages that we will develop and maintain further. First of all, we will continue to try to create a place where IT-specialists will be able to get answers to a variety of questions relating to their activities: both simple and complex; both having an unambiguous solution, and affecting a broader discussion issues or exchange of experience.