BudgetApps - First All-Russian Open Financial Data Competition
Friends, under the sunset of the outgoing 2014 and the beginning of 2015 there is great news for all who love to work with open data, to participate in competitions for developers.
And also, I am sure that there are those who love history and historical data.
From December 23, the Ministry of Finance of Russia with our help of Information Culture opens the application contest BudgetApps http://budgetapps.ru/contest on open data that the Ministry of Finance of Russia has published for the last few years.
')
The data is very different. These are data on budgets, data on audit organizations, public debt, government reserves and much more.
Well, it turned out that my name is Ivan Begtin and I am a member of the jury of this competition.
All of them are on the link on the website of the Ministry of Finance - http://minfin.ru/ru/opendata/
And a lot of budget data is on the Single portal of the budget system - http://budget.gov.ru/data/opendata there is a budget structure in CSV format, the data itself, reference books and much, much more. As well as data on all official institutions here http://bus.gov.ru/public/opendata.html . Pay special attention to this resource. There indicators, budgets, charters and many other things are published for each state organization and municipal institution in Russia. If you conceive any regional project, then these data will be invaluable.
This does not mean that it is impossible to use any other data, certainly it is possible and necessary, however, since this is a contest of the Ministry of Finance of Russia, it is certainly expected that other data will be used along with this.
I personally think that you should not be limited to only those data that have already been translated into a machine-readable form. There is also data that can be turned into open data by yourself.
Many people can write parsers, but for those who have not done this before, good support can be ScraperWiki ( https://scraperwiki.com/ ) to collect information from the pages, as well as different libraries for parsing Excel files, extracting tables from PDF documents - using pdftables.com or Abbyy services or their Abbyy Finereader.
On the website and other resources of the Ministry of Finance, in addition to data, there are many other interesting things that can be turned into data. Starting just from the news that has become particularly relevant in recent days, continuing with everything else.
There is a huge direction in the discovery of data that we have so long missed - this is the direction of historical data. Those that are stored in the archives in the form of large volumes of reference books with a myriad of tables and which are simply necessary at the moment when we begin to refer to the history, referring to the facts, creating special projects dedicated to any event.
In the very next few days, the first scanned budgets of the Russian Empire and the Soviet Union will be published. A little later, but also very soon, all scanned budgets of the Russian Empire, the USSR and the RSFSR will appear, which only exist.
In addition to scans, the data itself will be published, converted into Excel and CSV tables, reconstructed from the reference books in the primary form and put in order by us for subsequent visualization or project.
Frankly, if I were not a member of the jury of this competition, I would personally make a special project on this data. Or maybe I'll do it again when the contest is over, or maybe someone will do it before me.
Already prepared are budget budget data for several years, both primary data obtained from the texts of books, and processed and compared for different years.
Therefore, the historical data is about to be soon, but for now you can start using the available ones and look at the public project “Historical materials” ( istmat.info ) where many of the budget reference books of the USSR and the Russian Empire are collected.
What additional data sources do we have.
And much more.
I know that many use data from Wikipedia and DBPedia, someone collects them himself, and who comes up with something of their own.
First and foremost, these are projects for the clarity of public finances. To visualize how the budget or public debt is arranged, or some particular area of ​​finance.
Secondly, of course, an infinite number of projects can be done on data from bus.gov.ru.
Want to make a registry of hospitals and compare them? They are all there.
Want to compare all public universities? And they are all there.
Want to make a map of the availability of public services and such data is there.
Want to visualize the budgets of MSU, St. Petersburg State University, MEPI, MIREA or any of your favorite university? And it is possible.
And according to historical data, it is easy to even visualize them and compare them with what it was and what it is now - this is already a big and interesting task.
In addition to the opportunity to get quite a material prize, and the prize fund is 400 thousand rubles, of course, this is not all. If the project turns out to be good and interesting, of course, it will be mentioned on the website of the Ministry of Finance and this in itself is an additional advertisement for any good project.
The competition began on December 23rd and its website is located at www.budgetapps.ru . There is a description, several nominations. A description of how the jury will work and more. Look, think, and of course ask me questions. I will answer here and or directly email me - ibegtin@infoculture.ru
And also, I am sure that there are those who love history and historical data.
From December 23, the Ministry of Finance of Russia with our help of Information Culture opens the application contest BudgetApps http://budgetapps.ru/contest on open data that the Ministry of Finance of Russia has published for the last few years.
')
The data is very different. These are data on budgets, data on audit organizations, public debt, government reserves and much more.
Well, it turned out that my name is Ivan Begtin and I am a member of the jury of this competition.
All of them are on the link on the website of the Ministry of Finance - http://minfin.ru/ru/opendata/
And a lot of budget data is on the Single portal of the budget system - http://budget.gov.ru/data/opendata there is a budget structure in CSV format, the data itself, reference books and much, much more. As well as data on all official institutions here http://bus.gov.ru/public/opendata.html . Pay special attention to this resource. There indicators, budgets, charters and many other things are published for each state organization and municipal institution in Russia. If you conceive any regional project, then these data will be invaluable.
This does not mean that it is impossible to use any other data, certainly it is possible and necessary, however, since this is a contest of the Ministry of Finance of Russia, it is certainly expected that other data will be used along with this.
I personally think that you should not be limited to only those data that have already been translated into a machine-readable form. There is also data that can be turned into open data by yourself.
Many people can write parsers, but for those who have not done this before, good support can be ScraperWiki ( https://scraperwiki.com/ ) to collect information from the pages, as well as different libraries for parsing Excel files, extracting tables from PDF documents - using pdftables.com or Abbyy services or their Abbyy Finereader.
On the website and other resources of the Ministry of Finance, in addition to data, there are many other interesting things that can be turned into data. Starting just from the news that has become particularly relevant in recent days, continuing with everything else.
Historical budgets
There is a huge direction in the discovery of data that we have so long missed - this is the direction of historical data. Those that are stored in the archives in the form of large volumes of reference books with a myriad of tables and which are simply necessary at the moment when we begin to refer to the history, referring to the facts, creating special projects dedicated to any event.
In the very next few days, the first scanned budgets of the Russian Empire and the Soviet Union will be published. A little later, but also very soon, all scanned budgets of the Russian Empire, the USSR and the RSFSR will appear, which only exist.
In addition to scans, the data itself will be published, converted into Excel and CSV tables, reconstructed from the reference books in the primary form and put in order by us for subsequent visualization or project.
Frankly, if I were not a member of the jury of this competition, I would personally make a special project on this data. Or maybe I'll do it again when the contest is over, or maybe someone will do it before me.
Already prepared are budget budget data for several years, both primary data obtained from the texts of books, and processed and compared for different years.
Therefore, the historical data is about to be soon, but for now you can start using the available ones and look at the public project “Historical materials” ( istmat.info ) where many of the budget reference books of the USSR and the Russian Empire are collected.
Where to find more data?
What additional data sources do we have.
- Hub of open data - hubofdata.ru non-state register of open data supported by NP “Information Culture”. A lot of things, more than 5000 arrays of data, but everything is unofficial.
- The data of the Federal Treasury - http://roskazna.ru/opendata/
- Web Services of the Central Bank of Russia - http://cbr.ru/scripts/Root.asp a lot of interesting data on Russian finance.
- The open data portal of Russia - http://data.gov.ru/ its advantage is that it aggregates a lot of Russian and not only data.
- World Bank data - where there is also information about Russia http://data.worldbank.org/
- UN data - http://data.un.org/
And much more.
I know that many use data from Wikipedia and DBPedia, someone collects them himself, and who comes up with something of their own.
What can be done?
First and foremost, these are projects for the clarity of public finances. To visualize how the budget or public debt is arranged, or some particular area of ​​finance.
Secondly, of course, an infinite number of projects can be done on data from bus.gov.ru.
Want to make a registry of hospitals and compare them? They are all there.
Want to compare all public universities? And they are all there.
Want to make a map of the availability of public services and such data is there.
Want to visualize the budgets of MSU, St. Petersburg State University, MEPI, MIREA or any of your favorite university? And it is possible.
And according to historical data, it is easy to even visualize them and compare them with what it was and what it is now - this is already a big and interesting task.
Why do you need it?
In addition to the opportunity to get quite a material prize, and the prize fund is 400 thousand rubles, of course, this is not all. If the project turns out to be good and interesting, of course, it will be mentioned on the website of the Ministry of Finance and this in itself is an additional advertisement for any good project.
How to participate?
The competition began on December 23rd and its website is located at www.budgetapps.ru . There is a description, several nominations. A description of how the jury will work and more. Look, think, and of course ask me questions. I will answer here and or directly email me - ibegtin@infoculture.ru
Source: https://habr.com/ru/post/247117/
All Articles