For everyone who works with open data, makes their projects for themselves, people, to participate in contests, the source code of examples of how data was collected and what was done with them is always useful.
I propose to compile a list of open repositories of code aimed specifically at solving problems of working with open data and examples of projects that are based on them.
Here is a list of repositories of foreign initiatives that I know of:
- a
huge number of Open Knowledge Foundation - CKAN projects, extensions to it, data conversion utilities
-
Sunlight Labs source code repositories - a lot of examples of how many US sites and databases are parsed, as well as libraries for working with data of various types
-
OpenGovernment.org repositories - many examples of Ruby projects
-
Oxford IT department repositories - their open data projects such as DataVerse;
- the
open code of the White House (USA) - projects on petitions, API standards and all sorts of things for Drupal
-
AlphaGov (UK) repository - project materials
www.gov.uk a lot of project code and subprojects
')
We in the Information Culture work with open data all the time, and a part of the code that we produce may well be useful to others. But what is really there, just be useful.
Therefore, we have posted a lot of materials in the form of public repositories in which everyone can find something for themselves and use it freely.
And here is what it is:
-
OpenGovData.ru source code - it is not very relevant and damp, since we are gradually migrating to CKAN, but it is quite suitable for those who want to quickly and without any help deploy the open data portal in their city without asking anyone.
-
Open Data of the Moscow City Health
Service - data and scripts for their extraction from the website of the Moscow Department of Health
mosgorzdrav.ru . The data is collected and processed according to daily reports and is quite curious for visualization. Of course, it is important not to forget to update them.
-
Open data of the Central Bank of the Russian Federation - a project to convert data from the API of the Central Bank's web services into a database. A rather old API, we had to use the .NET utility to work with the web service, but maybe someone will have time and desire to work on this data.
-
Goontology - a set of RDF / OWL data in various areas of the state. Unfinished ontologies, but quite suitable for work.
-
Open State Duma - scripts and data obtained when working with the data of deputies. As I said earlier, they are not very interesting to deal with, there is a sheer policy.
-
Site Monitor - a small Django site monitoring project for accessibility. It runs the site
http://sitemon.opengovdata.ru/ monitoring
zakupki.gov.ru-
Open data of Moscow - data parser from data.mos.ru (Official Moscow portal) and their uploader in CKAN hub.opengovdata.ru
-
MES open data - scripts for extracting open data and the MES data itself. Collects information about phones, summaries and addresses of units.
-
Open data MFA - scripts and data on the ambassadors. Unfinished as there are a lot of errors when parsing. Therefore, analysis dumps from Google Refine / Open Refine are attached.
-
Open Kremlin - data from the kremlin.ru site on the President and Administration. Mostly historical in the form of a dump blog Medvedev and all comments to him. There are also ideas on how to use their data here they are collected in the form of Excel tablets
https://github.com/infoculture/openkremlin/blob/master/docs/kremlin_ru_opendata.xlsThere are many other useful projects for analyzing data, collecting them from sites, transforming data and much more. We will upload something as soon as it is ready (first of all, the code should be described, README done, etc.), but there are certainly other useful repositories. If you know such - send. We will make a list of them.