Many tests for certification of Java programmers contain a large number of questions with choices. There is little sense from such tests: many things concerning the API can be quickly learned by reading the documentation or source code. At the same time, the ability to program, which consists mostly of the ability to correctly formulate an algorithm and to think logically, is not tested at all.
San Francisco's company betterprogramming.com decided to fix this problem. The test located on their website, instead of many questions, offers to solve several problems. Tasks are the implementation of simple algorithms (level regional programming Olympiad, the first round of ACM ICPC or easy tasks in topcoder). The text of the program, written by the developer, is executed on the server, and according to its results as well as the time taken to pass the test, an assessment is given.