Java / Python SDKs 1.3.5, as well as partial implementation of MapReduce for AppEngine
First I’ll talk about changes in SDKs, and then about MapReduce.
So,
- Increasing TaskQueue quotas from 50 requests for an application to 50 requests for a queue; further improvements in this service are expected in subsequent operations.
- Ability to configure the storage limit for TaskQueue.
- Precompilation for Python, currently disabled by default, is included in the config .
- Added software interfaces to access blob files directly from the application. Work is underway on creating and editing a blob from the application until it is ready.
- For local python SDK tasks are now performed automatically.
From the changes it is clear that the current release was in the context of the development of MapReduce technology for AppEngine , it will be discussed below.
')
A year ago, Brett Slatkin promised a set of technologies for working with huge amounts of data, and it is obvious that MapReduce should have been the basis. But there were difficulties (for those interested, see the presentation of this year), and it was decided to use TaskQueue for implementation.
The appengine-mapreduce project opens up fully, and is developing quite quickly with the efforts of 4 people. For java, it is based on Apache Hadoop, for python all its code.
Currently, there is only a non-transactional map-phase, in the future there will be a full-fledged MapReduce with shuffle + reduce phases. All info on the project is on the main and wiki pages. Use on health.
By the way, in the next release, most likely, there will be support for web-sockets, now everything is ready in SDKs, including a full-fledged API, but apparently there are still difficulties for production.
2 Guria : in protobuf the description of rpc for XMPP in both SDK appeared the methods SendPresenceRequest and SendPresenceResponse, which gives you hope that your ticket will be closed soon. Continue writing on the forum and directly on your ticket, pulling at the developers.
Full lists of changes:
- Release Notes: Python
- Release Notes: Java
- Revision History
- Product Roadmap
So,
- Increasing TaskQueue quotas from 50 requests for an application to 50 requests for a queue; further improvements in this service are expected in subsequent operations.
- Ability to configure the storage limit for TaskQueue.
- Precompilation for Python, currently disabled by default, is included in the config .
- Added software interfaces to access blob files directly from the application. Work is underway on creating and editing a blob from the application until it is ready.
- For local python SDK tasks are now performed automatically.
From the changes it is clear that the current release was in the context of the development of MapReduce technology for AppEngine , it will be discussed below.
')
A year ago, Brett Slatkin promised a set of technologies for working with huge amounts of data, and it is obvious that MapReduce should have been the basis. But there were difficulties (for those interested, see the presentation of this year), and it was decided to use TaskQueue for implementation.
The appengine-mapreduce project opens up fully, and is developing quite quickly with the efforts of 4 people. For java, it is based on Apache Hadoop, for python all its code.
Currently, there is only a non-transactional map-phase, in the future there will be a full-fledged MapReduce with shuffle + reduce phases. All info on the project is on the main and wiki pages. Use on health.
By the way, in the next release, most likely, there will be support for web-sockets, now everything is ready in SDKs, including a full-fledged API, but apparently there are still difficulties for production.
2 Guria : in protobuf the description of rpc for XMPP in both SDK appeared the methods SendPresenceRequest and SendPresenceResponse, which gives you hope that your ticket will be closed soon. Continue writing on the forum and directly on your ticket, pulling at the developers.
Full lists of changes:
- Release Notes: Python
- Release Notes: Java
- Revision History
- Product Roadmap
Source: https://habr.com/ru/post/97937/
All Articles