What's New in AWS: DATA API, Kinesis Data Analytics, S3 Path

DATA API for Amazon Aurora Serverless

How does the connection to the traditional database work? You open a connection, use it to process one or more SQL queries or other statements, and then close the connection. You probably used a client library specific to your operating system, programming language, and database. At some point, you realized that making connections took a lot of time and took up memory at the database core.

The DATA API takes care of managing and scaling long-term database connections and returns data in the form of JSON for easy analysis. All traffic is encrypted and occurs via HTTPS.

So what is the DATA API?

ExecuteStatement - execute a single SQL query.
BatchExecuteStatement - execute a single SQL query for an array of data.
BeginTransaction - start a transaction and return the transaction identifier.
CommitTransaction - complete the transaction and commit the SQL operations that were performed in it.
RollbackTransaction - roll back the transaction.
')
The only limitation is that each function must complete within a minute and can return up to 1 megabyte of data.

Read more.

- Art Tonoyan arttonoyan , Database Administrator at Provectus

Amazon Kinesis Data Analytics now real-time applications

With the increase in data flow, the need to specifically process and analyze this data increases. Amazon Kinesis Data Analytics is one such service that enables you, writing SQL or Java code (using Apache Flink), to start collecting data from various sources, as well as process and analyze it in real time. Now that you have a more comprehensive and multidimensional picture of your data, you can easily extract new, useful information, as well as respond quickly to business and customer needs.

As the number of such applications grows, so does the need to properly manage them. Not so long ago, Amazon announced that it was now possible to add resource tags to your applications in Amazon Kinesis Data Analytics, like other AWS resources. A tag is a key-value pair, where the value is an optional part. Tagging is a simple but effective way to manage AWS resources and organize data. Examples of possible tags:

Environment: Staging
Application: Application name
Project: Project name

Using tags, you can add more context to the application. In the case of Amazon Kinesis Data Analytics applications, tags can be used:
To define billing for specific Amazon Kinesis Data Analytics applications.
To control access to application resources.
For purposes defined by the user himself, you can define the functionality of the application based on the presence of custom tags.
More information about tags for Amazon Kinesis Data Analytics applications can be found here.

- Bulat Gayneev grbulat , Software Engineer in Provectus

Amazon S3 Path Deprecation Plan - The Rest of the Story

In one of the most popular S3 services from Amazon Web Services (AWS), the way to get files by specifying the path (style), for example, s3.amazons.com/usmanovbf/docs/Bulat_Usmanov_CV.pdf or with the region - s3-us-east-2.amazonaws.com/usmanovbf/docs/Bulat_Usmanov_CV.pdf , where usmanovbf is a batch, and /docs/Bulat_Usmanov_CV.pdf is the key to a file on this batch.

Preference will be given to a different method - using a virtual host (virtual-hosted style), for example, usmanovbf.s3.amazonaws.com/docs/Bulat_Usmanov_CV.pdf or also with the region - usmanovbf.s3-us-east-2.amazonaws. com / docs / Bulat_Usmanov_CV.pdf

The transition is expected to be made on September 30, 2020. Due to the openness of AWS engineers to the community, all path-style links created prior to this date will not be deleted. That is, they will remain fully working, just after this date it will be possible to use only the second method - the virtual-hosted style.

This change is dictated by two main reasons:
1. A more centralized model, which is accessing files using path-style, limits effective scaling, since all traffic comes to a small set of input points: third-level subdomains s3, s3-us-east-2, s3-us-east -1 and so on. For the same reason, it becomes inconvenient to work with the resolution of DNS names, with security, reflection of DDOS attacks.
Virtual-hosted style allows you to more flexibly control the flow of data thanks to the binding already to a separate subdomain-baket and to the region, for example, usmanovbf and s3-us-east-2 as in the example above.

2. Engineers from AWS are not standing still, and for the introduction of new functionality and abandonment of the old, they need to switch to the virtual-hosted style. For example, it is planned to abandon the old encryption methods.

For more information on migrating to a new way, you can find it on the AWS official blog.

- Bulat Usmanov usmanovbf , Software Engineer in Provectus

Learn more about new services and products from Amazon at AWS Dev Day Moscow!

#AWSDevDayMoscow is a one-day free conference for Machine Learning Engineers, Data Scientists, DevOps Engineers, Solution Architects, and Software Engineers who are interested in or are already working with AWS services.

Let's discuss the hottest topics in the field of cloud technologies with like-minded people and the AWS team very soon!

When: June 18
Where: Space "Spring"
Spartak lane 2c1, entrance number 7

check in

See you at AWS Dev Day Moscow!