Aws DynamoDB support for transactions

Transactions provide atomicity, consistency, isolation, and durability (ACID) in DynamoDB, across one or more tables within a single AWS account and region

Pricing for transactions is based on the sizes of the items in the transaction.

Two new DynamoDB operations have been introduced for handling transactions

MySQL : InnoDB Transparent Tablespace Encryption (5.7)

article official-doc

Tablespace encryption uses a two tier encryption key architecture, consisting of

• a master encryption key and
• a tablespace keys.

When a tablespace is encrypted, a tablespace key is encrypted and stored in the tablespace header.

The decrypted version of a tablespace key never changes, but the master encryption key can be changed as required. This action is referred to as master key rotation.

A secure and robust encryption key management solution is critical for security and for compliance with various security standards

Tablespace encryption supports the Advanced Encryption Standard (AES) block-based encryption algorithm.

DynamoDB backup and restore

https://aws.amazon.com/dynamodb/backup-restore/

• On-demand backup allows you to create full backups of your Amazon DynamoDB table for data archiving, helping you meet your corporate and governmental regulatory requirements.
• Point-in-time recovery (PITR) provides continuous backups of your DynamoDB table data.
• for the last 35 days until you explicitly turn it off.
• Fully Managed Backups are automatically encrypted, cataloged, easily discoverable, and retained until you explicitly delete them.
• Fast and Scalable You can enable PITR or create as many backups for tables of any size, and retain those backups as long as you need them
• No Performance Impact PITR, backup, and restore do not consume any table provisioned capacity.
• Additional charges enabling the backuphttps://docs.aws.amazon.com/amazondynamodb/latest/developerguide/BackupRestore.html
• Backup and restore actions execute with zero impact on table performance or availability.

Essential Rsync guide

sync is a program that behaves in much the same way that rcp does, but has many more options and uses the rsync remote-update protocol to greatly speed up file transfers when the destination file already exists.

Mount Volume and formatting the disk

Add the disk to the server (can be done by EBS Volume or VirtualBox or others)

Aurora DB Cluster and backtrack feature

Aurora DB Cluster and backtrack

https://aws.amazon.com/blogs/aws/amazon-aurora-backtrack-turn-back-time/

You can backtrack a DB cluster to a specific time, without restoring data from a backup.

Overview of Backtracking Backtracking "rewinds" the DB cluster to the time you specify. Backtracking is not a replacement for backing up your DB cluster so that you can restore it to a point in time.

mysql Server-Side Help

if you provide an argument to the help command, mysql uses it as a search string to access server-side help from the contents of the MySQL Reference Manual.

https://mysqlserverteam.com/getting-help-in-mysql-shell/ https://dev.mysql.com/doc/refman/5.7/en/mysql-server-side-help.html

TSDB Time series database

A Time Series Database (TSDB) is a database optimized for time-stamped or time series data. Time series are simply measurements or events that are tracked, monitored, downsampled, and aggregated over time.

A Time Series Database is built specifically for handling metrics and events or measurements that are time-stamped.

https://www.influxdata.com/time-series-database/

Selects on Aurora Mysql cluster in Waiting for table level lock

Running a load tests, I found some select statements in an weird "Waiting for table level lock" state. I did an investigation and wrote a conclusion on it.

Issue

Waiting for table level lock | SELECT pad FROM sbtest4 WHERE id=50405|

| 3073 | sb_user    | 10.112.17.167:36999 | sbtest               | Query   |    0 | Waiting for table level lock | SELECT pad FROM sbtest4 WHERE id=50405|
| 3074 | sb_user    | 10.112.17.167:36993 | sbtest               | Query   |    0 | Waiting for table level lock | SELECT pad FROM sbtest4 WHERE id=50376|
| 3075 | sb_user    | 10.112.17.167:37000 | sbtest               | Sleep   |    0 | cleaned up                   | NULL                                                                          

Sysbench 1.0 for Mysql tests

https://github.com/akopytov/sysbench

Sysbench 1.0.15 - for Mysql

A cheat-sheet to use for a quick implementation of Mysql stress tests.

 Installing

sudo apt-get install automake build-essential libtool libmysqlclient-dev -y
curl -s https://packagecloud.io/install/repositories/akopytov/sysbench/script.deb.sh | sudo bash # Debian/Ubuntu
sudo apt -y install sysbench

default foulder is /usr/share/sysbench/

sysbench --version sysbench 1.0.15

Point-in-Time Recovery for DynamoDB

link link-2

Amazon DynamoDB point-in-time recovery (PITR) provides automatic backups of your DynamoDB table data. This section provides an overview of how the process works in DynamoDB.

After you enable point-in-time recovery, you can restore to any point time within EarliestRestorableDateTime and LatestRestorableDateTime. LatestRestorableDateTime is typically 5 minutes before the current time.

Installing Mysql 5.7

Step by Step to install Mysql 5.7 on Ubuntu 14.04

https://dev.mysql.com/doc/refman/5.7/en/installing.html

• Operation System Ubuntu 64bit
• Distributor ID Ubuntu
• Description Ubuntu 14.04.5 LTS
• Release 14.04
• Codename trusty
• Mysql Version 5.7
• machine M4.large on an EBS Volume
• Distribution format binary

Cloudformation and DependsOn attribute

With the DependsOn attribute you can specify that the creation of a specific resource follows another.

Aurora - testing ReplicationSourceIdentifier & SnapshotIdentifier

I continuosly use the Rds Aurora and I tend to manage all resources via cloudformation service. This time I planned to test how to promote a cross region read replica due to a failer of the primary cluster. I'm not going to explore how to do the disaster recovery but I'm testing how the two key properties used for the CRRR in the DB cluster CFN resource can be manage and if it is possible to change them afterwards.