Labels

Aws (32) MySQL (20) Aurora (12) Rds (7) DynamoDB (6) Cloudformation (4) Python3 (4) Unix (3) MongoDB (1)

Friday, 29 April 2022

Aurora instance local storage in nutshell

 This article will provide an insight into the local storage of each instance of the Aurora cluster.

Aurora instances have two types of storage:
1. Storage for persistent data, it is a cluster level and it increases automatically when more space is required.
2. Local storage based on the instance class. This storage can be changed only by moving to a larger DB instance class. Aurora uses local storage for storing error logs, non-innoDB temporary files, general logs, and slow logs. 

Monday, 11 April 2022

How to optimize your MySQL server running on a Ec2

 As a database engineer, I need to perform some DBA tasks, and accessing the desk and running some old-style scripts is still required. Besides the best solution if you are living in the cloud is to use some compute instances. 

AWS EC2 comes in handy, however, to get the best out of your instance, you should tune your EBS volume and your instance to increase speed, reliability and fault-tolerant

Sunday, 10 April 2022

Ec2 lifecycle hook

Lifecycle hooks allow you to control what happens when your Amazon EC2 instances are launched and terminated as you scale out and in.

Saturday, 9 April 2022

AWS CLI tips #1

 Using the query parameter to filter the output.

Quering using the JMESPath syntax to create expressions to filter out your output.


filter by tag using query

aws rds describe-db-instances --query "DBInstances[0].[DBInstanceIdentifier,TagList[?Key=='Name'].Value]"

rds with their name tag

aws rds describe-db-instances --query "DBInstances[].[DBInstanceIdentifier,TagList[?Key=='Name'].Value]"  --output text | awk 'NR%2{printf $0" ";next;}1'

References link

Friday, 8 April 2022

Elasticache Redis & Memcache auto-failover and Mitigations

 AWS provides the cache service called Elasticache. Two different technologies can be used the Redis and the Memcache. Both are robust solutions and they both have their advantages and disadvantages.

The solution needs to be resilient and highly available and as fast as possible. Besides an important feature is how they handle the failure of the system. Failover is a key factor to avoid any big disruption that weighs on the decision-making.

Redis and Memcache manage the failure differently and we will look at them in this article.

Friday, 4 March 2022

Elasticache Memcache stress test

 These stress test results are useful to figure out how much workload a single Memcached cluster node can cope with.

A fleet of Ec2 has been used to split the traffic coming toward the cache cluster.

Settings:

  • Memcache 1.4.14
  • Max Memory Size 1.3GiB
  • Pointer Size 64bit
  • Elasticache instance class cache.t3.small

Friday, 21 January 2022

Monitoring a Mamcached server

 As a database administrator, you time to time want to monitor or to do any maintenance on a Memcached server. As long as the cache works, we consider the server in a good state and is there nothing that needs to be done. 

However, it is always a good practice to review the server used to be able to understand if the cache is suffering from a lack of resources or if the cache is oversized based on the workload.

There aren't any official Memcached tools that pull out stats continuously. There are a few choices between using third-party clients or developing a wrapped script using telnet.