DynamoDB Optimistic vs Pessimistic Locking [The Ultimate Guide]
Written by Lakindu Hewawasam
Published on March 13th, 2022
Time to 10x your DynamoDB productivity with Dynobase [learn more]
Introduction to DynamoDB Locking
If you want to store application data in AWS, the go-to service is DynamoDB. It is easy to set up and auto-scales to serve thousands of requests as required. However, one common challenge that comes along the way is concurrency handling.
Without concurrency handling, it is likely to experience data loss as the changes from one user may override the other or affect the final calculations. Therefore, it is crucial to handle cases like this. Luckily, DynamoDB provides both Optimistic and Pessimistic Locking to solve this problem.
What is Optimistic Locking?
Optimistic Locking is a locking strategy offered by DynamoDB to detect whether a record is modified prior to updating it. A typical example would be when saving a record you have queried into the frontend, where no one else has modified it before you save your changes.
It ensures that the data item present at the client side is the same in the DynamoDB table. It prevents your changes from being accidentally overridden by others and vice versa.
How does Optimistic Locking work?
With Optimistic Locking, there is always one attribute in your DynamoDB table that will act as a "version number." It can be a nano-id, an integer, or a timestamp. The version number associated with the record must also be sent when clients request data.
Whenever the client modifies the data item, the version number present on the client side must be the same as the item's version number present in the table item. If it is the same, it means that no other user has changed the record, allowing the write to go through. However, if the version numbers are different, it's likely that another user has already updated the record, causing DynamoDB to reject your write by throwing the exception -
ConditionalCheckFailedException. You can retrieve the item again (with newly updated data) and retry your update when this happens.
How to use Optimistic Locking?
To use Optimistic Locking in DynamoDB, you need to implement Conditional Write in your code. Conditional Write is an expression used for
update operations that test each record's version number. If the conditional check passes, the operation is allowed, else it fails.
To implement a Conditional Write, include the
ConditionExpression to test the version number in your
For this walkthrough, I will use Node.JS and the AWS Node.JS SDK.
Let's first create a table in DynamoDB, to begin with.
Let's insert one record into the table. When inserting, include your attribute that acts as the version number. For this, I will use the attribute "
updatedAt" as my version number for the record.
Next, let's include a conditional write and update the record we created above by intentionally passing an old value for
The snippet above utilizes Optimistic Concurrency with
ConditionExpression. The expression checks if the value present in the attribute "
updatedAt" in the table equals the value currently at hand. No other user has updated the record if these two are the same. But since we intentionally made the record look stale, we get the output shown below as the version number in the table is not the same as on hand.
When DynamoDB throws the error -
ConditionalCheckFailedException, Optimistic Concurrency is in action.
To successfully perform an update, the version number in the client and database must be the same.
The snippet shown above modifies the initial ConditionalExpression by using the version number the same as the one in the database (
ConditionExpression: "#updatedAt = :updatedAtHand)".
When the updated code gets executed, it runs with no errors as the client's object is the same record present in the database.
Make sure to update the version number when a successful write occurs to the record in the database. The snippet above highlights this process as it updates the value ":
newChangeMadeAt" with the current time. It ensures that clients' future requests containing the old version get rejected by DynamoDB.
Benefits of Optimistic Locking
Using Optimistic Locking has several benefits:
- It ensures that stale data does not get edited in your application.
- It notifies when DynamoDB detects that you have an old version of a record.
- It does not require you to enforce a lock on the actual database resource, meaning faster.
What is Pessimistic Locking?
Pessimistic Locking is another strategy used by DynamoDB to prevent concurrent updates to a particular row. While Optimistic Locking sent version numbers to the client, Pessimistic Locking aims to avoid simultaneous updates from the database without maintaining version numbers.
How does Pessimistic Locking work?
Most database servers obtain a lock when a transaction starts and only release the lock after finishing the transaction. However, DynamoDB does this a bit differently. It does not lock the data under consideration. Instead, DynamoDB utilizes Transactions to identify changes that other threads made to the data under review, and if a change gets detected, DynamoDB cancels the transaction and throws an error. It helps perform atomic operations concurrently while maintaining data integrity. In addition, it ensures that the client always reads and updates the latest version.
How to use Pessimistic Locking?
DyanamoDB offers a Transact Write API that helps implement DynamoDB's version of Pessimistic Locking. When used, DynamoDB does not lock the items that are getting processed, but it monitors the items, and if another thread modifies the data, the entire transaction fails due to the data change and rolls back the data.
To use this approach in DynamoDB, we use the method -
Let us continue with the sample Node.JS project used above to use the Transact Write API.
TransactWrite method looks as shown below.
The method accepts an object consisting of
TransactItems. In addition, it accepts an array of modification objects, including "
Delete," and "
Update (used above)." It is also important to note that DynamoDB supports a maximum of 25 items per transaction.
Inside the "
Update" object, you can place the items to execute in the transaction. The snippet shown below highlights this.
The output for the snippet above is shown below.
In the code snippet above, the note gets updated in a transaction where its
updatedAt are modified. While this occurs, if another thread modifies its data, the transaction gets canceled and is rolled back.
Another important note is that you can include many data items to modify across multiple tables in transactions. Therefore, if one item in the transaction gets modified by another thread, the entire transaction is canceled and rolled back. This approach is called the "All-or-nothing" approach, as all data made in the transaction get rolled back in case one fails.
Benefits of Pessimistic Locking
- It allows you to perform updates across multiple tables, with rollbacks occurring when one item in the transaction gets modified.
- All changes are atomic.
- You prevent conflicts entirely from occurring, meaning that you do not have to deal with them.
Optimistic vs. Pessimistic Locking - What should you use?
Optimistic Locking vs. Pessimistic Locking
First, let us look at the main difference between Optimistic and Pessimistic Locking in DynamoDB.
- DynamoDB allows the update only if the client has the latest version at hand.
- It can provide fast concurrent access but occasionally throw an error when a version mismatch is detected.
- It assumes that concurrent access to data items is rare.
- DynamoDB allows multiple threads to update the item. However, when a transaction detects that another thread has already modified the data, it aborts the transaction and rolls the data back.
- It monitors other threads making changes to the data. Therefore, it has a higher performance overhead than Optimistic Locking.
- It assumes that data received is accessed and modified concurrently at a high frequency.
What should you use?
There is no right or wrong concurrency control approach. It depends on the use case. But, here are some guidelines that may help you determine the right concurrency control approach for you.
You may use Optimistic Locking if:
- Your data is updated concurrently at a low frequency.
- Your data is mainly read and not updated frequently.
You may use Pessimistic Locking if:
- Your data is updated concurrently at a high frequency.
- Your data gets updated across multiple tables. This way, even if another thread modifies one data item in your transaction, all items get rolled back.
- Your data gets read and updated frequently by many users.
This article provided a comparison of Optimistic and Pessimistic Locking in DynamoDB. It also discussed when to use either of these.
I hope this article helps you select the appropriate concurrency control for your use case so that your application data maintains its integrity.
The code used in the article is accessible in my GitHub repository.
Thank you for reading.
Does DynamoDB have Locking by default?
No. DynamoDB does not use any locking by default. Therefore, when you start using DynamoDB, implement locking to maintain data integrity.
© 2022 Dynobase