Redis (Re<\/strong>mote\u00a0Di<\/strong>ctionary\u00a0S<\/strong>erver) is one of the NoSQL-style database management systems.<\/p>\n Used to store structured data as key-value on RAM with high performance.<\/p>\n Can be used as a database, cache or message broker. Redis can also be used as a database stored in RAM to speed up processing.<\/p>\n Redis currently offers response times at speeds of less than a millisecond, as Redis allows you to store on your RAM faster than when storing on hard drives, about 150,000 times faster than hdd access and 500 times faster than SSD access.<\/p>\n Good use in linking microservices together.<\/p>\n Redis has no tables. Redis stores data as a key-value.<\/p>\n Redis data types used to store value: LIST<\/strong>: The associated list of strings. Redis supports push, pop operations from both sides of the list, trim based on offset, read 1 or more items of the list, search and delete values.<\/p>\n SET<\/strong>: Set of strings (not sorted). Redis supports operations that add, read, delete each element, check the appearance of the element in the set. Redis also supports set operations, including intersect\/union\/difference.<\/p>\n HASH<\/strong>: Stores hash tables of key-value pairs, in which keys are randomly sorted, in no order at all. Redis supports operations to add, read, delete each element individually, as well as read all values.<\/p>\n ZSET<\/strong>\u00a0(sorted set): Is a list, in which each element is a map of 1 string (member) and 1 floating-point number (score), the list is sorted by this score. Redis supports adding, reading, deleting each element, taking out elements based on the range of the score or string.<\/p>\n Redis uses a primary-replica architecture and supports asynchronous replication, data can be copied to many different servers. This makes for improved read performance (as requests can be split between servers) and faster recovery when the main server experiences an outage. For maintenance, Redis supports point-in-time backups (copying Redis data to disk).<\/p>\n Redis stores data on RAM, so reading and writing data is much faster than on a hard drive.<\/p>\n But also because all the data on RAM will be lost when turning off server, However, one solution was to use Redis Persistence.<\/p>\n Although working with key-value data stored on RAM, Redis still needs to store data on the hard drive to ensure data integrity when something goes wrong (the server is powered off) as well as recreate the dataset when restarting the server. Redis provides 2 main methods for backing up data to hard drives, namely RDB and AOF.<\/p>\n RDB (Redis Database)<\/strong><\/em><\/p>\n RDB creates and backs up a snapshot of the DB to the hard drive every certain period of time.<\/p>\n Advantages of RDB<\/em> RDB helps optimize Redis performance.\u00a0The main Redis process will only do the work on RAM, including the basic operations required from the client side such as add\/read\/delete, while a child process will take care of disk I\/O operations. .\u00a0This organization helps maximize Redis performance.<\/p>\n Disadvantages of RDB<\/em> RDB needs to use fork to create child processes for disk I\/O operations.\u00a0In case the data is too large, the fork process can be time consuming and the server will not be able to respond to the request from the client for several milliseconds or even 1 second depending on the amount of data and CPU performance.<\/p>\n AOF (Append Only File)<\/strong><\/em><\/p>\n AOF saves all write operations received by the server, these operations will be rerun when restarting the server or resetting the original dataset.<\/p>\n Advantages of AOF<\/em> Redis logs AOF in an append-to-end of an existing file, so a seek process on an existing file is unnecessary.\u00a0Even if the log ends with a half-written command for some reason (disk is full or other reasons), the redis-check-aof tool can still fix it easily.<\/p>\n Redis provides a background process, allowing to record AOF files when the file size is too large.\u00a0The rewrite is completely safe because while Redis continues to add to the old file, a completely new file is created with the minimal set of operations required to create the current dataset, and when this second file is ready, Redis transfers two files and starts adding a new file.<\/p>\n Disadvantages of AOF<\/em> AOF may be slower than RDB depending on fsync policy.\u00a0Generally with fsync set to second, performance is still very high, and with fsync disabled it will be exactly as fast as RDB.\u00a0RDB can still provide more guarantees about maximum latency even in case of very large write load.<\/p>\n Compared to a traditional on-disk database in which most tasks require repeated access to the drive, Redis only needs to get the calculated result. Therefore, Redis performance is remarkably fast for conventional read or write tasks along with low latency and high throughput.<\/p>\n Supports more operations and 10x faster response times. The average read and write operations take less than a millisecond and support millions of operations per second.<\/p>\n Caching<\/p>\n Save the pending task list<\/p>\n Game leaderboards<\/p>\n Session archive<\/p>\n Machine Learning<\/p>\n Real-time analytics<\/p>\n \u2026<\/p>\n The Redis Stack was created to enable developers to build real-time applications with a backend data platform that can reliably handle requests in milliseconds by extending Redis with data models and data processing tools.<\/p>\n Redis Stack has 5 module packages:\u00a0RedisJSON<\/strong>,\u00a0RediSearch<\/strong>,\u00a0RedisGraph<\/strong>,\u00a0RedisTimeSeries<\/strong>\u00a0and\u00a0RedisBloom<\/strong>.<\/p>\n In addition, the Redis Stack also\u00a0includes RedisInsight<\/strong>, a visualization tool for understanding and optimizing data.<\/p>\n RedisInsight interface<\/em><\/p>\n To easily understand how the Redis Stack works, we will start to learn how to use 2 modules\u00a0RedisJSON<\/strong>\u00a0and\u00a0RediSearch<\/strong>\u00a0with\u00a0the node-redis<\/strong>\u00a0library.<\/p>\n Install\u00a0node-redis<\/strong>\u00a0library<\/p>\n Connect to Redis Server<\/p>\n RedisJSON is a Redis module that provides JSON support in Redis. RedisJSON allows you to store, update, and retrieve JSON values in Redis just like you would with any other Redis data type. RedisJSON also works simultaneously with RediSearch to allow you to index and query your JSON documents.<\/p>\n The document is stored as binary data in a tree structure, which allows quick access to child elements.<\/span><\/p>\n Storing JSON Documents in Redis<\/strong><\/p>\n The Here, we’ll store a JSON document in the root of the Redis key “ await client.json.set(‘noderedis:users’, ‘$’, {<\/span><\/p>\n Retrieving JSON Documents from Redis<\/strong><\/p>\n RediSearch is a Redis module that provides query, sub-indexing, and search capabilities for Redis. To use RediSearch, you first declare indexes on your Redis data. You can then use the RediSearch query language to query that data.<\/p>\n RediSearch uses compressed, inverted indexes to index quickly with low memory capacity.<\/p>\n RediSearch provides accurate phrase comparison, fuzzy search (search for “approximation”), numeric filtering,…<\/p>\n Creating an Index<\/strong><\/p>\n Before we can perform any searches, we need to tell RediSearch how to index our data, and which Redis keys to find that data in. The\u00a0FT.CREATE\u00a0<\/strong>command creates a RediSearch index. Here’s how to use it to create an index we’ll call\u00a0 Once we’ve created an index, and added some data to Redis hashes whose keys begin with the prefix\u00a0 Add a document<\/strong><\/p>\n Use the\u00a0HSET<\/strong>\u00a0command to create a new hash document and add it to the index:<\/p>\n Querying the Index<\/strong><\/p>\n To search the index for documents containing specific words, use\u00a0FT. SEARCH<\/strong><\/p>\n Creating an Index<\/strong><\/p>\n To create an index for a JSON document<\/p>\n Querying the Index<\/strong><\/p>\n We will use the Redis is an open source software package with many advantages, so it is widely used in the software development process.<\/p>\n It’s super fast, easy to set up and use, and supports flexible data structures.\u00a0Redis is a great choice when it comes to caching data or applications with real-time requirements.<\/p>\n With the same mechanism of storing data on RAM, compared to Memcached\u00a0,<\/strong>\u00a0Redis supports more data types and more operations on the server side.\u00a0There is also a default mechanism to back up data to disk while Memcached does not have this mechanism.\u00a0So if you want your system to be cacheable but with complex data structures, then Redis will be a better choice.<\/p>\n https:\/\/redis.io\/docs\/<\/a><\/p>\n https:\/\/redis.js.org\/<\/a><\/p>\nFeatures of Redis<\/h3>\n
Data model<\/h5>\n
\nSTRING<\/strong>: Can be string, integer, or float. Redis can work with both strings, individual parts of the string, as well as increase\/ decrease the value of the integer, float.<\/p>\nReplication \u2013 Persistence:<\/h5>\n
In-Memory Data Store<\/h5>\n
Persistent redis<\/h5>\n
\nRDB allows users to save different versions of the DB, which is very convenient when something goes wrong.<\/p>\n
\nUsually users will set up to create RDB snapshot every 5 minutes (or more).\u00a0Therefore, in the event of a problem, Redis cannot operate, data in the last minutes will be lost.<\/p>\n
\nAOF Redis ensures that the dataset is more stable.\u00a0Users can configure Redis to log once a second or every query.<\/p>\n
\nAOF files are often larger than equivalent RDB files for the same data set.<\/p>\nPerformance<\/h3>\n
![\"\"](\"https:\/\/s3-ap-southeast-1.amazonaws.com\/homepage-media\/wp-content\/uploads\/2022\/08\/05151236\/nosql-benchmark-200000-300x208.png\")
<\/p>\nCommon use cases of Redis<\/h3>\n
Redis Stack<\/h2>\n
![\"\"](\"https:\/\/s3-ap-southeast-1.amazonaws.com\/homepage-media\/wp-content\/uploads\/2022\/08\/10104316\/RedisInsight-300x160.png\")
<\/p>\nnpm install redis<\/pre>\n
import { createClient } from 'redis';\r\n\r\nconst client = createClient<\/span>(<\/span>{<\/span>\r\n url<\/span>: 'redis[s]:\/\/[[username][:password]@][host][:port][\/db-number]'<\/span>\r\n}<\/span>)<\/span>;\r\n\r\n<\/span>client.on('error', (err) => console.log('Redis Client Error', err));\r\n\r\nawait client.connect();<\/pre>\nRedisJSON<\/h3>\n
JSON.SET<\/code>\u00a0command stores a JSON value at a given JSON Path in a Redis key.<\/p>\nusers<\/code>“:<\/p>\n \u00a0 name: 'Alice',\r\n \u00a0 age: 29\r\n});<\/pre>\n<\/div>\n
const results = await client.json.get('noderedis:users');<\/pre>\nresults<\/code>\u00a0will contain the following:<\/p>\n{ name: 'Alice', age: 29 }<\/pre>\n<\/div>\n<\/div>\n<\/div>\nRediSearch<\/h3>\n
Indexing and Querying Data in Redis Hashes<\/span><\/h6>\n
idx:animals<\/code>\u00a0where we want to index hashes containing\u00a0name<\/code>,\u00a0species<\/code>\u00a0and\u00a0age<\/code>\u00a0fields, and whose key names in Redis begin with the prefix\u00a0noderedis:animals<\/code>:<\/p>\nawait client.ft.create('idx:animals', {\r\n name: {\r\n type: SchemaFieldTypes.TEXT,\r\n sortable: true\r\n },\r\n species: SchemaFieldTypes.TAG,\r\n age: SchemaFieldTypes.NUMERIC\r\n }, {\r\n ON: 'HASH',\r\n PREFIX: 'noderedis:animals'\r\n }\r\n);<\/pre>\nnoderedis:animals<\/code><\/p>\nawait client.hSet('noderedis:animals:1', {name: 'Fluffy', species: 'cat', age: 3});\r\nawait client.hSet('noderedis:animals:2', {name: 'Ginger', species: 'dog', age: 4});<\/pre>\nconst results = await client.ft.search(\r\n 'idx:animals', \r\n '@species:{dog}',\r\n {\r\n SORTBY: {\r\n BY: 'age',\r\n DIRECTION: 'DESC' \/\/ or 'ASC' (default if DIRECTION is not present)\r\n }\r\n }\r\n );<\/pre>\nresults<\/code>\u00a0will look like this:<\/p>\n{<\/span>\r\n total<\/span>: 1,<\/span>\r\n documents<\/span>: [<\/span>\r\n {<\/span>\r\n id<\/span>: 'noderedis:animals:2'<\/span>,<\/span>\r\n value<\/span>: {<\/span>\r\n name<\/span>: 'Ginger'<\/span>,<\/span>\r\n species<\/span>: 'dog'<\/span>,<\/span>\r\n age<\/span>: '4'<\/span>\r\n }<\/span>\r\n }\r\n<\/span> ]<\/span>\r\n}<\/span><\/pre>\nIndexing and Querying Data with RedisJSON<\/h6>\n
await client.ft.create('idx:users', {\r\n \u00a0 '$.name': {\r\n \u00a0 \u00a0 \u00a0 type: SchemaFieldTypes.TEXT,\r\n \u00a0 \u00a0 \u00a0 SORTABLE: 'UNF'\r\n \u00a0 },\r\n \u00a0 '$.age': {\r\n \u00a0 \u00a0 \u00a0 type: SchemaFieldTypes.NUMERIC,\r\n \u00a0 \u00a0 \u00a0 AS: 'age'\r\n \u00a0 },\r\n}, {\r\n \u00a0 ON: 'JSON',\r\n \u00a0 PREFIX: 'noderedis:users'\r\n});<\/pre>\nFT.SEARCH<\/code> command and\u00a0RediSearch query language.\u00a0For example, a query to find users under the age of 30:<\/span><\/p>\nconst results = await<\/span> client<\/span>.<\/span>ft<\/span>.<\/span>search<\/span>(<\/span>'idx:users'<\/span>,<\/span> '@age:[0 30]'<\/span>)<\/span>;<\/span><\/pre>\n<\/div>\n<\/div>\nresults<\/code> data returned:<\/p>\n{\r\n \"total\": 1,\r\n \"documents\": [\r\n {\r\n \"id\": \"noderedis:users\",\r\n \"value\": {\r\n \"name\": \"Alice\",\r\n \"age\": 29\r\n }\r\n }\r\n ]\r\n}<\/pre>\nConclusion<\/h2>\n
References<\/h2>\n