Scribd
Upload
51 views

Redis Cluster Tutorial-6

This document discusses resharding a Redis cluster. Resharding involves moving hash slots from one set of nodes to another set. The document demonstrates resharding 1000 hash slots from all master nodes to one node using the redis-cli tool. While resharding, the example application running writes were unaffected. Finally, it discusses scripting resharding operations and improving the example application.

Uploaded by

Kajaruban Surendran
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
51 views

Redis Cluster Tutorial-6

This document discusses resharding a Redis cluster. Resharding involves moving hash slots from one set of nodes to another set. The document demonstrates resharding 1000 hash slots from all master nodes to one node using the redis-cli tool. While resharding, the example application running writes were unaffected. Finally, it discusses scripting resharding operations and improving the example application.

Uploaded by

Kajaruban Surendran
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 3

Normally writes are slowed down in order for the example application to be easier to

follow by humans.
Starting the application produces the following output:

ruby ./example.rb

^C (I stopped the program here)


This is not a very interesting program and we'll use a better one in a moment but we can
already see what happens during a resharding when the program is running.

Resharding the cluster


Now we are ready to try a cluster resharding. To do this please keep the example.rb
program running, so that you can see if there is some impact on the program running.
Also you may want to comment the sleep call in order to have some more serious write
load during resharding.
Resharding basically means to move hash slots from a set of nodes to another set of
nodes, and like cluster creation it is accomplished using the redis-cli utility.
To start a resharding just type:

redis-cli --cluster reshard 127.0.0.1:7000

You only need to specify a single node, redis-cli will find the other nodes automatically.
Currently redis-cli is only able to reshard with the administrator support, you can't just
say move 5% of slots from this node to the other one (but this is pretty trivial to
implement). So it starts with questions. The first is how much a big resharding do you
want to do:

How many slots do you want to move (from 1 to 16384)?

We can try to reshard 1000 hash slots, that should already contain a non trivial amount
of keys if the example is still running without the sleep call.
Then redis-cli needs to know what is the target of the resharding, that is, the node that
will receive the hash slots. I'll use the first master node, that is, 127.0.0.1:7000, but I
need to specify the Node ID of the instance. This was already printed in a list by redis-
cli, but I can always find the ID of a node with the following command if I need:

$ redis-cli -p 7000 cluster nodes | grep myself

97a3a64667477371c4479320d683e4c8db5858b1 :0 myself,master - 0 0 0

connected 0-5460

Ok so my target node is 97a3a64667477371c4479320d683e4c8db5858b1.


Now you'll get asked from what nodes you want to take those keys. I'll just type all in
order to take a bit of hash slots from all the other master nodes.
After the final confirmation you'll see a message for every slot that redis-cli is going to
move from a node to another, and a dot will be printed for every actual key moved from
one side to the other.
While the resharding is in progress you should be able to see your example program
running unaffected. You can stop and restart it multiple times during the resharding if
you want.
At the end of the resharding, you can test the health of the cluster with the following
command:

redis-cli --cluster check 127.0.0.1:7000

All the slots will be covered as usual, but this time the master at 127.0.0.1:7000 will
have more hash slots, something around 6461.

Scripting a resharding operation


Resharding can be performed automatically without the need to manually enter the
parameters in an interactive way. This is possible using a command line like the
following:

redis-cli --cluster reshard <host>:<port> --cluster-from <node-id> --cluster-to <node-

id> --cluster-slots <number of slots> --cluster-yes

This allows to build some automatism if you are likely to reshard often, however
currently there is no way for redis-cli to automatically rebalance the cluster checking the
distribution of keys across the cluster nodes and intelligently moving slots as needed.
This feature will be added in the future.

A more interesting example application


The example application we wrote early is not very good. It writes to the cluster in a
simple way without even checking if what was written is the right thing.
From our point of view the cluster receiving the writes could just always write the
key foo to 42 to every operation, and we would not notice at all.

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy