tencent cloud

PrevNext

Feedback

search by keyword

Recent Pages

Documentation
TencentDB for Redis
    Documentation
    Download PDF

    Migration with redis-port

    Last updated: 2023-04-18 11:29:06
    Download PDF

      Tools

      redis-port (Linux 64-bit) is a collection of open-source tools mainly used for database sync, data import, and data export between Redis nodes and supports cross-version Redis data migration. The toolkit contains the following tools:
      redis-sync: It is used for data migration between Redis instances.
      redis-restore: It supports importing Redis backup files (in RDB format) to the specified Redis instance.
      redis-dump: It supports backing up Redis data in RDB format.
      redis-decode: It supports decoding Redis RDB backup files into readable files.

      Compatible Versions

      Source instances on Redis 2.8, 3.0, and 4.0 are supported.
      Target instances on Redis 2.8, 3.0, 3.2, and 4.0 and in all editions of TencentDB are supported, including Redis Memory Edition and CKV Edition.

      Online Migration with redis-sync

      How it works

      redis-sync has two modules which are simulated as replication nodes to continuously sync data from the source instance and translate the replicated data into write commands to update the target instance.
      Data replication is done in two phases: full sync and incremental sync.
      Notes:
      The database capacity of the target instance should be greater than that of the source instance; otherwise, the migration will fail.
      If migration is interrupted for causes such as network failure, you need to empty the target instance first and then perform migration again; otherwise, there may be dirty data.
      The progress of migration is displayed in the log, where "sync: rdb = 9063349 - [100.00%]" indicates that full data has been synced and incremental data sync is in progress, while "speed=(0/0,0/0,0)" indicates that incremental data has been synced.
      You can stop data sync and migration by pressing Ctrl + C or through other means.

      Parameter description

      -n: Number of concurrent write tasks. We recommend that you leave it empty or set it to CPU core quantity * 2.
      -m: Source instance address in the format of "password"@ip:port or ip:port (in password-free mode).
      -t: Target instance address in the format of "password"@ip:port or ip:port (in password-free mode).
      --tmpfile=FILE: Temporary filename.
      --tmpfile-size=SIZE: Maximum size of the temporary file.
      --help: Help command.

      Sample

      ./redis-sync -m 127.0.0.1:6379 -t "xxx2018"@10.0.5.8:6379

      Output log

      [root@VM_5_16_centos bin]# ./redis-sync -m 127.0.0.1:6379 -t "xxx2018"@10.0.5.8:6379
      2019/02/21 09:56:00 sync.go:76: [INFO] sync: master = "127.0.0.1:6379", target = "xxx2018@10.0.5.8:6379"
      2019/02/21 09:56:01 sync.go:103: [INFO] +
      2019/02/21 09:56:01 sync.go:109: [INFO] sync: runid = "f63e2ad58e2fcc15c8cc122f15778389a012c1a4", offset = 18576271
      2019/02/21 09:56:01 sync.go:110: [INFO] sync: rdb file = 9063349 (8.64mb)
      2019/02/21 09:56:01 sync.go:208: [INFO] sync: (r/f,s/f,s) = (read,rdb.forward,rdb.skip/rdb.forward,rdb.skip)
      2019/02/21 09:56:02 sync.go:250: [INFO] sync: rdb = 9063349 - [100.00%] (r/f,s/f,s)=(1703936/71754,0/0,0) ~ (1.62mb/-,-/-,-) ~ speed=(1.62mb/71754,0/0,0)
      2019/02/21 09:56:03 sync.go:250: [INFO] sync: rdb = 9063349 - [100.00%] (r/f,s/f,s)=(3407872/153850,0/0,0) ~ (3.25mb/-,-/-,-) ~ speed=(1.62mb/82096,0/0,0)
      2019/02/21 09:57:54 sync.go:250: [INFO] sync: rdb = 9063349 - [100.00%] (r/f,s/f,s)=(80487526/411969,0/1587212,0) ~  (76.76mb/-,-/-,-) ~ speed=(0/0,0/0,0)

      Data Import with redis-restore

      redis-restore supports importing Redis backup files (in RDB format) on Redis 2.8, 3.0, 3.2, and 4.0 as well as AOF files into the specified Redis instance.

      Parameter description

      -n: Number of concurrent write tasks. We recommend that you leave it empty or set it to CPU core quantity * 2.
      -i: RDB file path.
      -t: Target instance address in the format of "password"@ip:port or ip:port (in password-free mode).
      -a: AOF file path.
      --db=DB: Database ID of the target Redis instance for backup file import, which should be the same as that of the source instance.
      --unixtime-in-milliseconds=EXPR: The key expiration time value is updated in the process of data import.
      --help: Help command.

      Sample

      ./redis-restore dump.rdb -t 127.0.0.1:6379

      Data Backup with redis-dump

      redis-dump supports backing up Redis data into RDB files and incremental data into AOF files.
      Notes
      TencentDB for Redis currently does not support backing up data through redis-dump. You can back up and download data in the TencentDB for Redis console or through APIs. However, you can use redis-dump to back up your self-built Redis instances.

      Parameter description

      -n: Number of concurrent write tasks. We recommend that you leave it empty or set it to CPU core quantity * 2.
      -m: Redis instance address in the format of "password"@ip:port or ip:port (in password-free mode).
      -o: Path of the output RDB file.
      -a: Path to the outputted AOF file.
      --help: Help command.

      Sample

      ./redis-dump  127.0.0.1:6379 -o dump.rdb
      
      Contact Us

      Contact our sales team or business advisors to help your business.

      Contact Us
      Technical Support

      Open a ticket if you're looking for further assistance. Our Ticket is 7x24 avaliable.

      Submit a Ticket
      7x24 Phone Support
      Copyright © 2013-2024 Tencent Cloud. All Rights Reserved.
      Privacy PolicyLegalCookie Policy