tencent cloud

Overview

Cluster is a resource dimension in TDMQ for Pulsar, and namespaces, topics, and role permissions of different clusters are completely isolated from each other. Each cluster has its own resource limits, such as the total number of topics and message retention period. It is common for the development, test, and production environments to use their respective dedicated clusters.

Clusters are divided into virtual clusters and professional clusters:

• Virtual cluster: Virtual computing and storage resources are used and automatically allocated based on usage. There are certain use limits. You don't need to pay for resources, and you can create up to 5 virtual clusters under each account.
• Professional cluster: Physical resources are exclusive, and data is secure. There are almost no use limits. Resource usage fees will be charged even if resources are idle.

Note：

• Professional cluster resources are unavailable currently. They can be applied for after the product is commercially launched. You will be notified by email and SMS one month in advance.
• Currently, clusters are available in multiple versions. For more information, see Cluster Version Updates.

TDMQ for Pulsar resource hierarchy

Directions

Creating a cluster

1. Log in to the TDMQ for Pulsar console and enter the Cluster Management page.
2. On the Cluster Management page, select the region and click Create Cluster to enter the Create Cluster window.
3. In the Create Cluster window, select the cluster type and set the cluster attributes:
   • Cluster Name: Set the name of the environment, which can contain up to 64 digits, letters, and special symbols (-_=:.).
   • Public Network Access: It is not enabled by default. To enable it, submit a ticket for application. We recommend you only enable this option for development and test clusters as it cannot be disabled once enabled.
   • Cluster Description: Enter the cluster description of up to 128 characters.
   • Resource Tag: Set a resource tag. For more information, see Managing Resource with Tag.
4. Click OK.
   

Note：

Each user can create up to 5 virtual clusters.

Subsequent steps

1. Get the access address to get the connection information of the server (only clusters on v2.6.1 require configuring an access point; for clusters on v2.7.1 or later, the access address can be copied directly).
2. Create a namespace as instructed in Namespace in the cluster.
3. Create a role as instructed in Role and Authentication in the cluster and grant it the production/consumption permissions of the namespace.
4. Create a topic as instructed in Topic Management in the namespace.
5. Write a demo as instructed in SDK Overview and configure the connection information and token for message production/consumption.

Viewing cluster details

On the Cluster Management list page, click the ID of the target cluster to enter the cluster details page, where you can view the following information:

• Cluster Statistics: This section displays the average message size, production speed, and consumption speed, the number of produced messages, and the accumulative storage duration in the selected time range.

  Note：

  The statistics feature is not supported for clusters on v2.6.x.

  Metric	Description
  Avg Message Size	Average size of message data (including message headers and bodies) in the selected time range.
  Avg Production Speed	Average number of messages produced to the cluster per second in the selected time range.
  Avg Consumption Speed	Average number of messages the cluster pushes to the client per second in the selected time range.
  Produced Messages	The number of messages produced to the cluster in the selected time range.
  Storage Duration	Total storage space used by message data as of the last time point of the selected time range (it changes only when the last time point changes).

• Cluster's basic information: Cluster name/ID, version, access address (available for clusters on v2.7.1 or later only), region, creation time, and description.
• Cluster configuration:
  

  Cluster Configuration	Configuration Description
  Max Production TPS Per Namespace	Maximum production TPS per namespace. If this value is exceeded, requests will be throttled.
  Max Consumption TPS Per Namespace	Maximum consumption TPS per namespace. If this value is exceeded, requests will be throttled.
  Max Production Bandwidth Per Namespace	Maximum production bandwidth per namespace.
  Max Consumption Bandwidth Per Namespace	Maximum consumption bandwidth per namespace.
  Max Namespaces	Maximum number of namespaces that can be created per cluster.
  Max Topics	Maximum number of topics that can be created per namespace.
  Message Retention Period	Maximum message retention period that can be configured. A shorter period can be configured at the namespace level.
  Max Message Storage	Maximum disk capacity used by message heap. After this value is exceeded, new messages cannot be produced (under normal circumstances, there should not be too many retained messages; if this is not the case, check whether the business is consuming messages normally).
  Max Message Delay	Maximum message consumption time delay.

Getting the access address

On the Cluster Management list page, click Access Address in the Operation column of the target cluster. You can get the access address in the following ways:

Deleting a cluster

You can delete a created cluster in the following steps:

1. On the Cluster Management list page, click Delete in the Operation column of the target cluster.
2. In the deletion confirmation pop-up window, click Delete.