产品概述
基本概念
集群架构
产品优势
应用场景
Exactly-Once 消费语义。CREAE FILE 命令上传到 Plao 中，并且 catalog 名称为 kafka。CREATE FILE 命令的具体帮助可以参见 CREATE FILE 命令手册。这里给出示例：CREATE FILE "ca.pem" PROPERTIES("url" = "https://example_url/kafka-key/ca.pem", "catalog" = "kafka");CREATE FILE "client.key" PROPERTIES("url" = "https://example_urlkafka-key/client.key", "catalog" = "kafka");CREATE FILE "client.pem" PROPERTIES("url" = "https://example_url/kafka-key/client.pem", "catalog" = "kafka");
CREATE ROUTINE LOAD demo.my_first_routine_load_job ON test_1COLUMNS TERMINATED BY ","PROPERTIES("max_batch_interval" = "20","max_batch_rows" = "300000","max_batch_size" = "209715200",)FROM KAFKA("kafka_broker_list" = "broker1:9092,broker2:9092,broker3:9092","kafka_topic" = "my_topic","property.group.id" = "xxx","property.client.id" = "xxx","property.kafka_default_offsets" = "OFFSET_BEGINNING");
max_batch_interval/max_batch_rows/max_batch_size 用于控制一个子任务的运行周期。一个子任务的运行周期由最长运行时间、最多消费行数和最大消费数据量共同决定。CREATE ROUTINE LOAD demo.my_first_routine_load_job ON test_1COLUMNS TERMINATED BY ",",PROPERTIES("max_batch_interval" = "20","max_batch_rows" = "300000","max_batch_size" = "209715200",)FROM KAFKA("kafka_broker_list"= "broker1:9091,broker2:9091","kafka_topic" = "my_topic","property.security.protocol" = "ssl","property.ssl.ca.location" = "FILE:ca.pem","property.ssl.certificate.location" = "FILE:client.pem","property.ssl.key.location" = "FILE:client.key","property.ssl.key.password" = "abcdefg");
STOP/PAUSE/RESUME 三个命令来控制作业的停止，暂停和重启。
具体命令请参阅：STOP ROUTINE LOAD、 PAUSE ROUTINE LOAD 和 RESUME ROUTINE LOAD 命令文档。文档反馈