tencent cloud

Elasticsearch Sinks
Last updated:2023-11-08 16:20:45
Elasticsearch Sinks
Last updated: 2023-11-08 16:20:45

Overview

An Elasticsearch data sink can write data to Elasticsearch.
Note
Currently, Elasticsearch data sinks only support Elasticsearch 6 and Elasticsearch 7.

Mapping of common data types

For the data types supported by Elasticsearch, see Elasticsearch Data ‍Types. The table below lists some of the common data types and their counterparts in Flink.
Flink
Elasticsearch
text
STRING
match_only_text
STRING
binary
STRING
keyword
STRING
wildcard
STRING
search_as_you_type
STRING
ip
STRING
short
SMALLINT
integer
INT
long
BIGINT
unsigned_long
BIGINT
float
FLOAT
half_float
FLOAT
double
DOUBLE
boolean
BOOLEAN
date
TIMESTAMP(3)
date_nanos
TIMESTAMP(6)
Note
Data types not listed in the above table are not supported currently.

Notes

Primary key

A primary key is required for Elasticsearch. The field set as the primary key will be written into _id, and data with the same ID will be overwritten.

Version differences

Please note that if you use Elasticsearch 6, you need to configure document-type. This is not necessary with Elasticsearch 7.

WITH parameters

Elasticsearch data sinks are developed based on the data analytics engine Elasticsearch. The two have identical WITH parameters. For details, see Elasticsearch Service.
Was this page helpful?
You can also Contact Sales or Submit a Ticket for help.
Yes
No

Feedback