tencent cloud

文档反馈

Custom Connectors

最后更新时间:2023-11-08 14:25:19

    Overview

    If the built-in connectors cannot meet your needs, you can customize your own connectors by uploading source and sink API classes and dynamically loading and calling them when the job is executed.

    Versions

    Flink Version
    Description
    1.11
    Supported
    1.13
    Supported
    1.14
    Supported
    1.16
    Supported

    Prepare your connector package

    You can either use a third-party connector package (such as Bahir) or build your own package.

    Apache Bahir

    Apache Bahir offers common source and sink extensions for Flink.
    Currently, the following third-party components are provided:

    Building your own package

    See Flink API.

    Build and upload the connector package

    Step 1. Compile the source code

    We recommend you refer to existing connector projects to modify the pom.xml file to import dependencies and create a JAR package in Maven.
    Note
    We recommend you use maven-shade-plugin to shade common dependencies such as Apache Commons and Guava to avoid conflicts between the imported dependencies and classes of Stream Compute Service.

    Step 2. Upload the package

    Go to the Dependencies page of the Stream Compute Service console and upload the connector package. For the first upload, the package will be v1. If you upload a new version, it will be v2, and so on.

    ‌### Step 3. Reference the package

    On the details page of your job, under the Job parameters tab, select the package version you uploaded.
    Note
    To avoid unexpected errors, make sure you select the correct package version.

    ‌### Step 4. Save/Publish the job

    Click Save to save the settings or Publish draft to publish the job.
    联系我们

    联系我们,为您的业务提供专属服务。

    技术支持

    如果你想寻求进一步的帮助,通过工单与我们进行联络。我们提供7x24的工单服务。

    7x24 电话支持