tencent cloud

Spark Integration with Kafka

Last updated: 2025-01-03 14:50:17

Spark Integration with Kafka

Last updated: 2025-01-03 14:50:17

Dependencies
Starting from v2.3, Spark no longer supports Kafka 0.8.2. As Spark 2.4.3 and later are integrated into EMR in the production environment, you need to integrate Kafka 0.10.0 and later.
How to view
1. Enter the version number in the following URL and open it:
https://spark.apache.org/docs/{spark.version}/streaming-kafka-integration.html
Replace {spark.version} with the actual Spark version. For example, to view the dependencies of v3.2.2, the URL should be as follows:
https://spark.apache.org/docs/3.2.2/streaming-kafka-integration.html
2. Click the appropriate link to view detailed integration instructions.
﻿

Was this page helpful?

You can also Contact Sales or Submit a Ticket for help.

Yes

No

Feedback