Skip to content

[hotfix][build] Update CI to support Flink 2.0#200

Open
hlteoh37 wants to merge 2 commits intoapache:mainfrom
hlteoh37:update_2.0
Open

[hotfix][build] Update CI to support Flink 2.0#200
hlteoh37 wants to merge 2 commits intoapache:mainfrom
hlteoh37:update_2.0

Conversation

@hlteoh37
Copy link
Copy Markdown
Contributor

Purpose of the change

Support Flink 2.0 in flink-connector-aws

Verifying this change

This change is already covered by existing tests (unit test, integ test in CI)

Significant changes

(Please check any boxes [x] if the answer is "yes". You can first publish the PR and check them afterwards, for convenience.)

  • Dependencies have been added or upgraded
  • Public API has been changed (Public API is any class annotated with @Public(Evolving))
  • Serializers have been changed
  • New feature has been introduced
    • If yes, how is this documented? (not applicable / docs / JavaDocs / not documented)
Copy link
Copy Markdown
Contributor

@leekeiabstraction leekeiabstraction left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for raising the PR!

Looks like the added coverage for 2.0 has found changes on the Sink interface breaking DynamoDbSink. I assume the same applies for KinesisSink as well.

 Error: Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile (default-compile) on project flink-connector-dynamodb: Compilation failure: Compilation failure: Error: /home/runner/work/flink-connector-aws/flink-connector-aws/flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/sink/DynamoDbSink.java:[138,13] cannot find symbol Error: symbol: class InitContext Error: location: class org.apache.flink.connector.dynamodb.sink.DynamoDbSink<InputT> Error: /home/runner/work/flink-connector-aws/flink-connector-aws/flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/sink/DynamoDbSink.java:[137,12] cannot find symbol Error: symbol: class StatefulSinkWriter Error: location: class org.apache.flink.connector.dynamodb.sink.DynamoDbSink<InputT> Error: /home/runner/work/flink-connector-aws/flink-connector-aws/flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/sink/DynamoDbSink.java:[145,13] cannot find symbol Error: symbol: class InitContext Error: location: class org.apache.flink.connector.dynamodb.sink.DynamoDbSink<InputT> Error: /home/runner/work/flink-connector-aws/flink-connector-aws/flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/sink/DynamoDbSink.java:[144,12] cannot find symbol Error: symbol: class StatefulSinkWriter Error: location: class org.apache.flink.connector.dynamodb.sink.DynamoDbSink<InputT> Error: /home/runner/work/flink-connector-aws/flink-connector-aws/flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/sink/DefaultDynamoDbElementConverter.java:[55,26] cannot find symbol Error: symbol: class InitContext Error: location: interface org.apache.flink.api.connector.sink2.Sink Error: /home/runner/work/flink-connector-aws/flink-connector-aws/flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/sink/DynamoDbSinkWriter.java:[22,49] cannot find symbol Error: symbol: class InitContext Error: location: interface org.apache.flink.api.connector.sink2.Sink Error: /home/runner/work/flink-connector-aws/flink-connector-aws/flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/sink/DynamoDbSinkWriter.java:[129,13] cannot find symbol Error: symbol: class InitContext Error: location: class org.apache.flink.connector.dynamodb.sink.DynamoDbSinkWriter<InputT> Error: /home/runner/work/flink-connector-aws/flink-connector-aws/flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/sink/DynamoDbBeanElementConverter.java:[67,26] cannot find symbol Error: symbol: class InitContext Error: location: interface org.apache.flink.api.connector.sink2.Sink Error: /home/runner/work/flink-connector-aws/flink-connector-aws/flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/sink/DynamoDbSinkWriter.java:[160,5] method does not override or implement a method from a supertype Error: -> [Help 1] 

Approved. Also raised a Jira for 2.0 migration: https://issues.apache.org/jira/browse/FLINK-37687

matrix:
flink: [1.19-SNAPSHOT, 1.20-SNAPSHOT]
flink: [ 1.20-SNAPSHOT ]
java: [ '8, 11, 17']
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we plan to continue supporting java 8? If not, should we remove it?

Copy link
Copy Markdown
Contributor

@darenwkt darenwkt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR and looking forward to support for Flink 2.0! Left a small clarification question

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

3 participants