Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] [seatunnel] mysqlcdc to mysql job-info/jobid error #8758

Open
3 tasks done
fanxishu opened this issue Feb 18, 2025 · 1 comment
Open
3 tasks done

[Bug] [seatunnel] mysqlcdc to mysql job-info/jobid error #8758

fanxishu opened this issue Feb 18, 2025 · 1 comment

Comments

@fanxishu
Copy link

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

http://10.19.11.19:8080/submit-job?format=hocon提交mysqlcdc到mysql时候提交后引擎那边看是有在运行的结果在查询的时候报空指针异常
When submitting MySQL CDC (Change Data Capture) to MySQL via the URL http://10.19.11.19:8080/submit-job?format=hocon, the engine appears to be running after submission. However, when performing a query, a NullPointerException is reported.
查询http://10.19.11.19:8080/job-info/944129568623558657报:

Image

引擎报[] 2025-02-18 15:15:36,345 ERROR [.s.r.f.ExceptionHandlingFilter] [qtp355920448-102] - Error occurred while processing request
java.lang.NullPointerException: null
[] 2025-02-18 15:15:37,231 ERROR [.s.r.f.ExceptionHandlingFilter] [qtp355920448-102] - Error occurred while processing request
java.lang.NullPointerException: null
[] 2025-02-18 15:15:37,245 ERROR [.s.r.f.ExceptionHandlingFilter] [qtp355920448-665] - Error occurred while processing request
java.lang.NullPointerException: null
[] 2025-02-18 15:15:37,682 ERROR [.s.r.f.ExceptionHandlingFilter] [qtp355920448-665] - Error occurred while processing request
java.lang.NullPointerException: null
[] 2025-02-18 15:15:37,687 ERROR [.s.r.f.ExceptionHandlingFilter] [qtp355920448-106] - Error occurred while processing request

] 2025-02-18 15:25:26,972 ERROR [.s.r.f.ExceptionHandlingFilter] [qtp355920448-29015] - Error occurred while processing request
java.lang.NullPointerException: null
后台执行有在运行

Image

SeaTunnel Version

2.3.9

SeaTunnel Config

env {
datasyncType=null
scheduleConf=null
"job.mode"=STREAMING
"job.name"="job_16630176989920"
parallelism="1"
"checkpoint.interval"="60000"
"savemode.execute.location"=CLUSTER
}
source {
MySQL-CDC {
    format=DEFAULT
    "snapshot.split.size"="8096"
    "snapshot.fetch.size"="1024"
    "incremental.parallelism"="1"
    "connect.timeout.ms"="30000"
    "connect.max-retries"="3"
    "connection.pool.size"="20"
    "chunk-key.even-distribution.factor.lower-bound"="0.05"
    "chunk-key.even-distribution.factor.upper-bound"="100.0"
    "sample-sharding.threshold"="1000"
    "inverse-sampling.rate"="1000"
    "schema-changes.enabled"="false"
    "startup.mode"=INITIAL
    "exactly_once"="false"
    "stop.mode"=NEVER
    parallelism="1"
    "plugin_output"=Table1739353661399bm
    "dag-parsing.mode"=MULTIPLEX
    catalog {
        factory=Mysql
    }
    database-names=[
        "arktest_1",
        "arktest_2",
        "arktest_3",
        "arktest_4",
        "arktest_5"
    ]
    table-names=[
        "arktest_1.product",
        "arktest_2.product",
        "arktest_3.product",
        "arktest_4.product",
        "arktest_5.product"
    ]
    username=ability
    base-url="jdbc:mysql://127.0.0.1:8801/arktest_1?useUnicode=true&characterEncoding=utf-8&allowMultiQueries=true"
    password="123"
    server-time-zone=UTC
}
}
transform {
}
sink {
Jdbc {
    "ignore_fields" {}
    "schema_save_mode"="CREATE_SCHEMA_WHEN_NOT_EXIST"
    "data_save_mode"="APPEND_DATA"
    "create_index"="true"
    "connection_check_timeout_sec"="30"
    "batch_size"="1000"
    "is_exactly_once"="false"
    "max_commit_attempts"="3"
    "transaction_timeout_sec"="-1"
    "max_retries"="0"
    "auto_commit"="true"
    "support_upsert_by_query_primary_key_exist"="false"
    "multi_table_sink_replica"="1"
    "field_ide"=ORIGINAL
    "plugin_input"=Table1739353661399bm
    "generate_sink_sql"=true
    catalog {
        factory=MySQL
        username=ability
        password="123"
        base-url="jdbc:mysql://127.0.0.1:8912/ability?useSSL=false&useUnicode=true&characterEncoding=utf-8&rewriteBatchedStatements=true"
    }
    database=ABILITY
    user=ability
    password="123"
    driver="com.mysql.cj.jdbc.Driver"
    url="jdbc:mysql://127.0.0.1:8912/ability?useSSL=false&useUnicode=true&characterEncoding=utf-8&rewriteBatchedStatements=true"
}
}

Running Command

{
	"status": "fail",
	"message": null
}

Error Exception

{
	"status": "fail",
	"message": null
}
[] 2025-02-18 15:15:36,345 ERROR [.s.r.f.ExceptionHandlingFilter] [qtp355920448-102] - Error occurred while processing request
java.lang.NullPointerException: null
[] 2025-02-18 15:15:37,231 ERROR [.s.r.f.ExceptionHandlingFilter] [qtp355920448-102] - Error occurred while processing request
java.lang.NullPointerException: null
[] 2025-02-18 15:15:37,245 ERROR [.s.r.f.ExceptionHandlingFilter] [qtp355920448-665] - Error occurred while processing request
java.lang.NullPointerException: null
[] 2025-02-18 15:15:37,682 ERROR [.s.r.f.ExceptionHandlingFilter] [qtp355920448-665] - Error occurred while processing request
java.lang.NullPointerException: null
[] 2025-02-18 15:15:37,687 ERROR [.s.r.f.ExceptionHandlingFilter] [qtp355920448-106] - Error occurred while processing request


] 2025-02-18 15:25:26,972 ERROR [.s.r.f.ExceptionHandlingFilter] [qtp355920448-29015] - Error occurred while processing request
java.lang.NullPointerException: null

Zeta or Flink or Spark Version

No response

Java or Scala Version

No response

Screenshots

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@fanxishu fanxishu added the bug label Feb 18, 2025
@fanxishu
Copy link
Author

cdc的会出现这个问题离线的不会
The issue occurs with CDC (Change Data Capture) systems, but not with offline systems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants