can not resolve nameservices when using meta service api--create_instance #45580
Unanswered
pklcoder
asked this question in
A - General / Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
in my case,we create instance and create cluster with Compute-Storage Decoupled.
use meta service api--create_instance to create instance,the code like below:
curl 'ms:5000/MetaService/http/create_instance?token=greedisgood9999' -d '
{
"instance_id": "lycc_test4_decouple",
"name": "lycc_test4_decouple_instance_name",
"user_id": "lycc_test4_decouple_user_id",
"vault": {
"hdfs_info" : {
"build_conf": {
"fs_name": "hdfs://nameservice:8020",
"nameservices": "nameservice",
"nn": "nn1,nn2",
"rpc2": "hostnamen2:8020",
"rpc1": "hostnamenn1:8020",
"provider": "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider",
"user": "hive",
"hdfs_kerberos_keytab": "/home/q/keytab/hive.service.keytab",
"hdfs_kerberos_principal": "hive/hostname@LYCC.COM",
"hdfs_confs" : [
{
"key": "hadoop.security.authentication",
"value": "kerberos"
}
]
},
"prefix": "/test4_vault"
}
}
}'
but found errors in doris-be server log like this:
hdfsBuilderConnect(forceNewInstance=1, nn=hdfs://nameservice:8020, port=0, kerbTicketCachePath=(NULL), userName=(NULL)) error:
UnknownHostException: nameservice java.lang.IllegalArgumentException: java.net.UnknownHostException: nameservice
at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:475)
at org.apache.hadoop.hdfs.NameNodeProxiesClient.createProxyWithClientProtocol(NameNodeProxiesClient.java:134)
may be these ha parameters of hadoop in wrong stytle:
"nameservices": "nameservice",
"nn": "nn1,nn2",
"rpc2": "hostnamen2:8020",
"rpc1": "hostnamenn1:8020",
"provider":
"org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider"
I have no idea how to send these ha parameters of hadoop,any one can point out the right way,thanks.
Beta Was this translation helpful? Give feedback.
All reactions