Hi, we are currently facing issue as bellow, could you give us any suggestions? (We don’t know how to configure leader namenode and how to continue our instalization , could you give us any documents?).
package version :
clusterj-hops-fix-7.6.10.jar hadoop-kms-3.2.0.4.jar hops-metadata-dal-impl-ndb-3.2.0.4.jar mysql-connector-java-8.0.11.jar
hadoop-common-3.2.0.4.jar hadoop-nfs-3.2.0.4.jar
hadoop-common-3.2.0.4-tests.jar hops-metadata-dal-3.2.0.4.jar
test step
we now install ndb cluster on node23(bdb sql server node) , node24 ( ndb mamager node), node25 (ndb data node); and all of them are started;
Then we install dal and hadoop on node23;
Then we configure hops-ndb-config.properties;
and the last we use commond ‘start.dfs.sh’ to install hopsfs .
But as we don’t have any doc to follow that we have no idea with how to contine now:
//ERROR LOG:
2024-01-05 16:04:25,825 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 9000: starting
2024-01-05 16:04:25,827 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Leader Node RPC up at: 192.168.1.23/192.168.1.23:9000
2024-01-05 16:04:25,934 INFO org.apache.hadoop.ipc.Server: IPC Server handler 0 on 9000, call Call#1476 Retry#0 org.apache.hadoop.hdfs.server.protocol.DatanodeProtocol.versionRequest from 192.168.1.23:41326
java.io.IOException: Leader Node still not started
at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.checkNNStartup(NameNodeRpcServer.java:1372)
at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.versionRequest(NameNodeRpcServer.java:1106)
at org.apache.hadoop.hdfs.protocolPB.DatanodeProtocolServerSideTranslatorPB.versionRequest(DatanodeProtocolServerSideTranslatorPB.java:277)
at org.apache.hadoop.hdfs.protocol.proto.DatanodeProtocolProtos$DatanodeProtocolService$2.callBlockingMethod(DatanodeProtocolProtos.java:36000)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:524)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1025)
at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:868)
at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:814)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1821)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2900)
2024-01-05 16:04:26,018 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Starting services required for active state
2024-01-05 16:04:26,018 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Catching up to latest edits from old active before taking over writer role in edits logs
2024-01-05 16:04:26,018 INFO org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager: Marking all datandoes as stale
2024-01-05 16:04:26,018 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Reprocessing replication and invalidation queues
2024-01-05 16:04:26,018 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: initializing replication queues
2024-01-05 16:04:26,026 INFO org.apache.hadoop.hdfs.server.blockmanagement.CacheReplicationMonitor: Starting CacheReplicationMonitor with interval 30000 milliseconds
2024-01-05 16:04:26,064 INFO org.apache.hadoop.hdfs.server.blockmanagement.BlockManager: processMisReplicated read 0/50000 in the Ids range [0 - 50000] (max inodeId when the process started: 1)
Hope for your kindly suggestion!