Hopsworks installer cannot install karamel

The installer cannot access karamel.io, nor can I or others. It appears to have been down all day. I tried to contact them with no response. Is there an alternative way to install Karamel? Is Karamel an active project?

Hi, yes we still maintain Karamel but we have been having some issues with the website.

Which version of the hopsworks-installer.sh are you using? Newer versions (2.1/2.2) don’t use karamel.io to download the artifact, but they use our general repository.

Can you make sure you are using the 2.2 installer? https://raw.githubusercontent.com/logicalclocks/karamel-chef/2.2/hopsworks-installer.sh

Hi @Fabio ,
Could you please take a look at this problem: Some "cookbook-dependency" problems of Hopsworks community edition 2.2 - #7 by Freeman
Because I don’t have the source code of the Karamel, I can’t pinpoint the cause of the problem.

thanks, that got me a bit further. Now I have

ERROR [2021-04-26 15:30:30,906] net.schmizz.sshj.transport.TransportImpl: Dying because - {}
! net.schmizz.sshj.transport.TransportException: Broken transport; encountered EOF
! at net.schmizz.sshj.transport.Reader.run(Reader.java:57) ~[sshj-0.20.0.jar:na]
INFO  [2021-04-26 15:30:30,906] net.schmizz.sshj.transport.TransportImpl: Disconnected - UNKNOWN
INFO  [2021-04-26 15:30:30,917] net.schmizz.sshj.transport.random.BouncyCastleRandom: Generating random seed from SecureRandom.
INFO  [2021-04-26 15:30:30,925] se.kth.karamel.backend.machines.SshMachine: 192.168.1.101: connecting ...
INFO  [2021-04-26 15:30:30,925] net.schmizz.sshj.transport.TransportImpl: Client identity string: SSH-2.0-SSHJ_0.20.0
INFO  [2021-04-26 15:30:30,934] net.schmizz.sshj.transport.TransportImpl: Server identity string: SSH-2.0-OpenSSH_8.3p1 Ubuntu-1
INFO  [2021-04-26 15:30:30,942] se.kth.karamel.backend.machines.SshMachine: 192.168.1.101: Yey!! connected ^-^
INFO  [2021-04-26 15:30:30,943] com.hierynomus.sshj.userauth.keyprovider.OpenSSHKeyV1KeyFile: Read key type: ssh-rsa
ERROR [2021-04-26 15:30:30,944] se.kth.karamel.backend.machines.MachinesMonitor: 
! net.schmizz.sshj.common.Buffer$BufferException: Bad item length: -618309638
! at net.schmizz.sshj.common.Buffer.readString(Buffer.java:370) ~[sshj-0.20.0.jar:na]
! at com.hierynomus.sshj.userauth.keyprovider.OpenSSHKeyV1KeyFile.readUnencrypted(OpenSSHKeyV1KeyFile.java:150) ~[sshj-0.20.0.jar:na]
! at com.hierynomus.sshj.userauth.keyprovider.OpenSSHKeyV1KeyFile.readDecodedKeyPair(OpenSSHKeyV1KeyFile.java:101) ~[sshj-0.20.0.jar:na]
! at com.hierynomus.sshj.userauth.keyprovider.OpenSSHKeyV1KeyFile.readKeyPair(OpenSSHKeyV1KeyFile.java:73) ~[sshj-0.20.0.jar:na]
! at net.schmizz.sshj.userauth.keyprovider.BaseFileKeyProvider.getPublic(BaseFileKeyProvider.java:81) ~[sshj-0.20.0.jar:na]
! at net.schmizz.sshj.userauth.method.KeyedAuthMethod.putPubKey(KeyedAuthMethod.java:44) ~[sshj-0.20.0.jar:na]
! ... 15 common frames omitted
! Causing: net.schmizz.sshj.userauth.UserAuthException: Problem getting public key from com.hierynomus.sshj.userauth.keyprovider.OpenSSHKeyV1KeyFile@166badcd
! at net.schmizz.sshj.userauth.method.KeyedAuthMethod.putPubKey(KeyedAuthMethod.java:46) ~[sshj-0.20.0.jar:na]
! at net.schmizz.sshj.userauth.method.AuthPublickey.buildReq(AuthPublickey.java:62) ~[sshj-0.20.0.jar:na]
! at net.schmizz.sshj.userauth.method.AuthPublickey.buildReq(AuthPublickey.java:81) ~[sshj-0.20.0.jar:na]
! at net.schmizz.sshj.userauth.method.AbstractAuthMethod.request(AbstractAuthMethod.java:68) ~[sshj-0.20.0.jar:na]
! at net.schmizz.sshj.userauth.UserAuthImpl.authenticate(UserAuthImpl.java:72) ~[sshj-0.20.0.jar:na]
! at net.schmizz.sshj.SSHClient.auth(SSHClient.java:219) ~[sshj-0.20.0.jar:na]
! ... 10 common frames omitted
! Causing: net.schmizz.sshj.userauth.UserAuthException: Exhausted available authentication methods
! at net.schmizz.sshj.SSHClient.auth(SSHClient.java:225) ~[sshj-0.20.0.jar:na]
! at net.schmizz.sshj.SSHClient.authPublickey(SSHClient.java:340) ~[sshj-0.20.0.jar:na]
! at net.schmizz.sshj.SSHClient.authPublickey(SSHClient.java:359) ~[sshj-0.20.0.jar:na]
! at se.kth.karamel.backend.machines.SshMachine.connect(SshMachine.java:479) ~[karamel-core-0.6.jar:na]
! ... 7 common frames omitted
! Causing: se.kth.karamel.common.exception.KaramelException: 192.168.1.101: Authentication problem using ssh keys.
! at se.kth.karamel.backend.machines.SshMachine.connect(SshMachine.java:511) ~[karamel-core-0.6.jar:na]
! at se.kth.karamel.backend.machines.SshMachine.ping(SshMachine.java:537) ~[karamel-core-0.6.jar:na]
! at se.kth.karamel.backend.machines.MachinesMonitor.run(MachinesMonitor.java:101) ~[karamel-core-0.6.jar:na]
! at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_282]
! at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_282]
! at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [na:1.8.0_282]
! at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_282]
! at java.lang.Thread.run(Thread.java:748) [na:1.8.0_282]

I am able to ssh and sudo just fine, not sure why chef/karamel cannot.

Are you using Ubuntu 20.04? If so have a look at this post: Error reading ssh key - net.schmizz.sshj.common.Buffer$BufferException: Bad item length: -1845887552 - #2 by joakimeriksson