Hi, I’m trying to install on Ubuntu server 16.04…using this manual:https://hopsworks.readthedocs.io/en/latest/getting_started/installation_guide/platforms/baremetal.html#quickstart-single-host-installation. But the karamel keeps throwing following question. Which I thought was some problem with the yml file… But comparing the yml file and the error message… Seems all fields are there
Distributor ID: Ubuntu
Description: Ubuntu 16.04.1 LTS
Release: 16.04
Codename: xenial
name: Hops
baremetal:
username: ubuntu
cookbooks:
hopsworks:
github: logicalclocks/hopsworks-chef
branch: 1.3
attrs:
install:
dir: /srv/hops
cloud: on-premises
kubernetes: false
hops:
# version: "2.8.2.10-EE-RC0"
tls:
enabled: false
yarn:
cgroups_strict_resource_usage: 'false'
vcores: 7
memory_mbs: 61440
detect-hardware-capabilities: false
rmappsecurity:
actor_class: "org.apache.hadoop.yarn.server.resourcemanager.security.DevHopsworksRMAppSecurityActions"
# maggy:
# version: "git+git://github.com/logicalclocks/maggy@master"
kagent:
python_conda_versions: 3.6
# conda:
# hops-util-py:
# install-mode: "git"
# branch: "model_repo_project"
# repo: "jimdowling"
# ndb:
# nvme:
# disks: "/dev/nvme0n1 /dev/nvme0n1"
# format: true
# logfile_size: 100000M
# undofile_size: 1000M
# NoOfReplicas: 2
# DataMemory: 8192
alertmanager:
email:
to: sre@logicalclocks.com
from: hopsworks@logicalclocks.com
smtp_host: mail.hello.com
prometheus:
retention_time: "8h"
hopsworks:
# war_url: http://snurran.sics.se/hops/hopsworks/1.4.0/hopsworks-web-dev.war
# ca_url: http://snurran.sics.se/hops/hopsworks/1.4.0/hopsworks-ca-dev.war
# ear_url: http://snurran.sics.se/hops/hopsworks/1.4.0/hopsworks-ear-dev.ear
encryption_password: 5f104eaa_001
master:
password: 5f104eaa_002
admin:
user: adminuser
password: 5f104eaa_201
https:
port: 443
featurestore_online: true
requests_verify: false
application_certificate_validity_period: 6d
kagent_liveness:
enabled: true
threshold: 40s
hive2:
mysql_password: 5f104eaa_203
mysql:
password: 5f104eaa_202
elastic:
opendistro_security:
jwt:
exp_ms: 1800000
audit:
enable_rest: true
enable_transport: false
admin:
username: admin
password: 5f104eaa_201
kibana:
username: kibana
password: 5f104eaa_201
logstash:
username: logstash
password: 5f104eaa_201
epipe:
username: epipe
password: 5f104eaa_201
elastic_exporter:
username: elasticexporter
password: 5f104eaa_201
groups:
metaserver:
size: 1
baremetal:
ip: ###########
recipes:
- kagent
- conda
- ndb::mgmd
- ndb::ndbd
- ndb::mysqld
- hops::ndb
- hops::rm
- hops::nn
- hops::jhs
- hadoop_spark::yarn
- hadoop_spark::historyserver
- hadoop_spark::certs
- flink::yarn
- flink::historyserver
- elastic
- livy
- kzookeeper
- kkafka
- epipe
- hopsworks
- hopsmonitor
- hopslog
- hopslog::_filebeat-spark
- hopslog::_filebeat-serving
- hopslog::_filebeat-kagent
- hopslog::_filebeat-beam
- hops::dn
- hops::nm
- tensorflow
- hive2
- hops_airflow
- hops_airflow::sqoop
- hopsmonitor::prometheus
- hopsmonitor::alertmanager
- hopsmonitor::node_exporter
- hopsmonitor::purge_telegraf
- consul::master
Error message:
ERROR [2020-08-06 05:18:17,357] se.kth.karamel.webservice.KaramelServiceApplication: Inalid yaml file; Invalid attributes, all used attributes must be defined in metadata.rb files: [hops/tls/enabled, elastic/opendistro_security/epipe/username, hops/rmappsecurity/actor_class, hopsworks/application_certificate_validity_period, elastic/opendistro_security/admin/username, hopsworks/kagent_liveness/threshold, elastic/opendistro_security/audit/enable_transport, hopsworks/requests_verify, elastic/opendistro_security/elastic_exporter/username, kagent/python_conda_versions, elastic/opendistro_security/audit/enable_rest, mysql/password, hops/yarn/cgroups_strict_resource_usage, hopsworks/featurestore_online, hopsworks/admin/password, hops/yarn/detect-hardware-capabilities, hopsworks/admin/user, elastic/opendistro_security/logstash/password, hopsworks/encryption_password, elastic/opendistro_security/epipe/password, alertmanager/email/to, elastic/opendistro_security/jwt/exp_ms, install/dir, prometheus/retention_time, alertmanager/email/smtp_host, elastic/opendistro_security/kibana/password, hops/yarn/memory_mbs, alertmanager/email/from, hopsworks/master/password, hops/yarn/vcores, elastic/opendistro_security/kibana/username, hive2/mysql_password, install/kubernetes, hopsworks/kagent_liveness/enabled, hopsworks/https/port, elastic/opendistro_security/admin/password, install/cloud, elastic/opendistro_security/logstash/username, elastic/opendistro_security/elastic_exporter/password]
INFO [2020-08-06 05:18:17,366] org.eclipse.jetty.server.ServerConnector: Stopped karamel-core@422c3c7a{HTTP/1.1}{0.0.0.0:9090}
INFO [2020-08-06 05:18:17,368] org.eclipse.jetty.server.handler.ContextHandler: Stopped i.d.j.MutableServletContextHandler@7a34b7b8{/admin,null,UNAVAILABLE}
INFO [2020-08-06 05:18:17,369] org.eclipse.jetty.server.handler.ContextHandler: Stopped i.d.j.MutableServletContextHandler@5b69fd74{/,null,UNAVAILABLE}
Appreciate for any suggestions. Thank you very much.