I have installed a Hopsworks feature store on-prem v2.4.0 as a single-host cluster on an Ubuntu 18.04 LTS vm. I would like to update it to the new version v2.5.0.
Sofar I got from the upgrade doc Upgrades — Documentation 2.6.0-SNAPSHOT documentation, is that I need to modify cluster-defns/hopsworks-installation.yml and run the karamel, but I don’t quite understand which option of “hopsworks-installer.sh” shall be called to perform the software version update to v2.5.0. I would like to keep my user data and system settings.
Can you share with me detailed steps how I can update from hopsworks v2.4.0 to v2.5.0 ? Thanks so much for your help in advance.
I have tried the following approach sofar:
change the branch version
In cluster-defns/hopswroks-installion.yml
cookbooks:
hopsworks:
github: logicalclocks/hopsworks-chef
branch: 2.5 # from 2.4 to 2.5
Run karamel launch
./bin/karamel -launch ../cluster-defns/hopsworks-installation.yml
Got an Error for task hopsworks::default
from http://localhost:9090/index.html#/terminal
* file[/srv/hops/apache-hive/logs/hive.log] action create (up to date)
Recipe: hopsworks::defaulte[0m
* ruby_block[check_db_empty] action run
e[0m
================================================================================e[0m
e[31mError executing action `run` on resource 'ruby_block[check_db_empty]'e[0m
================================================================================e[0m
e[0m RuntimeErrore[0m
------------e[0m
You are trying to initialize the database, but the database is not empty. Either there is a failed migration, or you forgot to set the current_version attributee[0m
e[0m Cookbook Trace:e[0m
---------------e[0m
/tmp/chef-solo/cookbooks/hopsworks/recipes/default.rb:183:in `block (2 levels) in from_file'e[0m
e[0m Resource Declaration:e[0m
---------------------e[0m
# In /tmp/chef-solo/cookbooks/hopsworks/recipes/default.rb
e[0m
e[0m 181: ruby_block "check_db_empty" do
e[0m 182: block do
e[0m 183: raise "You are trying to initialize the database, but the database is not empty. Either there is a failed migration, or you forgot to set the current_version attribute"
e[0m 184: end
e[0m 185: only_if "#{node['ndb']['scripts_dir']}/mysql-client.sh hopsworks -e \"SHOW TABLES\" | grep project"
e[0m 186: end
e[0m 187:
e[0m
e[0m Compiled Resource:e[0m
------------------e[0m
# Declared in /tmp/chef-solo/cookbooks/hopsworks/recipes/default.rb:181:in `from_file'
e[0m
e[0m ruby_block("check_db_empty") do
e[0m action [:run]
e[0m default_guard_interpreter :default
e[0m declared_type :ruby_block
e[0m cookbook_name "hopsworks"
e[0m recipe_name "default"
e[0m block #<Proc:0x0000000004dba7f0@/tmp/chef-solo/cookbooks/hopsworks/recipes/default.rb:182>
e[0m block_name "check_db_empty"
e[0m only_if "/srv/hops/mysql-cluster/ndb/scripts/mysql-client.sh hopsworks -e "SHOW TABLES" | grep project"
e[0m end
e[0m
e[0m System Info:e[0m
------------e[0m
chef_version=14.10.9
e[0m platform=ubuntu
e[0m platform_version=18.04
e[0m ruby=ruby 2.5.3p105 (2018-10-18 revision 65156) [x86_64-linux]
e[0m program_name=/usr/bin/chef-solo
e[0m executable=/opt/chefdk/bin/chef-soloe[0m
e[0me[0m
Running handlers:e[0m
[2022-02-17T11:21:47+00:00] ERROR: Running exception handlers
Running handlers complete
e[0m[2022-02-17T11:21:47+00:00] ERROR: Exception handlers complete
Chef Client failed. 7 resources updated in 20 secondse[0m
[2022-02-17T11:21:47+00:00] FATAL: Stacktrace dumped to /tmp/chef-solo/chef-stacktrace.out
[2022-02-17T11:21:47+00:00] FATAL: Please provide the contents of the stacktrace.out file if you file a bug report
[2022-02-17T11:21:47+00:00] FATAL: RuntimeError: ruby_block[check_db_empty] (hopsworks::default line 181) had an error: RuntimeError: You are trying to initialize the database, but the database is not empty. Either there is a failed migration, or you forgot to set the current_version attribute
It seams that to run the migration, I need to set perheps current_version attribute in cluster-defns/hopswroks-installion.yml?
hopsworks__default.log.zip (3.2 KB)