Comments (5)
maugustosilva
commented on August 26, 2024
oops, apologies for the long delay. We were busy finishing the conversion of the whole code for python3 :-). I recommend you start by trying what is described under Debugging single-VM attachment errors in https://github.com/ibmcb/cbtool/wiki/HOWTO:-Debug-initial-setup. This should allow you to login on the VM and run ~/cbtool/scripts/common/cb_post_boot.sh directly there...
from cbtool.
Giuseppe1992
commented on August 26, 2024
There is the same problem using Amazon EC2
this is the log that I have:
Aug 4 14:40:33 ip-172-31-29-18.eu-central-1.compute.internal cloudbench [DEBUG] process_management.py/ProcessManagement.retriable_run_os_command process_management - Command "~/cbtool/scripts/common/cb_post_boot.sh" failed to execute on hostname 172.31.29.217, port 22 after attempt 14. Will try 22 more times.from cbtool.
mraygalaxy
commented on August 26, 2024
@marcinkaczor This is a very common networking problem for new users. cbtool has to be installed in a location that is reachable by the the cloud (on all ports). If it is not, things will not work.
You have many options here: 1) Put cbtool in the cloud itself 2) Use our VPN support and run it outside of the cloud or 3) Use a jumpbox
There are instructions on the wiki for doing both 2) and 3) if you don't want to do 1)
from cbtool.
marcinkaczor
commented on August 26, 2024
After issuing the command vmattach tinyvm on the orchestrator, I opened a second terminal view, logged on the VM (tinyvm) and ran ~/cbtool/scripts/common/cb_post_boot.sh directly there. It turned out that the script execution was interrupted, because there was a problem with cb_common.sh script with ntp service: Failed to restart ntp.service: Unit ntp.service not found. I installed ntp by executing sudo apt install ntp and succesfully ran cb_post_boot.sh script once again on this VM. Then, I came back to my orchestrator and it turned out that VM was succesfully attached to the experiment.
Summarizing, in the end, I succesfully attached the VM to my experiment but it required my manual intervention... I see I am not the only one who struggles with this problem :(
Could you please look at it, guys?
I attach the log from unsuccessful cb_post_boot.sh script execution on VM:
cbuser@cb-marcin-mygce-vm2-tinyvm:~$ ./cbtool/scripts/common/cb_post_boot.sh
open
port checker: host 10.142.0.45 is open.
cb_common.sh (40400): Starting generic VM post_boot configuration
cb_common.sh (40400): VMs need to be able to perform passwordless SSH between each other. Updating ~/.ssh/id_rsa with the contents from "~/cbtool/credentials/cbtool_rsa" to be the same on all VMs..
cb_common.sh (40400): Relaxing all security configurations
cb_common.sh (40400): Stopping service "ufw" with command "sudo systemctl stop ufw"...
cb_common.sh (40400): Disabling service "ufw" with command "sudo systemctl disable ufw"...
Synchronizing state of ufw.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install disable ufw
cb_common.sh (40400): Disabling Apparmor...
cb_common.sh (40400): Stopping service "apparmor" with command "sudo systemctl stop apparmor"...
cb_common.sh (40400): Disabling service "apparmor" with command "sudo systemctl disable apparmor"...
Synchronizing state of apparmor.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install disable apparmor
* Unloading AppArmor profiles [ OK ]
cb_common.sh (40400): Done
cb_common.sh (40400): Starting (AI) Log store...
cb_common.sh (40400): Local (AI) Log store started
cb_common.sh (40400): Starting (AI) Object store...
cb_common.sh (40400): Stopping service "redis-server" with command "sudo systemctl stop redis-server"...
cb_common.sh (40400): Disabling service "redis-server" with command "sudo systemctl disable redis-server"...
Synchronizing state of redis-server.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install disable redis-server
cb_common.sh (40400): Updating object store configuration template
cb_common.sh (40400): Restarting service "redis-server", with command "sudo service redis-server restart", attempt 1 of 7...
cb_common.sh (40400): Service "redis-server" was successfully restarted
cb_common.sh (40400): Enabling service "redis-server", with command "sudo update-rc.d -f redis-server defaults"...
cb_common.sh (40400): Local (AI) Object store started
cb_common.sh (40400): Making sure all NICs on this instance have IPs configured ...
cb_common.sh (40400): Refreshing hosts file ...
cb_common.sh (40400): Enabling firewall via ufw commands...
Skipping adding existing rule
Skipping adding existing rule
Skipping adding existing rule
Skipping adding existing rule
Skipping adding existing rule
Skipping adding existing rule
Skipping adding existing rule
cb_common.sh (40400): Executing "post_boot_steps" function
cb_common.sh (40400): Nested container not requested.
cb_common.sh (40400): Stopping service "ganglia-monitor" with command "sudo systemctl stop ganglia-monitor"...
cb_common.sh (40400): Disabling service "ganglia-monitor" with command "sudo systemctl disable ganglia-monitor"...
ganglia-monitor.service is not a native service, redirecting to systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install disable ganglia-monitor
cb_common.sh (40400): Stopping service "gmetad" with command "sudo service gmetad stop"...
Failed to stop gmetad.service: Unit gmetad.service not loaded.
cb_common.sh (40400): Disabling service "gmetad" with command "sudo update-rc.d -f gmetad remove"...
cb_common.sh (40400): Killing previously running ganglia monitoring processes on cb-marcin-mygce-vm2-tinyvm
cb_common.sh (40400): Ganglia monitoring processes killed successfully on cb-marcin-mygce-vm2-tinyvm
cb_common.sh (40400): Previously running ganglia monitoring processes killed cb-marcin-mygce-vm2-tinyvm
cb_common.sh (40400): Stopping service "ntp" with command "sudo service ntp stop"...
Failed to stop ntp.service: Unit ntp.service not loaded.
cb_common.sh (40400): Disabling service "ntp" with command "sudo update-rc.d -f ntp remove"...
cb_common.sh (40400): Creating ntp (ntp.conf) file
open
port checker: host 10.142.0.45 is open.
cb_common.sh (43282): Force ntp time synchronization with server 10.142.0.45
sudo: ntpdate: command not found
/bin/cp: cannot create regular file '/var/lib/ntp/ntp.conf.dhcp': No such file or directory
cb_common.sh (40400): Forcing clock update from ntp
b''
cb_common.sh (40400): Restarting service "ntp", with command "sudo service ntp restart", attempt 1 of 7...
Failed to restart ntp.service: Unit ntp.service not found.
cb_common.sh (40400): Restarting service "ntp", with command "sudo service ntp restart", attempt 2 of 7...
Failed to restart ntp.service: Unit ntp.service not found.
cb_common.sh (40400): Restarting service "ntp", with command "sudo service ntp restart", attempt 3 of 7...
Failed to restart ntp.service: Unit ntp.service not found.
cb_common.sh (40400): Restarting service "ntp", with command "sudo service ntp restart", attempt 4 of 7...
Failed to restart ntp.service: Unit ntp.service not found.
cb_common.sh (40400): Restarting service "ntp", with command "sudo service ntp restart", attempt 5 of 7...
Failed to restart ntp.service: Unit ntp.service not found.
cb_common.sh (40400): Restarting service "ntp", with command "sudo service ntp restart", attempt 6 of 7...
Failed to restart ntp.service: Unit ntp.service not found.
cb_common.sh (40400): Restarting service "ntp", with command "sudo service ntp restart", attempt 7 of 7...
Failed to restart ntp.service: Unit ntp.service not found.
cb_common.sh (40400): Service "ntp" failed to restart after 7 attempts
from cbtool.
marcinkaczor
commented on August 26, 2024
Hello,
I added ntp to the cloud-init packages:
...
[VM_DEFAULTS : GCE_CLOUDCONFIG]
CLOUDINIT_PACKAGES = ntp
...
And the problem no loger exists.
from cbtool.
Related Issues (20)
- Problems with attaching the nullworkload application instance to the experiment in GCE
- kmeans_baseline no results HOT 1
- Install: ganglia instructions on centos doesn't work HOT 1
- Install: rrdplot related dependencies install instructions are broken on centos HOT 1
- Orchestrator node installation issues on Centos
- docker_file_parser() throws exception because of invalid workload file name
- PLM should delete cloud-init config disk image when detaching a vm
- PLM: intermittent vmdetach error on Centos 7.2 orchestrator node
- PLM: Ubuntu 22.04 workload vms having duplicate IP addresses HOT 2
- docker file: python-daemon-3K should be replaced by python-daemon module
- cb_post_boot.sh starts log store and object store services locally on vms
- RUN_LIMIT doesn't work well for many workloads
- Two issues with scripts/common/cb_cleanup.sh
- PLM: ycsb vm can't start because there is no template entry for "4-16384" vm configuration
- PLM: unintended error message displayed in CLI console
- key prefix of python-setuptools mismatch in PUBLIC_dependencies.txt and Dockerfile-ubuntu_cb_nullworkload
- Can't install workloads requiring Python 2 (e.g. ycsb) on Ubuntu 22.04 HOT 1
- Workload reports metrics even when it fails to run
- All workload start scripts get benchmark command's return code wrong
- Some workloads' dockerfiles hardcode ubuntu release code name
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cbtool.