ajnouri / coa Goto Github PK

Openstack Foundation Openstack Certified Administrator exam Preparation

License: MIT License

Shell 100.00%

openstack coa exam openstack-administrator-exam nova glance neutron swift cinder heatmap

coa's Introduction

Are you ready for the COA exam?

The following is a collection of exercices to get familiar with Openstack administration through the cli for the purpose of preparing for COA (Openstack Foundation Openstack Certified Administrator) exam:

CLI administration section:

Identity management
Compute
- Instances
- Quotas
Glance
Neutron
Cinder
- Instances snapshots
- Volume snapshots
- Volume backups
- Volume encryption
Swift
Orchestration (heat)
Telemetry (ceilometer)
Database

Exam practice & labbing:

Under construction:

Browse the page http://hpnouri.free.fr/coa, you'll find a series of tasks you can try to perform on your own lab. You can download the page index.html and run a local webserver in the same directory
ex: python -m SimpleHTTPServer 12345

By clicking on each tasks, the solution will be revealed.
Make sure to avoid the illusion of competency by trying your best to solve the question and consulting the documentation docs.openstack.org, the only reference available in the exam, before looking the answer. This will help consolidating a mental process to get to the solution.

Until the page http://hpnouri.free.fr/coa is built, you can simply use the above outline for more uptodate exercices and solutions.

Troubleshooting section:

I am collecting all issues I've encountered during the learning process, mainly, installing multinode openstack from scratch

In the issue section, look for issues labeled Troubleshooting. Opened issues are still under investigation, closed are solved.

Even though different root causes could have the same symptoms and some solutions are curcumstantial, they still gives a hint on how processes and configuration files are interconnected.

If you are lucky enough, you'll make a lot of mistakes to learn from and to be prepared for the exam :)

Exam references

DISCLAIMER!

The list of tasks and the format presented are suggested before taking the exam, so any matching is a pure coincidence.

VERY IMPORTANT!

Your contribution is very welcome and encouraged for both the content and the form.

And got it finally:

Documentation

My main reference for preparation is LinuxAcademy with their amazing OpenStack courses and On-Demand hands-on labs.
Openstack official Documentation
Troubleshooting swift

coa's People

Contributors

Stargazers

Watchers

coa's Issues

Swift: "Account HEAD failed", "Account GET failed"

On the CLI:
swift stat

Account HEAD failed: http://controller:8080/v1/AUTH_75b240c9b75a47e493f5b7f57f9a79d3 400 Bad Request

swift list

Account GET failed: http://controller:8080/v1/AUTH_75b240c9b75a47e493f5b7f57f9a79d3?format=json 400 Bad Request Invalid path: /sdb/980/AUTH_75b240c9b75a47e493f5b7f57f9a79d3

Horizon GUI:

Error: Unable to get the Swift container listing
Error: Unable to create the container.

glance: Warning: Invalid utf8 character string: '80027D' cursor.execute(statement, parameters)

During glance installation, when populating glance db
su -s /bin/sh -c "glance-manage db_sync" glance

/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py:324: Warning: Invalid utf8 character string: '80027D' cursor.execute(statement, parameters)

Accidentally removed keyston service: No handlers could be found for logger "keystoneclient.httpclient"

During troubleshooting other openstack service component, i accidentally deleted keystone service instead of another service

I cannot create it back

keystone endpoint-list

No handlers could be found for logger "keystoneclient.httpclient"

keystone service-create --name keystone --type identity --description "Openstack Identity"

No handlers could be found for logger "keystoneclient.httpclient"

keystone endpoint-list

No handlers could be found for logger "keystoneclient.httpclient"

root@controller:/home/ajn# keystone service-create --name keystone --type identity --description "Openstack Identity"

No handlers could be found for logger "keystoneclient.httpclient"

script to report configuration files of Openstack, per service.

1st commit:
swift config collect fb96c35

domain-specific Openstack installation (Liberty): Cannot list users nor assign "admin" role to "admin" user.

On domain-specific Openstack installation (Liberty), following installation documentation: identity I can list all domains, projects, roles.

But cannot list users or assign a role "admin" to a user "admin" (during identity service installation)

openstack user list

The request you have made requires authentication. (HTTP 401) (Request-ID: req-2acfb267-db78-48cd-a660-5e8f5e618240)

openstack role add --project admin --user admin admin

The request you have made requires authentication. (HTTP 401) (Request-ID: req-b50dc3ae-1f58-4678-80c6-b23343b86dd2)

openstack role add --domain default --user admin admin

The request you have made requires authentication. (HTTP 401) (Request-ID: req-c435621a-3875-470a-9987-84309deaa11b)

horizon: Something went wrong! An unexpected error has occurred. Try refreshing the page. If that doesn't help, contact your local administrator.

swift: mounting xfs disk, "mount: wrong fs type, bad option, bad superblock on /dev/sdb, missing codepage or helper program, or other error In some cases useful info is found in syslog - try dmesg | tail or so"

root@swift:/home/ajn# mkdir -p /srv/node/sdb
root@swift:/home/ajn# mount /srv/node/sdb
mount: wrong fs type, bad option, bad superblock on /dev/sdb,
missing codepage or helper program, or other error
In some cases useful info is found in syslog - try
dmesg | tail or so

Nova: Nova services don't start (stop/waiting)

ACCESS_REFUSED - Login was refused using authentication mechanism AMQPLAIN

Not all Neutron agents are shown in horizon

From the network node, all needed agents are running:

root@network:/# for agent in neutron-plugin-openvswitch-agent neutron-l3-agent neutron-dhcp-agent neutron-metadata-agent; do \
> service $agent status; done;
neutron-plugin-openvswitch-agent start/running, process 2101
neutron-l3-agent start/running, process 2145
neutron-dhcp-agent start/running, process 2170
neutron-metadata-agent start/running, process 2189

But Horizon doesn't show all agents as expected (from tutorial):

Swift client: [Errno 111] Connection refused, HTTPConnectionPool(host='controller', port=8080): Max retries exceeded

On either controller or swiftproxy nodes :

. admin-openrc.sh

Please enter your OpenStack Password:

swift list

HTTPConnectionPool(host='controller', port=8080): Max retries exceeded with url: /v1/AUTH_cdbcbc3eeb8a472c8abb2b67e749774c?format=json (Caused by <class 'socket.error'>: [Errno 111] Connection refused)

On swift proxy node:

root@swiftProxy:/#tail /var/log/syslog

Oct 19 00:48:48 swiftProxy proxy-server: Using /tmp/keystone-signing-EiU8XG as cache directory for signing certificate
Oct 19 00:48:48 swiftProxy proxy-server: Started child 2688
Oct 19 00:48:48 swiftProxy proxy-server: Adding required filter dlo to pipeline at position 0
Oct 19 00:48:48 swiftProxy proxy-server: Adding required filter gatekeeper to pipeline at position 0
Oct 19 00:48:48 swiftProxy proxy-server: Adding required filter catch_errors to pipeline at position 0
Oct 19 00:48:48 swiftProxy proxy-server: Pipeline was modified. New pipeline is "catch_errors gatekeeper dlo healthcheck memcache keystoneclient.middleware.auth_token:filter_factory keystoneauth proxy".
Oct 19 00:48:48 swiftProxy proxy-server: Starting keystone auth_token middleware
Oct 19 00:48:48 swiftProxy proxy-server: Configuring auth_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint
Oct 19 00:48:48 swiftProxy proxy-server: Using /tmp/keystone-signing-y6DDNe as cache directory for signing certificate
Oct 19 01:17:01 swiftProxy CRON[2734]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)

Swift: Conflict occurred attempting to store user

keystone user-create --name swift --pass linuxacademy123 --email [email protected]
Conflict occurred attempting to store user. (IntegrityError) (1062, "Duplicate entry 'default-swift' for key 'domain_id'") 'INSERT INTO user (id, name, domain_id, password, enabled, extra, default_project_id) VALUES (%s, %s, %s, %s, %s, %s, %s)' ('ddacf633cffe4de29ad839c4cd64dfc9', 'swift', 'default', '$6$rounds=40000$18UieXr8GEujQqpR$YZKinkqiqGRb06pCXNo6bBBBk7GoCZnvjfXGAKQFb0U5loGtGwC2CXTfL368h70GzeyNYAc8kTR1g5KeLsfHX.', 1, '{"email": "[email protected]"}', None) (HTTP 409)

Nova console: stuck in ""Booting from Hard Disk ... GRUB"

RDO All-In-One devstack (Newton) on Vmware workstation.

Ceilometer: Error communicating with http://controller:8777 [Errno 111] Connection refused

ceilometer alarm-list

Error communicating with http://controller:8777 [Errno 111] Connection refused

Cannot connect to Ceilometer endpoint.

The log file gives:

tail /var/log/ceilometer/ceilometer-api.log

2016-12-15 02:16:04.566 1167 TRACE ceilometer File "/usr/lib/python2.7/dist-packages/ceilometer/storage/impl_mongodb.py", line 82, in get_connection
2016-12-15 02:16:04.566 1167 TRACE ceilometer return Connection(conf)
2016-12-15 02:16:04.566 1167 TRACE ceilometer File "/usr/lib/python2.7/dist-packages/ceilometer/storage/impl_mongodb.py", line 428, in init
2016-12-15 02:16:04.566 1167 TRACE ceilometer self.conn = self.CONNECTION_POOL.connect(url)
2016-12-15 02:16:04.566 1167 TRACE ceilometer File "/usr/lib/python2.7/dist-packages/ceilometer/storage/pymongo_base.py", line 124, in connect
2016-12-15 02:16:04.566 1167 TRACE ceilometer safe=True)
2016-12-15 02:16:04.566 1167 TRACE ceilometer File "/usr/lib/python2.7/dist-packages/pymongo/mongo_client.py", line 352, in init
2016-12-15 02:16:04.566 1167 TRACE ceilometer raise ConnectionFailure(str(e))
2016-12-15 02:16:04.566 1167 TRACE ceilometer ConnectionFailure: could not connect to controller:27017: [Errno 111] ECONNREFUSED
2016-12-15 02:16:04.566 1167 TRACE ceilometer

COnfiguration with keystone service looks OK:

grep controller /etc/ceilometer/ceilometer.conf

connection = mongodb://ceilometer:PASSWD@controller:27017/ceilometer
auth_uri = http://controller:5000
auth_url = http://controller:35357
os_auth_url = http://controller:5000/v2.0
rabbit_host = controller

Cheking the services:

export CEILO_SVCS='agent-central agent-notification ceilometer-api ceilometer-collector alarm-evaluator alarm-notifier'
for svc in $CEILO_SVCS ; do sudo service ceilometer-$svc restart ; done

ceilometer-agent-central stop/waiting
ceilometer-agent-central start/running, process 3616
ceilometer-agent-notification stop/waiting
ceilometer-agent-notification start/running, process 3632
ceilometer-ceilometer-api: unrecognized service
ceilometer-ceilometer-collector: unrecognized service
ceilometer-alarm-evaluator stop/waiting
ceilometer-alarm-evaluator start/running, process 3658
ceilometer-alarm-notifier stop/waiting
ceilometer-alarm-notifier start/running, process 3678

service mongodb status

mongodb start/running, process 1164

Ceilometer-api and collector not running, though both installed:

apt list --installed | grep ceilometer

WARNING: apt does not have a stable CLI interface yet. Use with caution in scripts.

ceilometer-agent-central/trusty-updates,now 2014.1.5-0ubuntu2 all [installed]
ceilometer-agent-notification/trusty-updates,now 2014.1.5-0ubuntu2 all [installed]
ceilometer-alarm-evaluator/trusty-updates,now 2014.1.5-0ubuntu2 all [installed]
ceilometer-alarm-notifier/trusty-updates,now 2014.1.5-0ubuntu2 all [installed]
ceilometer-api/trusty-updates,now 2014.1.5-0ubuntu2 all [installed]
ceilometer-collector/trusty-updates,now 2014.1.5-0ubuntu2 all [installed]
ceilometer-common/trusty-updates,now 2014.1.5-0ubuntu2 all [installed,automatic]
python-ceilometer/trusty-updates,now 2014.1.5-0ubuntu2 all [installed,automatic]
python-ceilometerclient/trusty,now 1.0.8-0ubuntu1 all [installed]

Neutron router commands show: 404 Not Found The resource could not be found.

On the controller:
neutron router-list
or
neutron router-create "router1"
result in:

404 Not Found The resource could not be found.

Neutron log file /var/log/neutron/server.log shows:

2016-09-21 12:20:18.715 1117 ERROR neutron.openstack.common.rpc.common [-] AMQP server on controller:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds.

Swift with demo user: Unauthorised. Check username, password and tenant name/id

The demo user is not authorized to use swift service:

`. demo-openrc.sh`

`swift stat`

Unauthorised. Check username, password and tenant name/id

And from Horizon, it looks like this:

Create identity service: "An unexpected error prevented the server from fulfilling your request. (HTTP 500) (Request-ID: req-ed70ceef-c225-4f2e-a3cd-d7850f864df3)"

When trying to install the identity service from liberty installation docs:
http://docs.openstack.org/liberty/install-guide-ubuntu/keystone-services.html

openstack service create --name keystone --description "OpenStack Identity" identity

An unexpected error prevented the server from fulfilling your request. (HTTP 500) (Request-ID: req-ed70ceef-c225-4f2e-a3cd-d7850f864df3)

Log file gives:
tail /var/log/keystone/keystone-wsgi-admin.log

2016-11-09 00:41:05.712 2662 ERROR keystone.common.wsgi File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception
2016-11-09 00:41:05.712 2662 ERROR keystone.common.wsgi util.raise_from_cause(newraise, exc_info)
2016-11-09 00:41:05.712 2662 ERROR keystone.common.wsgi File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 199, in raise_from_cause
2016-11-09 00:41:05.712 2662 ERROR keystone.common.wsgi reraise(type(exception), exception, tb=exc_tb)
2016-11-09 00:41:05.712 2662 ERROR keystone.common.wsgi File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
2016-11-09 00:41:05.712 2662 ERROR keystone.common.wsgi context)
2016-11-09 00:41:05.712 2662 ERROR keystone.common.wsgi File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
2016-11-09 00:41:05.712 2662 ERROR keystone.common.wsgi cursor.execute(statement, parameters)
2016-11-09 00:41:05.712 2662 ERROR keystone.common.wsgi OperationalError: (sqlite3.OperationalError) no such table: service [SQL: u'INSERT INTO service (id, type, enabled, extra) VALUES (?, ?, ?, ?)'] [parameters: ('7f702fafd28848458ec5940433a6df47', u'identity', 1, '{"description": "OpenStack Identity", "name": "keystone"}')]
2016-11-09 00:41:05.712 2662 ERROR keystone.common.wsgi

glance: Request returned failure status. Invalid OpenStack Identity credentials.

Any glance client operation
ex: glance image-list

Request returned failure status.
Invalid OpenStack Identity credentials.

glance --debug image-list shows

wrong parameters (tenant.user or password)

Nova: The server has either erred or is incapable of performing the requested operation.

When performing
nova inage-list

ERROR: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-3ecfc01c-41af-4552-ae63-dd0407b4be5e)

Nova log files /var/log/nova/nova-api.log gives

TRACE nova.api.openstack CommunicationError: Error communicating with http://10.10.10.53:9292 [Errno 111] ECONNREFUSED

nova: admin not allowed to start an instance

domain-specific Openstack installation (Liberty): Generate token for user "user" The request you have made requires authentication. (HTTP 401)

On domain-specific Openstack installation (Liberty), following installation documentation: keystone verification.

Could not issue token for "demo" user using:

openstack --os-auth-url http://libcontroller:5000/v3  \
--os-project-domain-id default \
--os-user-domain-id default \
--os-project-name demo \
--os-username demo \
--os-auth-type password  \
token issue

Password:
The request you have made requires authentication. (HTTP 401) (Request-ID: req-fb58f2a0-5702-431a-89bf-c4550244b4b3)

Centos7 guest reboot after installation "libvirt: Requested operation is not valid: domain is not running"

Right after installation finished, the VM is like suspended and cannot shut it down.
and keep showing

"libvirt: Requested operation is not valid: domain is not running"

Openstack Keystone version v2 and v3: what and when to use?

I am using openstack command with keystone v3 API (http://X.X.239.4:5000/v3/) as follow:

openstack --os-auth-url http://X.X.239.4:5000/v3/ --os-project-domain-id default --os-user-domain-id default --os-project-name admin --os-username admin --os-auth-type password endpoint list
+----------------------------------+-----------+--------------+----------------+
| ID                               | Region    | Service Name | Service Type   |
+----------------------------------+-----------+--------------+----------------+
| 3d3605860ed144b584b40b059210add7 | RegionOne | swift        | object-store   |
| 5a24c9b20a874d0aae89a3013ec9773a | RegionOne | heat         | orchestration  |
| 0f9ef30badc54af3984327fea4ba49b1 | RegionOne | nova_legacy  | compute_legacy |
| 544e4daa8f3b41648654876a0cad7b06 | RegionOne | ec2          | ec2            |
| 8f901675d8504a5dad0039093c2d18e4 | RegionOne | nova         | compute        |
| 4ea0ca4e7ed04d19a76d48a0977e7c6d | RegionOne | heat-cfn     | cloudformation |
| 7c269c7ae8664d1aa06014b30d55fe37 | RegionOne | glance       | image          |
| 735bfa3e5c2c4981a4a3f47d55b38d0f | RegionOne | neutron      | network        |
| 8685440e3d73467792b6c106a8d9087c | RegionOne | keystone     | identity       |
| 28e29f53d54c4590b79a80f3036270da | RegionOne | cinderv2     | volumev2       |
| b5b9a6fd79b241d3bdfb46d75d94c698 | RegionOne | cinder       | volume         |
| 397dfa4339e5419c9ce2e0ac9f2d7883 | RegionOne | s3           | s3             |
+----------------------------------+-----------+--------------+----------------+

But when inspecting keystone endpoint I got v2 as OS auth url

openstack --os-auth-url http://X.X.239.4:5000/v3/ --os-project-domain-id default --os-user-domain-id default --os-project-name admin --os-username admin --os-auth-type password endpoint show 8685440e3d73467792b6c106a8d9087c
+--------------+----------------------------------+
| Field        | Value                            |
+--------------+----------------------------------+
| adminurl     | http://X.X.239.4:35357/v2.0  |
| enabled      | True                             |
| id           | 8685440e3d73467792b6c106a8d9087c |
| internalurl  | http://X.X.239.4:5000/v2.0   |
| publicurl    | http://X.X.239.4:5000/v2.0   |
| region       | RegionOne                        |
| service_id   | 58c80619effb4cf7896d309d169d0f20 |
| service_name | keystone                         |
| service_type | identity                         |
+--------------+----------------------------------+

If I reissue the openstack command using v2 url (http://X.X.239.4:35357/v2.0) doesn't accept the url version:

openstack --os-auth-url http://X.X.239.4:35357/v2.0 --os-project-domain-id default --os-user-domain-id default --os-project-name admin --os-username admin --os-auth-type password endpoint show 8685440e3d73467792b6c106a8d9087c
Could not determine a suitable URL for the plugin

Are they both keystone authentication url versions serving different purpose?

Brake things, generally configuration and service-related parameters and analyse the consequences

Swift-proxy: start: Job failed to start

After configuring swift and swiftproxy nodes, cannot start swift-proxy on swift-proxy node:

syslog file:
root@swiftProxy:/etc/swift# tail /var/log/syslog

Oct 13 06:39:12 swiftProxy kernel: [ 10.299904] init: plymouth-upstart-bridge main process (236) killed by TERM signal
Oct 13 06:40:12 swiftProxy ntpdate[778]: step time server 91.189.89.198 offset 55.365267 sec
Oct 13 06:40:28 swiftProxy ntpdate[1175]: adjust time server 91.189.89.198 offset 0.000298 sec
Oct 13 07:17:01 swiftProxy CRON[1188]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Oct 13 08:17:01 swiftProxy CRON[1275]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Oct 13 09:17:01 swiftProxy CRON[2359]: (root) CMD ( cd / && run-parts --report /etc/cron.hourly)
Oct 13 09:18:52 swiftProxy kernel: [ 9535.121254] init: swift-proxy pre-start process (2381) terminated with status 1
Oct 13 09:18:52 swiftProxy kernel: [ 9535.221865] init: swift-proxy post-stop process (2387) terminated with status 1
Oct 13 09:19:32 swiftProxy kernel: [ 9574.854161] init: swift-proxy pre-start process (2397) terminated with status 1
Oct 13 09:19:32 swiftProxy kernel: [ 9574.974138] init: swift-proxy post-stop process (2403) terminated with status 1

keystone endpoint-get: publicURL endpoint for <> not found

Though the corresponding services works fine,
keystone endpoint-get commands shows "publicURL endpoint for swift not found"

ajn@controller:~$ ```
keystone endpoint-create \

--service-id=$(keystone service-list | awk '/ object-store / {print $2}')
--publicurl="http://swiftProxy:8080/v1/AUTH_%(tenant_id)s"
--internalurl="http://swiftProxy:8080/v1/AUTH_%(tenant_id)s"
--adminurl="http://swiftProxy:8080"
--region regionOne


+-------------+----------------------------------------------+
|   Property  |                    Value                     |
+-------------+----------------------------------------------+
|   adminurl  |            http://swiftProxy:8080            |
|      id     |       a3a8732079e245ccbe4efcddc065cd12       |
| internalurl | http://swiftProxy:8080/v1/AUTH_%(tenant_id)s |
|  publicurl  | http://swiftProxy:8080/v1/AUTH_%(tenant_id)s |
|    region   |                  regionOne                   |
|  service_id |       1f53ecf0429444238e3f9e816b8cc4f9       |
+-------------+----------------------------------------------+

ajn@controller:~$ keystone endpoint-get --service swift

publicURL endpoint for swift not found

Same for other services:

ajn@controller:~$ keystone endpoint-get --service cinder

publicURL endpoint for cinder not found

ajn@controller:~$ keystone endpoint-get --service glance

publicURL endpoint for glance not found

ajn@controller:~$ keystone endpoint-get --service neutron

publicURL endpoint for neutron not found

ceilometer: python-ceilometermiddleware package installation errors

Environment:

Distributor ID: Ubuntu
Description: Ubuntu 14.04.5 LTS
Release: 14.04 Codename: trusty
Linux controller 4.4.0-31-generic
50~14.04.1-Ubuntu SMP Wed Jul 13 01:07:32 UTC 2016 x86_64 x86_64
x86_64 GNU/Linux

I am installing Telemetry service on my OpenStack Liberty for object storage service:

Looks like there is no package for Ubuntu

apt-get install python-ceilometermiddleware

Reading package lists... Done Building
dependency tree Reading state
information... Done
E: Unable to locate package python-ceilometermiddleware

And pip install gives error:
http://docs.openstack.org/developer/ceilometermiddleware/installation.html

pip install ceilometermiddleware

...
Downloading/unpacking netifaces>=0.10.4 (from oslo.utils->ceilometermiddleware)
Downloading netifaces-0.10.5.tar.gz
Running setup.py (path:/tmp/pip_build_root/netifaces/setup.py) egg_info for package netifaces

Downloading/unpacking tenacity>=3.2.1 (from oslo.messaging>=5.2.0->ceilometermiddleware)
Downloading tenacity-3.5.0.tar.gz
Running setup.py (path:/tmp/pip_build_root/tenacity/setup.py) egg_info for package tenacity
error in setup command: 'install_requires' must be a string or list of strings containing valid project/version requirement specifiers
Complete output from command python setup.py egg_info:
error in setup command: 'install_requires' must be a string or list of strings containing valid project/version requirement specifiers

--
Cleaning up...
Command python setup.py egg_info failed with error code 1 in /tmp/pip_build_root/tenacity
Storing debug log for failure in /root/.pip/pip.log

The specified log files gives:

tail  /root/.pip/pip.log

status = self.run(options, args) File
"/usr/lib/python2.7/dist-packages/pip/commands/install.py",
line 278, in run
requirement_set.prepare_files(finder,
force_root_egg_info=self.bundle,
bundle=self.bundle) File
"/usr/lib/python2.7/dist-packages/pip/req.py",
line 1230, in prepare_files
req_to_install.run_egg_info() File
"/usr/lib/python2.7/dist-packages/pip/req.py",
line 326, in run_egg_info
command_desc='python setup.py egg_info') File
"/usr/lib/python2.7/dist-packages/pip/util.py",
line 715, in call_subprocess
% (command_desc, proc.returncode, cwd)) InstallationError: Command
python setup.py egg_info failed with
error code 1 in
/tmp/pip_build_root/tenacity

ceilometer: dpkg error processing of ceilometer packages due to dependency problems

Problem with Ceilometer installation on Ubuntu 14.04

Openstack liberty

> Distributor ID:	Ubuntu
> Description:	Ubuntu 14.04.5 LTS
> Release:	14.04 Codename:	trusty
> 138-Ubuntu SMP Fri Jun 24 17:00:34 UTC
> 2016 x86_64 x86_64 x86_64 GNU/Linux

Complaining about dpkg error processing of ceilometer packages due to dependency problems:

apt-get install ceilometer-api ceilometer-collector \
ceilometer-agent-central ceilometer-agent-notification \
ceilometer-alarm-evaluator ceilometer-alarm-notifier \
python-ceilometerclient

Reading package lists... Done Building
dependency tree Reading state
information... Done The following
extra packages will be installed:
ceilometer-common python-ceilometer
Suggested packages: python-pysnmp4
The following NEW packages will be
installed: ceilometer-agent-central
ceilometer-agent-notification
ceilometer-alarm-evaluator
ceilometer-alarm-notifier
ceilometer-api ceilometer-collector
ceilometer-common python-ceilometer
python-ceilometerclient 0 upgraded, 9
newly installed, 0 to remove and 0 not
upgraded. Need to get 0 B/597 kB of
archives. After this operation, 8,214
kB of additional disk space will be
used. Do you want to continue? [Y/n] Y
Selecting previously unselected
package python-ceilometerclient.
(Reading database ... 110527 files and
directories currently installed.)
Preparing to unpack
.../python-ceilometerclient_1.0.8-0ubuntu1_all.deb
... Unpacking python-ceilometerclient
(1.0.8-0ubuntu1) ... Selecting
previously unselected package
python-ceilometer. Preparing to unpack
.../python-ceilometer_2014.1.5-0ubuntu2_all.deb
... Unpacking python-ceilometer
(2014.1.5-0ubuntu2) ... Selecting
previously unselected package
ceilometer-common. Preparing to unpack
.../ceilometer-common_2014.1.5-0ubuntu2_all.deb
... Unpacking ceilometer-common
(2014.1.5-0ubuntu2) ... Selecting
previously unselected package
ceilometer-agent-central. Preparing to
unpack
.../ceilometer-agent-central_2014.1.5-0ubuntu2_all.deb
... Unpacking ceilometer-agent-central
(2014.1.5-0ubuntu2) ... Selecting
previously unselected package
ceilometer-agent-notification.
Preparing to unpack
.../ceilometer-agent-notification_2014.1.5-0ubuntu2_all.deb
... Unpacking
ceilometer-agent-notification
(2014.1.5-0ubuntu2) ... Selecting
previously unselected package
ceilometer-alarm-evaluator. Preparing
to unpack
.../ceilometer-alarm-evaluator_2014.1.5-0ubuntu2_all.deb
... Unpacking
ceilometer-alarm-evaluator
(2014.1.5-0ubuntu2) ... Selecting
previously unselected package
ceilometer-alarm-notifier. Preparing
to unpack
.../ceilometer-alarm-notifier_2014.1.5-0ubuntu2_all.deb
... Unpacking
ceilometer-alarm-notifier
(2014.1.5-0ubuntu2) ... Selecting
previously unselected package
ceilometer-api. Preparing to unpack
.../ceilometer-api_2014.1.5-0ubuntu2_all.deb
... Unpacking ceilometer-api
(2014.1.5-0ubuntu2) ... Selecting
previously unselected package
ceilometer-collector. Preparing to
unpack
.../ceilometer-collector_2014.1.5-0ubuntu2_all.deb
... Unpacking ceilometer-collector
(2014.1.5-0ubuntu2) ... Processing
triggers for ureadahead (0.100.0-16)
... Setting up python-ceilometerclient
(1.0.8-0ubuntu1) ... Setting up
python-ceilometer (2014.1.5-0ubuntu2)
... Setting up ceilometer-common
(2014.1.5-0ubuntu2) ... Traceback
(most recent call last): File
"/usr/bin/ceilometer-dbsync", line 6,
in
from ceilometer.cli import storage_dbsync File
"/usr/lib/python2.7/dist-packages/ceilometer/cli.py",
line 32, in
from oslo.config import cfg ImportError: No module named config
dpkg: error processing package
ceilometer-common (--configure):
subprocess installed post-installation
script returned error exit status 1
dpkg: dependency problems prevent
configuration of
ceilometer-agent-central:
ceilometer-agent-central depends on
ceilometer-common (=
2014.1.5-0ubuntu2); however: Package ceilometer-common is not configured
yet.

dpkg: error processing package
ceilometer-agent-central
(--configure): dependency problems -
leaving unconfigured dpkg: dependency
problems prevent configuration of
ceilometer-agent-notification:
ceilometer-agent-notification depends
on ceilometer-common (=
2014.1.5-0ubuntu2); however: Package ceilometer-common is not configured
yet.

dpkg: error processing package
ceilometer-agent-notification
(--configure): dependency problems -
leaving unconfigured dpkg: dependency
problems prevent configuration of
ceilometer-alarm-evaluator:
ceilometer-alarm-evaluator depends on
ceilometer-common (=
2014.1.5-0ubuntu2); however: Package ceilometer-coNo apport report written
because the error message indicates
its a followup error from a previous
failure.
No apport report written because the
error message indicates its a followup
error from a previous failure.
No apport report written because
MaxReports is reached already
No apport report written because
MaxReports is reached already
No apport report written because
MaxReports is reached already
No apport report written because
MaxReports is reached already
mmon is not configured yet.

dpkg: error processing package
ceilometer-alarm-evaluator
(--configure): dependency problems -
leaving unconfigured dpkg: dependency
problems prevent configuration of
ceilometer-alarm-notifier:
ceilometer-alarm-notifier depends on
ceilometer-common (=
2014.1.5-0ubuntu2); however: Package ceilometer-common is not configured
yet.

dpkg: error processing package
ceilometer-alarm-notifier
(--configure): dependency problems -
leaving unconfigured dpkg: dependency
problems prevent configuration of
ceilometer-api: ceilometer-api
depends on ceilometer-common (=
2014.1.5-0ubuntu2); however: Package ceilometer-common is not configured
yet.

dpkg: error processing package
ceilometer-api (--configure):
dependency problems - leaving
unconfigured dpkg: dependency problems
prevent configuration of
ceilometer-collector:
ceilometer-collector depends on
ceilometer-common (=
2014.1.5-0ubuntu2); however: Package ceilometer-common is not configured
yet.

dpkg: error processing package
ceilometer-collector (--configure):
dependency problems - leaving
unconfigured Errors were encountered
while processing: ceilometer-common
ceilometer-agent-central
ceilometer-agent-notification
ceilometer-alarm-evaluator
ceilometer-alarm-notifier
ceilometer-api ceilometer-collector
E: Sub-process /usr/bin/dpkg returned
an error code (1)

Tried to remove-purge the packages and upgrade the system, no success:

sudo apt-get purge ceilometer-api ceilometer-collector ceilometer-agent-central ceilometer-agent-notification ceilometer-alarm-evaluator ceilometer-alarm-notifier python-ceilometerclient
sudo apt-get --purge autoremove
sudo apt-get autoclean
sudo rm -rf /var/lib/ceilometer/ /var/log/ceilometer
sudo deluser ceilometer
sudo apt-get update
sudo apt-get dist-upgrade

volume snapshot content not resored

I am trying to create a volume, put some data, snapshot it, create a new volume from the snapshot, delete original volume and its snapshot, and recover the data from the new volume, but I cannot recover the original data:

1- Create a volume
2- Create an instance
3- Attach the volume to the instance
4- Console to the instnce
5- Format, mount the partition and create a file in the mounting directory /mnt/vdb
6- Detach the volume
7- Create a snapshot of the volume
8- Create a volume from the snapshot
9- Delete the original volume and its snapshot
10- Attach the volume created from the snapshot to the instance
11- Console to the instance
==> no trace of the created file

1- Create a volume

cinder create --name vol1 1

2- Create an instance

root@ubuntu-openstack-liberty23082016-123009:~# nova boot --flavor m1.tiny --security-groups new-secgroup --image cirros-0.3.4-x86_64-uec instance1

3- Attach the volume to the instance

root@ubuntu-openstack-liberty23082016-123009:~# nova volume-attach a0342488-3c72-4791-ae5e-ce18a5566526 90d3913f-f3a0-4caa-aeab-53b7ca360881
+----------+--------------------------------------+
| Property | Value                                |
+----------+--------------------------------------+
| device   | /dev/vdb                             |
| id       | 90d3913f-f3a0-4caa-aeab-53b7ca360881 |
| serverId | a0342488-3c72-4791-ae5e-ce18a5566526 |
| volumeId | 90d3913f-f3a0-4caa-aeab-53b7ca360881 |
+----------+--------------------------------------+

4- Console to the instnce

root@ubuntu-openstack-liberty23082016-123009:~# ssh [email protected]

5- Format, mount the partition and create a file in the mounting directory /mnt/vdb

sudo mkfs.ext3 /dev/vdb
sudo mount /dev/vdb /mnt/vdb

$ echo "data" > /mnt/vdb/testfile.txt
$ sync && sleep2
$ exit

6- Detach the volume

root@ubuntu-openstack-liberty23082016-123009:~# nova volume-detach a0342488-3c72-4791-ae5e-ce18a5566526 90d3913f-f3a0-4caa-aeab-53b7ca360881

7- Create a snapshot of the volume

root@ubuntu-openstack-liberty23082016-123009:~# cinder snapshot-create --name snapshot-of-vol1 90d3913f-f3a0-4caa-aeab-53b7ca360881
+-------------+--------------------------------------+
|   Property  |                Value                 |
+-------------+--------------------------------------+
|  created_at |      2016-08-24T00:47:09.788915      |
| description |                 None                 |
|      id     | bc953f1d-ff98-415e-a4ff-f22d4c70f1ac |
|   metadata  |                  {}                  |
|     name    |           snapshot-of-vol1           |
|     size    |                  1                   |
|    status   |               creating               |
|  volume_id  | 90d3913f-f3a0-4caa-aeab-53b7ca360881 |
+-------------+--------------------------------------+
root@ubuntu-openstack-liberty23082016-123009:~# cinder snapshot-list
+--------------------------------------+--------------------------------------+-----------+------------------+------+
|                  ID                  |              Volume ID               |   Status  |       Name       | Size |
+--------------------------------------+--------------------------------------+-----------+------------------+------+
| bc953f1d-ff98-415e-a4ff-f22d4c70f1ac | 90d3913f-f3a0-4caa-aeab-53b7ca360881 | available | snapshot-of-vol1 |  1   |
+--------------------------------------+--------------------------------------+-----------+------------------+------+

8- Create a volume from the snapshot

root@ubuntu-openstack-liberty23082016-123009:~# cinder create --snapshot-id bc953f1d-ff98-415e-a4ff-f22d4c70f1ac --name vol2-from-snapshot-of-vol1

root@ubuntu-openstack-liberty23082016-123009:~# cinder list
+--------------------------------------+-----------+----------------------------+------+-------------+----------+-------------+-------------+
|                  ID                  |   Status  |            Name            | Size | Volume Type | Bootable | Multiattach | Attached to |
+--------------------------------------+-----------+----------------------------+------+-------------+----------+-------------+-------------+
| 90d3913f-f3a0-4caa-aeab-53b7ca360881 | available |            vol1            |  1   | lvmdriver-1 |  false   |    False    |             |
| e2a5b327-2485-42a2-b97f-6e76d5327b52 | available | vol2-from-snapshot-of-vol1 |  1   | lvmdriver-1 |  false   |    False    |             |
+--------------------------------------+-----------+----------------------------+------+-------------+----------+-------------+-------------+

9- Delete the original volume and its snapshot

root@ubuntu-openstack-liberty23082016-123009:~# cinder snapshot-delete bc953f1d-ff98-415e-a4ff-f22d4c70f1ac
root@ubuntu-openstack-liberty23082016-123009:~# cinder delete 90d3913f-f3a0-4caa-aeab-53b7ca360881
Request to delete volume 90d3913f-f3a0-4caa-aeab-53b7ca360881 has been accepted.



root@ubuntu-openstack-liberty23082016-123009:~# cinder list

+--------------------------------------+-----------+----------------------------+------+-------------+----------+-------------+-------------+
|                  ID                  |   Status  |            Name            | Size | Volume Type | Bootable | Multiattach | Attached to |
+--------------------------------------+-----------+----------------------------+------+-------------+----------+-------------+-------------+
| e2a5b327-2485-42a2-b97f-6e76d5327b52 | available | vol2-from-snapshot-of-vol1 |  1   | lvmdriver-1 |  false   |    False    |             |
+--------------------------------------+-----------+----------------------------+------+-------------+----------+-------------+-------------+
root@ubuntu-openstack-liberty23082016-123009:~# nova list
+--------------------------------------+-----------+--------+------------+-------------+--------------------------------------------------------+
| ID                                   | Name      | Status | Task State | Power State | Networks                                               |
+--------------------------------------+-----------+--------+------------+-------------+--------------------------------------------------------+
| a0342488-3c72-4791-ae5e-ce18a5566526 | instance1 | ACTIVE | -          | Running     | private=10.0.0.3, fdac:2033:33e4:0:f816:3eff:fed2:d970 |
+--------------------------------------+-----------+--------+------------+-------------+--------------------------------------------------------+

10- Attach the volume created from the snapshot to the instance

root@ubuntu-openstack-liberty23082016-123009:~# nova volume-attach a0342488-3c72-4791-ae5e-ce18a5566526 e2a5b327-2485-42a2-b97f-6e76d5327b52
+----------+--------------------------------------+
| Property | Value                                |
+----------+--------------------------------------+
| device   | /dev/vdb                             |
| id       | e2a5b327-2485-42a2-b97f-6e76d5327b52 |
| serverId | a0342488-3c72-4791-ae5e-ce18a5566526 |
| volumeId | e2a5b327-2485-42a2-b97f-6e76d5327b52 |
+----------+--------------------------------------+

11- Console to the instance

root@ubuntu-openstack-liberty23082016-123009:~# ssh [email protected]
[email protected]'s password: 
$ 
$ df -h
Filesystem                Size      Used Available Use% Mounted on
/dev                    242.2M         0    242.2M   0% /dev
/dev/vda                 23.2M      9.6M     12.4M  44% /
tmpfs                   245.8M         0    245.8M   0% /dev/shm
tmpfs                   200.0K    108.0K     92.0K  54% /run
/dev/vdb               1007.9M     33.3M    923.4M   3% /mnt/vdb
$ cd /mnt/vdb
$ ls
$

==> no trace of the created file

Cannot Add interface from public subnet to a router

From a domain "domain1" a user, non-admin, cannot add a public interface to a router, even though the IP is not allocated.

Got this error:

Error: Failed to add_interface: (rule:create_port and rule:create_port:fixed_ips) on {'binding:host_id': <neutron_lib.constants.Sentinel object at 0x3638610>, 'description': '', 'allowed_address_pairs': <neutron_lib.constants.Sentinel object at 0x3638610>, 'admin_state_up': True, u'network_id': u'1f611bfc-4279-4017-a27e-3b17341a6e95', u'tenant_id': u'd9fb488a66d540058c7cda0bb726fb91', 'extra_dhcp_opts': None, 'name': '', 'device_owner': '', 'binding:vnic_type': 'normal', 'mac_address': <neutron_lib.constants.Sentinel object at 0x3638610>, 'binding:profile': <neutron_lib.constants.Sentinel object at 0x3638610>, 'project_id': u'd9fb488a66d540058c7cda0bb726fb91', u'fixed_ips': [{u'subnet_id': u'860ade7e-5869-4077-b7c3-a385935837fe', u'ip_address': u'172.24.224.226'}], 'network:tenant_id': u'b2c5722772f241198eaaa0b3c53c082a', 'security_groups': <neutron_lib.constants.Sentinel object at 0x3638610>, 'device_id': ''} by {'domain': None, 'project_name': u'd1project1', 'tenant_name': u'd1project1', 'project_domain': None, 'timestamp': '2016-11-13 00:49:59.482831', 'auth_token': 'cd27ee0c3ae44b9ab9150e5fed40bc2d', 'resource_uuid': None, 'is_admin': False, 'user': u'1c3f7243130d44fcb42c8ed2901990c1', 'tenant': u'd9fb488a66d540058c7cda0bb726fb91', 'read_only': False, 'project_id': u'd9fb488a66d540058c7cda0bb726fb91', 'user_id': u'1c3f7243130d44fcb42c8ed2901990c1', 'show_deleted': False, 'roles': [u'member'], 'user_identity': u'1c3f7243130d44fcb42c8ed2901990c1 d9fb488a66d540058c7cda0bb726fb91 - - -', 'tenant_id': u'd9fb488a66d540058c7cda0bb726fb91', 'is_admin_project': True, 'request_id': 'req-2c57b7ba-71f0-4c68-a7cf-83ab9c50a773', 'user_domain': None, 'user_name': u'user3'} disallowed by policy Neutron server returns request_ids: ['req-2c57b7ba-71f0-4c68-a7cf-83ab9c50a773']

Mongodb: couldn't connect to server controller:27017 at src/mongo/shell/mongo.js:147

When creating Ceilometer database:

mongo --host controller --eval '
db = db.getSiblingDB("ceilometer");
db.addUser({user: "ceilometer",
pwd: MONGODB_PASSWORD,
roles: [ "readWrite", "dbAdmin" ]})'

I got the error:

Error: couldn't connect to server controller:27017 at src/mongo/shell/mongo.js:147

The correct controller IP is configured in mongodb config file
/etc/mongodb.conf

bind_ip = 10.10.10.51

The databse service looks OK:
service mongodb status

mongodb start/running, process 3202

pinging the controller resolves to 127.0.0.1 ??!! A bit strange
ping controller

PING controller (127.0.1.1) 56(84) bytes of data.
64 bytes from controller (127.0.1.1): icmp_seq=1 ttl=64 time=0.045 ms
64 bytes from controller (127.0.1.1): icmp_seq=2 ttl=64 time=0.038 ms
64 bytes from controller (127.0.1.1): icmp_seq=3 ttl=64 time=0.049 ms

New router interfaces down

New router interfaces "DOWN"

Any new router I create has intrefaces "DOWN".
Here is the steps I am doing:

Created a new private network "private1"
Created a new public
network "public2" with different subnet pool
(172.24.4.20,172.24.4.30) than the default one used
(172.24.4.2,172.24.4.10), I changed the end range to 10 instead of254.
Created a new router "router2", connected to private network
"private1" and set "public2" as default gateway.

The issue is that the new router "router1" have all its interface statuses DOWN.

LA lab

When inspecting the namespaces, I can see both private networks and the default router, but not the new router I created.

ip netns  
qdhcp-76d4b3bc-8b95-4705-8552-811261ceb021 
qrouter-ceb5ca2f-b3fc-4d26-b675-635ddb6d4ca8  
qdhcp-7e17706c-9566-43e1-9d81-1cb9757d6e1c

By the way I have noticed that it is the same for the router created in Red Hat OpenStack Administrator Certification Prep Course "Configure the Tenants Networks"

Linux Academy Red Hat OpenStack Administrator Certification Prep Course

Same for Openstack on Ubuntu

Deploy and Manage OpenStack on Ubuntu - Icehouse

Any hint about a possible cause?

RDO AIO : VM not reaching Internet / outside (host) networks

br-ext interface, which is supposed to connect to host network and from there to Internet, was DOWN.
And no IP address configured.

Troubleshooting:
Brought the interface br-ext UP and pinging 8.8.8.8 from a started VM and sniffing the host br-ext interface, which is supposed to connect to host network and from there to Internet, I could see the arp messages from the VM not able to reach the default gateway on the router:

tcpdump -i br-ex

tcpdump: WARNING: br-ex: no IPv4 address assigned
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on br-ex, link-type EN10MB (Ethernet), capture size 65535 bytes
10:59:50.418966 ARP, Request who-has 172.24.4.225 tell 172.24.4.231, length 28
10:59:51.420156 ARP, Request who-has 172.24.4.225 tell 172.24.4.231, length 28
10:59:52.422163 ARP, Request who-has 172.24.4.225 tell 172.24.4.231, length 28
10:59:54.421406 ARP, Request who-has 172.24.4.225 tell 172.24.4.231, length 28
10:59:55.422171 ARP, Request who-has 172.24.4.225 tell 172.24.4.231, length 28
10:59:56.424161 ARP, Request who-has 172.24.4.225 tell 172.24.4.231, length 28

Cannot find the ring associated files: account.ring.gz, container.ring.gz, object.ring.gz

When installing swift, and after building the ring, I could not find the associated (pickeled) files:

account.ring.gz
container.ring.gz
object.ring.gz

And I got the following when tryinjg to rebalance the ring associated to container/account/object

ajn@controller:/etc/swift$ sudo swift-ring-builder object.builder rebalance

An error has occurred during ring validation. Common

causes of failure are rings that are empty or do not

have enough devices to accommodate the replica count.

Original exception message:

Replica count of 3.0 requires more than 1 devices

ajn@controller:/etc/swift$ sudo swift-ring-builder container.builder rebalance

An error has occurred during ring validation. Common

causes of failure are rings that are empty or do not

have enough devices to accommodate the replica count.

Original exception message:

Replica count of 3.0 requires more than 1 devices

ajn@controller:/etc/swift$ sudo swift-ring-builder account.builder rebalance

An error has occurred during ring validation. Common

causes of failure are rings that are empty or do not

have enough devices to accommodate the replica count.

Original exception message:

Replica count of 3.0 requires more than 1 devices

cinder create : ERROR: Volume API version is set to 1 but you are accessing a 2 endpoint.

cinder create --display-name myVolume 1

ERROR: Volume API version is set to 1 but you are accessing a 2 endpoint. Change its value via either --os-volume-api-version or env[OS_VOLUME_API_VERSION]

With debug inf.

cinder --debug create --display-name myVolume 1

REQ: curl -i http://controller:35357/v2.0/tokens -X POST -H "Content-Type: application/json" -H "Accept: application/json" -H "User-Agent: python-cinderclient" -d '{"auth": {"tenantName": "admin", "passwordCredentials": {"username": "admin", "password": "linuxacademy123"}}}'

DEBUG:cinderclient.client:
REQ: curl -i http://controller:35357/v2.0/tokens -X POST -H "Content-Type: application/json" -H "Accept: application/json" -H "User-Agent: python-cinderclient" -d '{"auth": {"tenantName": "admin", "passwordCredentials": {"username": "admin", "password": "linuxacademy123"}}}'

RESP: [200] CaseInsensitiveDict({'date': 'Fri, 23 Sep 2016 15:32:44 GMT', 'vary': 'X-Auth-Token', 'content-length': '5440', 'content-type': 'application/json', 'x-distribution': 'Ubuntu'})
RESP BODY: {"access": {"token": {"issued_at": "2016-09-23T15:32:44.342635", "expires": "2016-09-23T16:32:44Z", "id": "MIIJ4AYJKoZIhvcNAQcCoIIJ0TCCCc0CAQExDTALBglghkgBZQMEAgEwggguBgkqhkiG9w0BBwGggggfBIIIG3siYWNjZXNzIjogeyJ0b2tlbiI6IHsiaXNzdWVkX2F0IjogIjIwMTYtMDktMjNUMTU6MzI6NDQuMzQyNjM1IiwgImV4cGlyZXMiOiAiMjAxNi0wOS0yM1QxNjozMjo0NFoiLCAiaWQiOiAicGxhY2Vob2xkZXIiLCAidGVuYW50IjogeyJkZXNjcmlwdGlvbiI6ICJBZG1pbiB0ZW5hbnQiLCAiZW5hYmxlZCI6IHRydWUsICJpZCI6ICJjZGJjYmMzZWViOGE0NzJjOGFiYjJiNjdlNzQ5Nzc0YyIsICJuYW1lIjogImFkbWluIn19LCAic2VydmljZUNhdGFsb2ciOiBbeyJlbmRwb2ludHMiOiBbeyJhZG1pblVSTCI6ICJodHRwOi8vY29udHJvbGxlcjo4Nzc2L3YxL2NkYmNiYzNlZWI4YTQ3MmM4YWJiMmI2N2U3NDk3NzRjIiwgInJlZ2lvbiI6ICJyZWdpb25PbmUiLCAiaW50ZXJuYWxVUkwiOiAiaHR0cDovL2NvbnRyb2xsZXI6ODc3Ni92Mi9jZGJjYmMzZWViOGE0NzJjOGFiYjJiNjdlNzQ5Nzc0YyIsICJpZCI6ICIwYWM5ZDhjNTBiMmE0MzE5OWIyN2UyZWEzMDIyOTYzOSIsICJwdWJsaWNVUkwiOiAiaHR0cDovL2NvbnRyb2xsZXI6ODc3Ni92Mi9jZGJjYmMzZWViOGE0NzJjOGFiYjJiNjdlNzQ5Nzc0YyJ9XSwgImVuZHBvaW50c19saW5rcyI6IFtdLCAidHlwZSI6ICJ2b2x1bWUiLCAibmFtZSI6ICJjaW5kZXIifSwgeyJlbmRwb2ludHMiOiBbeyJhZG1pblVSTCI6ICJodHRwOi8vY29udHJvbGxlcjo5MjkyIiwgInJlZ2lvbiI6ICJyZWdpb25PbmUiLCAiaW50ZXJuYWxVUkwiOiAiaHR0cDovL2NvbnRyb2xsZXI6OTI5MiIsICJpZCI6ICIwNmVhOWEzZjJlMzg0Yjc2OTNlY2Q5NTdmY2ZiMzM3YiIsICJwdWJsaWNVUkwiOiAiaHR0cDovL2NvbnRyb2xsZXI6OTI5MiJ9XSwgImVuZHBvaW50c19saW5rcyI6IFtdLCAidHlwZSI6ICJpbWFnZSIsICJuYW1lIjogImdsYW5jZSJ9LCB7ImVuZHBvaW50cyI6IFt7ImFkbWluVVJMIjogImh0dHA6Ly9jb250cm9sbGVyOjg3NzQvdjIvY2RiY2JjM2VlYjhhNDcyYzhhYmIyYjY3ZTc0OTc3NGMiLCAicmVnaW9uIjogInJlZ2lvbk9uZSIsICJpbnRlcm5hbFVSTCI6ICJodHRwOi8vY29udHJvbGxlcjo4Nzc0L3YyL2NkYmNiYzNlZWI4YTQ3MmM4YWJiMmI2N2U3NDk3NzRjIiwgImlkIjogIjBmOGNlNmM1YjU3ZDRlNDY4YTdiZGY4ZTA1ZDEyNzdhIiwgInB1YmxpY1VSTCI6ICJodHRwOi8vY29udHJvbGxlcjo4Nzc0L3YyL2NkYmNiYzNlZWI4YTQ3MmM4YWJiMmI2N2U3NDk3NzRjIn1dLCAiZW5kcG9pbnRzX2xpbmtzIjogW10sICJ0eXBlIjogImNvbXB1dGUiLCAibmFtZSI6ICJub3ZhIn0sIHsiZW5kcG9pbnRzIjogW3siYWRtaW5VUkwiOiAiaHR0cDovL2NvbnRyb2xsZXI6OTY5NiIsICJyZWdpb24iOiAicmVnaW9uT25lIiwgImludGVybmFsVVJMIjogImh0dHA6Ly9jb250cm9sbGVyOjk2OTYiLCAiaWQiOiAiNTBhNDkzZjJkY2IxNGNmZjllZWRkMmZmY2E1NDFiMTQiLCAicHVibGljVVJMIjogImh0dHA6Ly9jb250cm9sbGVyOjk2OTYifV0sICJlbmRwb2ludHNfbGlua3MiOiBbXSwgInR5cGUiOiAibmV0d29yayIsICJuYW1lIjogIm5ldXRyb24ifSwgeyJlbmRwb2ludHMiOiBbeyJhZG1pblVSTCI6ICJodHRwOi8vY29udHJvbGxlcjozNTM1Ny92Mi4wIiwgInJlZ2lvbiI6ICJyZWdpb25PbmUiLCAiaW50ZXJuYWxVUkwiOiAiaHR0cDovL2NvbnRyb2xsZXI6NTAwMC92Mi4wIiwgImlkIjogIjc2ZjJlMzUyZmU0MjRkMDM4YmI4MDUzMjExMWYwMTNmIiwgInB1YmxpY1VSTCI6ICJodHRwOi8vY29udHJvbGxlcjo1MDAwL3YyLjAifV0sICJlbmRwb2ludHNfbGlua3MiOiBbXSwgInR5cGUiOiAiaWRlbnRpdHkiLCAibmFtZSI6ICJrZXlzdG9uZSJ9XSwgInVzZXIiOiB7InVzZXJuYW1lIjogImFkbWluIiwgInJvbGVzX2xpbmtzIjogW10sICJpZCI6ICJmNzU2MzZjOTlmNzU0ZDAyODZmMjBmYWQxY2UwZWIzMyIsICJyb2xlcyI6IFt7Im5hbWUiOiAiX21lbWJlcl8ifSwgeyJuYW1lIjogImFkbWluIn1dLCAibmFtZSI6ICJhZG1pbiJ9LCAibWV0YWRhdGEiOiB7ImlzX2FkbWluIjogMCwgInJvbGVzIjogWyI5ZmUyZmY5ZWU0Mzg0YjE4OTRhOTA4NzhkM2U5MmJhYiIsICJiMzNlMjI5MmE0ODE0ODMyOWQzODY1YTVlNTUzYjQ1ZSJdfX19MYIBhTCCAYECAQEwXDBXMQswCQYDVQQGEwJVUzEOMAwGA1UECAwFVW5zZXQxDjAMBgNVBAcMBVVuc2V0MQ4wDAYDVQQKDAVVbnNldDEYMBYGA1UEAwwPd3d3LmV4YW1wbGUuY29tAgEBMAsGCWCGSAFlAwQCATANBgkqhkiG9w0BAQEFAASCAQBP7qqSe6IzD8R43F83frAMuxwdtrHbinRwwv2+WOUOHqVw2u3qd3v0PaV8hqa2S4qfsa5flJ9bvX9sEeIPk+iiXC6BKjXckAlC4TJ1+WwiBXcuvGj2ZIRxw+Ew32ZZdVjS2aRm60I93ZRV3wIqG0gvurX6EuJtk0NHcQlXHmINxG31H9NIyfuAvN6uBw8RI7I34bkLVZUInkCLoNImsiOujx53KLKw8XYs+WUdI16StIrTuJ-xdy-PoNniazwD0wqLo3zGtBXMROehv4EawKvYw4rrQI7Giw-eYrbCGS4+2SOGADzQDCG9f0mub91TBq-x3ZZV393AuB2eC0NSlaxq", "tenant": {"description": "Admin tenant", "enabled": true, "id": "cdbcbc3eeb8a472c8abb2b67e749774c", "name": "admin"}}, "serviceCatalog": [{"endpoints": [{"adminURL": "http://controller:8776/v1/cdbcbc3eeb8a472c8abb2b67e749774c", "region": "regionOne", "internalURL": "http://controller:8776/v2/cdbcbc3eeb8a472c8abb2b67e749774c", "id": "0ac9d8c50b2a43199b27e2ea30229639", "publicURL": "http://controller:8776/v2/cdbcbc3eeb8a472c8abb2b67e749774c"}], "endpoints_links": [], "type": "volume", "name": "cinder"}, {"endpoints": [{"adminURL": "http://controller:9292", "region": "regionOne", "internalURL": "http://controller:9292", "id": "06ea9a3f2e384b7693ecd957fcfb337b", "publicURL": "http://controller:9292"}], "endpoints_links": [], "type": "image", "name": "glance"}, {"endpoints": [{"adminURL": "http://controller:8774/v2/cdbcbc3eeb8a472c8abb2b67e749774c", "region": "regionOne", "internalURL": "http://controller:8774/v2/cdbcbc3eeb8a472c8abb2b67e749774c", "id": "0f8ce6c5b57d4e468a7bdf8e05d1277a", "publicURL": "http://controller:8774/v2/cdbcbc3eeb8a472c8abb2b67e749774c"}], "endpoints_links": [], "type": "compute", "name": "nova"}, {"endpoints": [{"adminURL": "http://controller:9696", "region": "regionOne", "internalURL": "http://controller:9696", "id": "50a493f2dcb14cff9eedd2ffca541b14", "publicURL": "http://controller:9696"}], "endpoints_links": [], "type": "network", "name": "neutron"}, {"endpoints": [{"adminURL": "http://controller:35357/v2.0", "region": "regionOne", "internalURL": "http://controller:5000/v2.0", "id": "76f2e352fe424d038bb80532111f013f", "publicURL": "http://controller:5000/v2.0"}], "endpoints_links": [], "type": "identity", "name": "keystone"}], "user": {"username": "admin", "roles_links": [], "id": "f75636c99f754d0286f20fad1ce0eb33", "roles": [{"name": "member"}, {"name": "admin"}], "name": "admin"}, "metadata": {"is_admin": 0, "roles": ["9fe2ff9ee4384b1894a90878d3e92bab", "b33e2292a48148329d3865a5e553b45e"]}}}

DEBUG:cinderclient.client:RESP: [200] CaseInsensitiveDict({'date': 'Fri, 23 Sep 2016 15:32:44 GMT', 'vary': 'X-Auth-Token', 'content-length': '5440', 'content-type': 'application/json', 'x-distribution': 'Ubuntu'})
RESP BODY: {"access": {"token": {"issued_at": "2016-09-23T15:32:44.342635", "expires": "2016-09-23T16:32:44Z", "id": "MIIJ4AYJKoZIhvcNAQcCoIIJ0TCCCc0CAQExDTALBglghkgBZQMEAgEwggguBgkqhkiG9w0BBwGggggfBIIIG3siYWNjZXNzIjogeyJ0b2tlbiI6IHsiaXNzdWVkX2F0IjogIjIwMTYtMDktMjNUMTU6MzI6NDQuMzQyNjM1IiwgImV4cGlyZXMiOiAiMjAxNi0wOS0yM1QxNjozMjo0NFoiLCAiaWQiOiAicGxhY2Vob2xkZXIiLCAidGVuYW50IjogeyJkZXNjcmlwdGlvbiI6ICJBZG1pbiB0ZW5hbnQiLCAiZW5hYmxlZCI6IHRydWUsICJpZCI6ICJjZGJjYmMzZWViOGE0NzJjOGFiYjJiNjdlNzQ5Nzc0YyIsICJuYW1lIjogImFkbWluIn19LCAic2VydmljZUNhdGFsb2ciOiBbeyJlbmRwb2ludHMiOiBbeyJhZG1pblVSTCI6ICJodHRwOi8vY29udHJvbGxlcjo4Nzc2L3YxL2NkYmNiYzNlZWI4YTQ3MmM4YWJiMmI2N2U3NDk3NzRjIiwgInJlZ2lvbiI6ICJyZWdpb25PbmUiLCAiaW50ZXJuYWxVUkwiOiAiaHR0cDovL2NvbnRyb2xsZXI6ODc3Ni92Mi9jZGJjYmMzZWViOGE0NzJjOGFiYjJiNjdlNzQ5Nzc0YyIsICJpZCI6ICIwYWM5ZDhjNTBiMmE0MzE5OWIyN2UyZWEzMDIyOTYzOSIsICJwdWJsaWNVUkwiOiAiaHR0cDovL2NvbnRyb2xsZXI6ODc3Ni92Mi9jZGJjYmMzZWViOGE0NzJjOGFiYjJiNjdlNzQ5Nzc0YyJ9XSwgImVuZHBvaW50c19saW5rcyI6IFtdLCAidHlwZSI6ICJ2b2x1bWUiLCAibmFtZSI6ICJjaW5kZXIifSwgeyJlbmRwb2ludHMiOiBbeyJhZG1pblVSTCI6ICJodHRwOi8vY29udHJvbGxlcjo5MjkyIiwgInJlZ2lvbiI6ICJyZWdpb25PbmUiLCAiaW50ZXJuYWxVUkwiOiAiaHR0cDovL2NvbnRyb2xsZXI6OTI5MiIsICJpZCI6ICIwNmVhOWEzZjJlMzg0Yjc2OTNlY2Q5NTdmY2ZiMzM3YiIsICJwdWJsaWNVUkwiOiAiaHR0cDovL2NvbnRyb2xsZXI6OTI5MiJ9XSwgImVuZHBvaW50c19saW5rcyI6IFtdLCAidHlwZSI6ICJpbWFnZSIsICJuYW1lIjogImdsYW5jZSJ9LCB7ImVuZHBvaW50cyI6IFt7ImFkbWluVVJMIjogImh0dHA6Ly9jb250cm9sbGVyOjg3NzQvdjIvY2RiY2JjM2VlYjhhNDcyYzhhYmIyYjY3ZTc0OTc3NGMiLCAicmVnaW9uIjogInJlZ2lvbk9uZSIsICJpbnRlcm5hbFVSTCI6ICJodHRwOi8vY29udHJvbGxlcjo4Nzc0L3YyL2NkYmNiYzNlZWI4YTQ3MmM4YWJiMmI2N2U3NDk3NzRjIiwgImlkIjogIjBmOGNlNmM1YjU3ZDRlNDY4YTdiZGY4ZTA1ZDEyNzdhIiwgInB1YmxpY1VSTCI6ICJodHRwOi8vY29udHJvbGxlcjo4Nzc0L3YyL2NkYmNiYzNlZWI4YTQ3MmM4YWJiMmI2N2U3NDk3NzRjIn1dLCAiZW5kcG9pbnRzX2xpbmtzIjogW10sICJ0eXBlIjogImNvbXB1dGUiLCAibmFtZSI6ICJub3ZhIn0sIHsiZW5kcG9pbnRzIjogW3siYWRtaW5VUkwiOiAiaHR0cDovL2NvbnRyb2xsZXI6OTY5NiIsICJyZWdpb24iOiAicmVnaW9uT25lIiwgImludGVybmFsVVJMIjogImh0dHA6Ly9jb250cm9sbGVyOjk2OTYiLCAiaWQiOiAiNTBhNDkzZjJkY2IxNGNmZjllZWRkMmZmY2E1NDFiMTQiLCAicHVibGljVVJMIjogImh0dHA6Ly9jb250cm9sbGVyOjk2OTYifV0sICJlbmRwb2ludHNfbGlua3MiOiBbXSwgInR5cGUiOiAibmV0d29yayIsICJuYW1lIjogIm5ldXRyb24ifSwgeyJlbmRwb2ludHMiOiBbeyJhZG1pblVSTCI6ICJodHRwOi8vY29udHJvbGxlcjozNTM1Ny92Mi4wIiwgInJlZ2lvbiI6ICJyZWdpb25PbmUiLCAiaW50ZXJuYWxVUkwiOiAiaHR0cDovL2NvbnRyb2xsZXI6NTAwMC92Mi4wIiwgImlkIjogIjc2ZjJlMzUyZmU0MjRkMDM4YmI4MDUzMjExMWYwMTNmIiwgInB1YmxpY1VSTCI6ICJodHRwOi8vY29udHJvbGxlcjo1MDAwL3YyLjAifV0sICJlbmRwb2ludHNfbGlua3MiOiBbXSwgInR5cGUiOiAiaWRlbnRpdHkiLCAibmFtZSI6ICJrZXlzdG9uZSJ9XSwgInVzZXIiOiB7InVzZXJuYW1lIjogImFkbWluIiwgInJvbGVzX2xpbmtzIjogW10sICJpZCI6ICJmNzU2MzZjOTlmNzU0ZDAyODZmMjBmYWQxY2UwZWIzMyIsICJyb2xlcyI6IFt7Im5hbWUiOiAiX21lbWJlcl8ifSwgeyJuYW1lIjogImFkbWluIn1dLCAibmFtZSI6ICJhZG1pbiJ9LCAibWV0YWRhdGEiOiB7ImlzX2FkbWluIjogMCwgInJvbGVzIjogWyI5ZmUyZmY5ZWU0Mzg0YjE4OTRhOTA4NzhkM2U5MmJhYiIsICJiMzNlMjI5MmE0ODE0ODMyOWQzODY1YTVlNTUzYjQ1ZSJdfX19MYIBhTCCAYECAQEwXDBXMQswCQYDVQQGEwJVUzEOMAwGA1UECAwFVW5zZXQxDjAMBgNVBAcMBVVuc2V0MQ4wDAYDVQQKDAVVbnNldDEYMBYGA1UEAwwPd3d3LmV4YW1wbGUuY29tAgEBMAsGCWCGSAFlAwQCATANBgkqhkiG9w0BAQEFAASCAQBP7qqSe6IzD8R43F83frAMuxwdtrHbinRwwv2+WOUOHqVw2u3qd3v0PaV8hqa2S4qfsa5flJ9bvX9sEeIPk+iiXC6BKjXckAlC4TJ1+WwiBXcuvGj2ZIRxw+Ew32ZZdVjS2aRm60I93ZRV3wIqG0gvurX6EuJtk0NHcQlXHmINxG31H9NIyfuAvN6uBw8RI7I34bkLVZUInkCLoNImsiOujx53KLKw8XYs+WUdI16StIrTuJ-xdy-PoNniazwD0wqLo3zGtBXMROehv4EawKvYw4rrQI7Giw-eYrbCGS4+2SOGADzQDCG9f0mub91TBq-x3ZZV393AuB2eC0NSlaxq", "tenant": {"description": "Admin tenant", "enabled": true, "id": "cdbcbc3eeb8a472c8abb2b67e749774c", "name": "admin"}}, "serviceCatalog": [{"endpoints": [{"adminURL": "http://controller:8776/v1/cdbcbc3eeb8a472c8abb2b67e749774c", "region": "regionOne", "internalURL": "http://controller:8776/v2/cdbcbc3eeb8a472c8abb2b67e749774c", "id": "0ac9d8c50b2a43199b27e2ea30229639", "publicURL": "http://controller:8776/v2/cdbcbc3eeb8a472c8abb2b67e749774c"}], "endpoints_links": [], "type": "volume", "name": "cinder"}, {"endpoints": [{"adminURL": "http://controller:9292", "region": "regionOne", "internalURL": "http://controller:9292", "id": "06ea9a3f2e384b7693ecd957fcfb337b", "publicURL": "http://controller:9292"}], "endpoints_links": [], "type": "image", "name": "glance"}, {"endpoints": [{"adminURL": "http://controller:8774/v2/cdbcbc3eeb8a472c8abb2b67e749774c", "region": "regionOne", "internalURL": "http://controller:8774/v2/cdbcbc3eeb8a472c8abb2b67e749774c", "id": "0f8ce6c5b57d4e468a7bdf8e05d1277a", "publicURL": "http://controller:8774/v2/cdbcbc3eeb8a472c8abb2b67e749774c"}], "endpoints_links": [], "type": "compute", "name": "nova"}, {"endpoints": [{"adminURL": "http://controller:9696", "region": "regionOne", "internalURL": "http://controller:9696", "id": "50a493f2dcb14cff9eedd2ffca541b14", "publicURL": "http://controller:9696"}], "endpoints_links": [], "type": "network", "name": "neutron"}, {"endpoints": [{"adminURL": "http://controller:35357/v2.0", "region": "regionOne", "internalURL": "http://controller:5000/v2.0", "id": "76f2e352fe424d038bb80532111f013f", "publicURL": "http://controller:5000/v2.0"}], "endpoints_links": [], "type": "identity", "name": "keystone"}], "user": {"username": "admin", "roles_links": [], "id": "f75636c99f754d0286f20fad1ce0eb33", "roles": [{"name": "member"}, {"name": "admin"}], "name": "admin"}, "metadata": {"is_admin": 0, "roles": ["9fe2ff9ee4384b1894a90878d3e92bab", "b33e2292a48148329d3865a5e553b45e"]}}}

ERROR: Volume API version is set to 1 but you are accessing a 2 endpoint. Change its value via either --os-volume-api-version or env[OS_VOLUME_API_VERSION]

[CLI] CLI clients: The request you have made requires authentication.

All service clients gives the following:

[root@localhost ajn(keystone_admin)]# neutron agent-list
The request you have made requires authentication. (HTTP 401) (Request-ID: req-80b3566a-93c2-42a8-9015-97e9cb925eaf)

openstack: 'domain' is not an openstack command

Though I've been using it before restarting, the openstack comamnd "domain" is not there anymore.

(openstack) domain

openstack: 'domain' is not an openstack command. See 'openstack --help'.

mysql service doesn't start

mysql service doesn't start after changes in my.cnf
glance image-list

Invalid OpenStack Identity credentials.

ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)

Version: '5.5.50-0ubuntu0.14.04.1' socket: '/var/run/mysqld/mysqld.sock' port: 3306 (Ubuntu)

Nova: VM stuck in "starting up"

RDO All-In-One devstack (Newton) on Vmware workstation.

and the most noticeable log:

for i in ls /var/log/nova/*.log; do tail $i ; echo ""; echo ">>> $i <<<" ;read -p "Press any key..."; done
.

..

/var/log/nova/nova-manage.log <<<
Press any key...
2016-12-24 10:32:58.397 4657 WARNING oslo_config.cfg [req-45d3cad4-d94a-4c80-8b34-c3b16736bb5b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal. Its value may be silently ignored in the future.
2016-12-24 10:32:58.397 4657 WARNING oslo_config.cfg [req-45d3cad4-d94a-4c80-8b34-c3b16736bb5b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal. Its value may be silently ignored in the future.
2016-12-24 10:32:58.398 4657 WARNING oslo_config.cfg [req-45d3cad4-d94a-4c80-8b34-c3b16736bb5b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal. Its value may be silently ignored in the future.
2016-12-24 10:32:58.716 4657 INFO nova.console.websocketproxy [req-45d3cad4-d94a-4c80-8b34-c3b16736bb5b - - - - -] 7: connect info: {u'instance_uuid': u'aedaaed5-0ea3-4dee-ac29-c86beccea8ad', u'internal_access_path': None, u'last_activity_at': 1482571977.40909, u'console_type': u'novnc', u'host': u'rdo-newton', u'token': u'b6c743e8-8fa8-4c59-a841-81eaeba2c4fd', u'access_url': u'http://192.168.0.126:6080/vnc_auto.html?token=b6c743e8-8fa8-4c59-a841-81eaeba2c4fd', u'port': u'5900'}
2016-12-24 10:32:58.717 4657 INFO nova.console.websocketproxy [req-45d3cad4-d94a-4c80-8b34-c3b16736bb5b - - - - -] 7: connecting to: rdo-newton:5900
2016-12-24 10:33:01.016 4650 INFO nova.console.websocketproxy [-] 192.168.0.146: ignoring socket not ready
2016-12-24 10:33:01.047 4651 INFO nova.console.websocketproxy [-] 192.168.0.146: ignoring socket not ready
2016-12-24 10:33:01.102 4652 INFO nova.console.websocketproxy [-] 192.168.0.146: ignoring socket not ready
2016-12-24 10:33:01.267 4654 INFO nova.console.websocketproxy [-] 192.168.0.146: ignoring socket not ready
2016-12-24 10:33:01.295 4655 INFO nova.console.websocketproxy [-] 192.168.0.146: ignoring socket not ready

Horizon: You are not authorized for any projects or domains.

Though the user is created:

openstack user create --email "user3@domain1" user3 --domain domain1 --password-prompt

User Password:
Repeat User Password:
+---------------------+----------------------------------+
| Field | Value |
+---------------------+----------------------------------+
| domain_id | b27c4d5ab21240a8979397f107515b1c |
| email | user3@domain1 |
| enabled | True |
| id | 1c3f7243130d44fcb42c8ed2901990c1 |
| name | user3 |
| password_expires_at | None |
+---------------------+----------------------------------+

RDO AIO : VM not reaching Internet / outside (host) networks

Connection to neutron failed: [Errno 111] Connection refused

neutron net-create ext-net --shared --router:external True

Connection to neutron failed: [Errno 111] Connection refused

neutron net-list

Connection to neutron failed: Maximum attempts reached

Log file /var/log/neutron/server.log gives:

CRITICAL neutron [-] No module named impl.kombu

vnc console : failed to connect to server (code: 1006)

failed to connect to server (code: 1006)

cinder: volume status error

cinder create --display-name myVolume1 1

+---------------------+--------------------------------------+
| Property | Value |
+---------------------+--------------------------------------+
| attachments | [] |
| availability_zone | nova |
| bootable | false |
| created_at | 2016-10-05T03:13:35.283132 |
| display_description | None |
| display_name | myVolume1 |
| encrypted | False |
| id | a8cca061-fb16-42d0-bc5d-c80cfdfcab10 |
| metadata | {} |
| size | 1 |
| snapshot_id | None |
| source_volid | None |
| status | creating |
| volume_type | None |
+---------------------+--------------------------------------+

cinder list

+--------------------------------------+--------+--------------+------+-------------+----------+-------------+
| ID | Status | Display Name | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+--------+--------------+------+-------------+----------+-------------+
| a8cca061-fb16-42d0-bc5d-c80cfdfcab10 | error | myVolume1 | 1 | None | false | |
+--------------------------------------+--------+--------------+------+-------------+----------+-------------+

Dashboard

Glance: Access denied for user 'glance'@'controller' (using password: YES)") None None

During glance installation, when populating glance db
su -s /bin/sh -c "glance-manage db_sync" glance

CRITICAL glance [-] OperationalError: (OperationalError) (1045, "Access denied for user 'glance'@'controller' (using password: YES)") None None

Ceilometer: Empty meter list

Meter list is empty, notging to set as meter to be monitored:

ceilometer meter-list

+------+------+------+-------------+---------+------------+
| Name | Type | Unit | Resource ID | User ID | Project ID |
+------+------+------+-------------+---------+------------+
+------+------+------+-------------+---------+------------+

ceilometer resource-list

+-------------+--------+---------+------------+
| Resource ID | Source | User ID | Project ID |
+-------------+--------+---------+------------+
+-------------+--------+---------+------------+

Exam practice form: Solve reading spinner content from reset button.

Solve reading spinner content from reset button.

ceilometer: The request you have made requires authentication. (HTTP 401)

[root@rdo-newton ~(keystone_admin)]# ceilometer meter-list

The request you have made requires authentication. (HTTP 401) (Request-ID: req-e1cfda2f-a698-4fb9-ab8e-69357a7f9e6e)

Monitoring ceilometer logs, gives the following error:

export CEILO_SVCS='compute central collector api alarm-evaluator alarm-notifier'
for svc in $CEILO_SVCS ; do sudo grep ERROR /var/log/ceilometer/${svc}.log ; done

Specifically /var/log/ceilometer/compute.log

2016-11-22 14:50:58.922 2447 ERROR oslo.messaging._drivers.impl_rabbit [-] [a01b43c5-231a-4fbf-8bfa-6f7f51a298f0] AMQP server on 192.168.0.126:5672 is unreachable: [Errno 111] Connection refused. Trying again in 6 seconds. Client port: None

Rabbitmq service is running as expected

systemctl status rabbitmq-server.service

● rabbitmq-server.service - RabbitMQ broker
Loaded: loaded (/usr/lib/systemd/system/rabbitmq-server.service; enabled; vendor preset: disabled)
Drop-In: /etc/systemd/system/rabbitmq-server.service.d
└─limits.conf
Active: active (running) since Tue 2016-12-06 02:15:32 CET; 1 day 1h ago
Main PID: 1281 (beam)
Status: "Initialized"
CGroup: /system.slice/rabbitmq-server.service
├─1281 /usr/lib64/erlang/erts-7.3.1.2/bin/beam -W w -A 64 -P 1048576 -t 5000000 -stbt db -K true -- -root /usr/lib64/erlang -p...
├─2938 inet_gethost 4
└─2939 inet_gethost 4

Dec 06 02:14:57 rdo-newton systemd[1]: Starting RabbitMQ broker...
Dec 06 02:15:28 rdo-newton rabbitmq-server[1281]: RabbitMQ 3.6.5. Copyright (C) 2007-2016 Pivotal Software, Inc.
Dec 06 02:15:28 rdo-newton rabbitmq-server[1281]: ## ## Licensed under the MPL. See http://www.rabbitmq.com/
Dec 06 02:15:28 rdo-newton rabbitmq-server[1281]: ## ##
Dec 06 02:15:28 rdo-newton rabbitmq-server[1281]: ########## Logs: /var/log/rabbitmq/[email protected]
Dec 06 02:15:28 rdo-newton rabbitmq-server[1281]: ###### ## /var/log/rabbitmq/[email protected]
Dec 06 02:15:28 rdo-newton rabbitmq-server[1281]: ##########
Dec 06 02:15:28 rdo-newton rabbitmq-server[1281]: Starting broker...
Dec 06 02:15:32 rdo-newton systemd[1]: Started RabbitMQ broker.
Dec 06 02:15:32 rdo-newton rabbitmq-server[1281]: completed with 0 plugins.

ss | grep :amqp
t

cp ESTAB 0 0 192.168.0.126:44618 192.168.0.126:amqp
tcp ESTAB 0 0 192.168.0.126:45082 192.168.0.126:amqp
tcp ESTAB 0 0 192.168.0.126:45938 192.168.0.126:amqp
tcp ESTAB 0 0 192.168.0.126:45828 192.168.0.126:amqp
tcp ESTAB 0 0 192.168.0.126:44660 192.168.0.126:amqp

Without port resolution, we can see the host 192.168.0.126:5672 available (not reachable according to the log above)

tcp ESTAB 0 0 ::ffff:192.168.0.126:5672 ::ffff:192.168.0.126:45912
tcp ESTAB 0 0 ::ffff:192.168.0.126:5672 ::ffff:192.168.0.126:47692
tcp ESTAB 0 0 ::ffff:192.168.0.126:5672 ::ffff:192.168.0.126:45672
tcp ESTAB 0 0 ::ffff:192.168.0.126:5672 ::ffff:192.168.0.126:45910
tcp ESTAB 0 0 ::ffff:192.168.0.126:5672 ::ffff:192.168.0.126:45894
tcp ESTAB 0 0 ::ffff:192.168.0.126:5672 ::ffff:192.168.0.126:44660

cat /etc/ceilometer/ceilometer.conf | grep rabbit | grep -v ^#

rpc_backend=rabbit
[oslo_messaging_rabbit]
rabbit_host=192.168.0.126
rabbit_port=5672
rabbit_use_ssl=False
rabbit_userid=guest
rabbit_password=guest

Exam practice form

Develop a simple web page that presents the tasks in an exam way.

ceilometer : Request returned failure status. Invalid OpenStack Identity credentials.

After installing ceilometer for most services (except swift), ceilometer command shows authentication error:

ceilometer alarm-list

WARNING (http:172) Request returned failure status.
Invalid OpenStack Identity credentials.

Logs gives the following:

tail /var/log/ceilometer/ceilometer-api.log

2016-12-12 15:51:40.744 4249 INFO urllib3.connectionpool [-] Starting new HTTPS connection (1): 127.0.0.1
2016-12-12 15:51:40.758 4249 WARNING keystoneclient.middleware.auth_token [-] Retrying on HTTP connection exception: [Errno 1] _ssl.c:510: error:140770FC:SSL routines:SSL23_GET_SERVER_HELLO:unknown protocol
2016-12-12 15:51:41.260 4249 INFO urllib3.connectionpool [-] Starting new HTTPS connection (1): 127.0.0.1
2016-12-12 15:51:41.277 4249 WARNING keystoneclient.middleware.auth_token [-] Retrying on HTTP connection exception: [Errno 1] _ssl.c:510: error:140770FC:SSL routines:SSL23_GET_SERVER_HELLO:unknown protocol
2016-12-12 15:51:42.279 4249 INFO urllib3.connectionpool [-] Starting new HTTPS connection (1): 127.0.0.1
2016-12-12 15:51:42.294 4249 WARNING keystoneclient.middleware.auth_token [-] Retrying on HTTP connection exception: [Errno 1] _ssl.c:510: error:140770FC:SSL routines:SSL23_GET_SERVER_HELLO:unknown protocol
2016-12-12 15:51:44.299 4249 INFO urllib3.connectionpool [-] Starting new HTTPS connection (1): 127.0.0.1
2016-12-12 15:51:44.317 4249 ERROR keystoneclient.middleware.auth_token [-] HTTP connection exception: [Errno 1] _ssl.c:510: error:140770FC:SSL routines:SSL23_GET_SERVER_HELLO:unknown protocol
2016-12-12 15:51:44.317 4249 WARNING keystoneclient.middleware.auth_token [-] Authorization failed for token
2016-12-12 15:51:44.318 4249 INFO keystoneclient.middleware.auth_token [-] Invalid user token - rejecting request

Looks like related to the issue with installing ceilometermiddleware

swift: "swift-init all start" shows Unable to locate config for

Swift proxy doesn't recognize swift services and corresponding configurations:

root@swiftProxy:/#

for service in \
swift-object swift-object-replicator swift-object-updater swift-object-auditor \
swift-container swift-container-replicator swift-container-updater swift-container-auditor \
swift-account swift-account-replicator swift-account-updater swift-account-auditor ; do \
service $service start; done

swift-object: unrecognized service
swift-object-replicator: unrecognized service
swift-object-updater: unrecognized service
swift-object-auditor: unrecognized service
swift-container: unrecognized service
swift-container-replicator: unrecognized service
swift-container-updater: unrecognized service
swift-container-auditor: unrecognized service
swift-account: unrecognized service
swift-account-replicator: unrecognized service
swift-account-updater: unrecognized service
swift-account-auditor: unrecognized service

root@swiftProxy:/# swift-init all start

Unable to locate config for container-updater
Unable to locate config for account-auditor
Unable to locate config for object-replicator
proxy-server running (2484 - /etc/swift/proxy-server.conf)
proxy-server already started...
Unable to locate config for container-replicator
Unable to locate config for object-auditor
Unable to locate config for object-expirer
Unable to locate config for container-auditor
Unable to locate config for container-server
Unable to locate config for account-server
Unable to locate config for account-reaper
Unable to locate config for container-sync
Unable to locate config for account-replicator
Unable to locate config for object-updater
Unable to locate config for object-server

ajnouri / coa Goto Github PK

coa's Introduction

Are you ready for the COA exam?

CLI administration section:

Exam practice & labbing:

Under construction:

Until the page http://hpnouri.free.fr/coa is built, you can simply use the above outline for more uptodate exercices and solutions.

Troubleshooting section:

Exam references

DISCLAIMER!

VERY IMPORTANT!

And got it finally:

Documentation

My main reference for preparation is LinuxAcademy with their amazing OpenStack courses and On-Demand hands-on labs.

coa's People

Contributors

Stargazers

Watchers

Forkers

coa's Issues

. demo-openrc.sh

swift stat

Dashboard

Recommend Projects

Recommend Topics

Recommend Org

`. demo-openrc.sh`

`swift stat`