Nutanix の Acropolis OpenStack Services VM (OVM) を Ravello で試してみました。
Ravello での Nutanix CE にわりあてられるスペック上の事情により、OVM は Nutanix とは独立したサーバとしてデプロイしています。
今回は、OpenStack Controller が OVM に含まれる All-in-one 構成にします。
ovmctl 実行前の OVM の状態
Nutanix CE と、OVM の VM を別に用意しています。
OVM デプロイ直後はネットワーク設定がされていないので、Console から接続します。
Nutanix には、Prism からアクセスします。
Nutanix CE は、1ノードクラスタで、クラスタ名と、クラスタの VIP は設定済みです。
- CLUSTER NAME： ntnx-ce
- CLUSTER VIRTUAL IP ADDRESS： 10.1.1.12
OVM には、Ravello のコンソールからアクセスします。
ディスクイメージから VM を作成して、ただ起動したままの状態です。
Nutanix 上で起動した場合に合わせて virtio の NIC を選択していて、デフォルトで eth0 として認識しています。
OVM のセットアップ
まず、ovmctl --add ovm で OVM 自身のセットアップをします。
root （初期パスワードは admin）でログインします。
この時点では、まだ何も OVM の設定がありません。
[root@none ~]# ovmctl --show Role: ----- None OVM configuration: ------------------ None Openstack Controllers configuration: ------------------------------------ None Nutanix Clusters configuration: ------------------------------- None Version: -------- Version : 2015.1.0 Release : 1 Summary : Acropolis drivers for Openstack Kilo.
下記のようなコマンドラインを実行します。
- 今回は事情により、/22 のアドレスにしています。
- このコマンドを実行するときに、NIC が eth0 ではなく ens3 になっていたりするとエラーになるようです。
[root@none ~]# ovmctl --add ovm --name ovm01 --ip 10.1.1.15 --netmask 255.255.252.0 --gateway 10.1.1.1 --nameserver 10.1.1.1 --domain ntnx.local
これで、OVM の設定だけでなくネットワーク設定もされます。
[root@ovm01 ~]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
link/ether 2c:c2:60:4a:22:b6 brd ff:ff:ff:ff:ff:ff
inet 10.1.1.15/22 brd 10.1.3.255 scope global eth0
valid_lft forever preferred_lft forever
inet6 fe80::2ec2:60ff:fe4a:22b6/64 scope link
valid_lft forever preferred_lft forever
ちょっと不思議な感じですが、ifcfg ファイルにも設定が記載されました。
[root@ovm01 ~]# cat /etc/sysconfig/network-scripts/ifcfg-eth0
# Generated by OVM
ONBOOT="yes"
NM_CONTROLLED="no"
BOOTPROTO=none
TYPE="Ethernet"
DEVICE="eth0"
IPADDR="10.1.1.15"
NETMASK="255.255.252.0"
GATEWAY="10.1.1.1"
DNS1="10.1.1.1"
DOMAIN="ntnx,local"
今回の環境だと、OVM を再起動すると接続ができなくなってしまうので、とりあえず NetworkManager は停止しました。
[root@ovm01 ~]# systemctl stop NetworkManager [root@ovm01 ~]# systemctl disable NetworkManager Removed symlink /etc/systemd/system/dbus-org.freedesktop.NetworkManager.service. Removed symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service. Removed symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service.
OVM configuration が追加されました。
[root@ovm01 ~]# ovmctl --show
Role:
-----
None
OVM configuration:
------------------
1 OVM name : ovm01
IP : 10.1.1.15
Netmask : 255.255.252.0
Gateway : 10.1.1.1
Nameserver : 10.1.1.1
Domain : ntnx.local
Openstack Controllers configuration:
------------------------------------
None
Nutanix Clusters configuration:
-------------------------------
None
Version:
--------
Version : 2015.1.0
Release : 1
Summary : Acropolis drivers for Openstack Kilo.
OVM への OpenStack コントローラ追加
ここからは SSH で接続しています。プロンプトを見ると、ovmctl --add ovm で指定したホスト名に変更されていることがわかります。
「ovmctl --add controller」でコントローラを追加します。All-in-one 構成なので、コントローラの「--ip」には、OVM 自身の IP アドレスを指定しています。
[root@ovm01 ~]# ovmctl --add controller --name ovm01 --ip 10.1.1.15 1/4: Stop services: Redirecting to /bin/systemctl stop openstack-nova-api.service Redirecting to /bin/systemctl stop openstack-nova-consoleauth.service Redirecting to /bin/systemctl stop openstack-nova-scheduler.service Redirecting to /bin/systemctl stop openstack-nova-conductor.service Redirecting to /bin/systemctl stop openstack-nova-compute.service Redirecting to /bin/systemctl stop openstack-nova-cert.service Redirecting to /bin/systemctl stop openstack-nova-novncproxy.service Redirecting to /bin/systemctl stop openstack-cinder-api.service Redirecting to /bin/systemctl stop openstack-cinder-scheduler.service Redirecting to /bin/systemctl stop openstack-cinder-volume.service Redirecting to /bin/systemctl stop openstack-cinder-backup.service Redirecting to /bin/systemctl stop openstack-glance-registry.service Redirecting to /bin/systemctl stop openstack-glance-api.service Redirecting to /bin/systemctl stop neutron-dhcp-agent.service Redirecting to /bin/systemctl stop neutron-l3-agent.service Redirecting to /bin/systemctl stop neutron-metadata-agent.service Redirecting to /bin/systemctl stop neutron-openvswitch-agent.service Redirecting to /bin/systemctl stop neutron-server.service Redirecting to /bin/systemctl start iptables.service Note: Forwarding request to 'systemctl enable iptables.service'. Redirecting to /bin/systemctl restart httpd.service Successful 2/4: Disconnect controller: Apply allinone disconnect manifest Error: NetworkManager is not running. Notice: Compiled catalog for ovm01.ntnx.local in environment production in 0.65 seconds Notice: Finished catalog run in 5.96 seconds Apply services disconnect manifest Error: NetworkManager is not running. Notice: Compiled catalog for ovm01.ntnx.local in environment production in 0.41 seconds Notice: Finished catalog run in 12.97 seconds Apply glance plugin disconnect manifest Error: NetworkManager is not running. Notice: Compiled catalog for ovm01.ntnx.local in environment production in 0.11 seconds Notice: Finished catalog run in 5.90 seconds Successful 3/4: Connect controller: Apply allinone connect manifest Error: NetworkManager is not running. Notice: Compiled catalog for ovm01.ntnx.local in environment production in 0.25 seconds Notice: /Stage[main]/Main/Augeas[ovm_allinone_glance_controller_api_config]/returns: executed successfully Notice: /Stage[main]/Main/Augeas[ovm_allinone_glance_controller_registry_config]/returns: executed successfully Notice: /Stage[main]/Main/Augeas[ovm_allinone_nova_controller_config]/returns: executed successfully Notice: /Stage[main]/Main/File_line[add_allinone_httpd_config]/ensure: created Notice: /Stage[main]/Main/Augeas[ovm_allinone_cinder_controller_config]/returns: executed successfully Notice: Finished catalog run in 4.11 seconds Apply services connect manifest Error: NetworkManager is not running. Notice: Compiled catalog for ovm01.ntnx.local in environment production in 0.45 seconds Notice: /Stage[main]/Main/Augeas[ovm_nova_cluster_config]/returns: executed successfully Notice: /Stage[main]/Main/Augeas[ovm_nova_controller_config]/returns: executed successfully Notice: /Stage[main]/Main/Augeas[ovm_cinder_controller_config]/returns: executed successfully Notice: /Stage[main]/Main/Augeas[ovm_neutron_controller_config]/returns: executed successfully Notice: /Stage[main]/Main/Augeas[ovm_neutron_cluster_entry_points_config]/returns: executed successfully Notice: /Stage[main]/Main/Augeas[ovm_neutron_controller_ml2_config]/returns: executed successfully Notice: /Stage[main]/Main/File_line[add-acropolis-driver]/ensure: created Notice: /Stage[main]/Main/Augeas[ovm_neutron_controller_metadata_config]/returns: executed successfully Notice: /Stage[main]/Main/Augeas[ovm_neutron_controller_ovs_neutron_plugin_config]/returns: executed successfully Notice: /Stage[main]/Main/Augeas[ovm_cinder_cluster_config]/returns: executed successfully Notice: Finished catalog run in 10.88 seconds Apply glance plugin connect manifest Error: NetworkManager is not running. Notice: Compiled catalog for ovm01.ntnx.local in environment production in 0.12 seconds Notice: /Stage[main]/Main/Augeas[ovm_nova_service_config]/returns: executed successfully Notice: /Stage[main]/Main/Augeas[ovm_glance_controller_api_config]/returns: executed successfully Notice: /Stage[main]/Main/Augeas[ovm_glance_cluster_api_config]/returns: executed successfully Notice: /Stage[main]/Main/Augeas[ovm_glance_controller_registry_config]/returns: executed successfully Notice: /Stage[main]/Main/Augeas[ovm_glance_cluster_entry_points_config]/returns: executed successfully Notice: /Stage[main]/Main/Augeas[ovm_cinder_service_config]/returns: executed successfully Notice: Finished catalog run in 6.38 seconds Successful 4/4: Restart Services: Redirecting to /bin/systemctl restart openstack-nova-api.service Redirecting to /bin/systemctl restart openstack-nova-consoleauth.service Redirecting to /bin/systemctl restart openstack-nova-scheduler.service Redirecting to /bin/systemctl restart openstack-nova-conductor.service Redirecting to /bin/systemctl restart openstack-nova-compute.service Redirecting to /bin/systemctl restart openstack-nova-cert.service Redirecting to /bin/systemctl restart openstack-nova-novncproxy.service Redirecting to /bin/systemctl restart openstack-cinder-api.service Redirecting to /bin/systemctl restart openstack-cinder-scheduler.service Redirecting to /bin/systemctl restart openstack-cinder-volume.service Redirecting to /bin/systemctl restart openstack-cinder-backup.service Redirecting to /bin/systemctl restart openstack-glance-registry.service Redirecting to /bin/systemctl restart openstack-glance-api.service Redirecting to /bin/systemctl restart neutron-server.service Redirecting to /bin/systemctl restart neutron-dhcp-agent.service Redirecting to /bin/systemctl restart neutron-l3-agent.service Redirecting to /bin/systemctl restart neutron-metadata-agent.service Redirecting to /bin/systemctl restart neutron-openvswitch-agent.service Note: Forwarding request to 'systemctl enable prism-vnc-proxy.service'. Redirecting to /bin/systemctl stop iptables.service Note: Forwarding request to 'systemctl disable iptables.service'. Removed symlink /etc/systemd/system/basic.target.wants/iptables.service. Redirecting to /bin/systemctl restart httpd.service Successful
Role が Allinone になり、Openstack Controllers configuration にコントローラが追加されました。
[root@ovm01 ~]# ovmctl --show
Role:
-----
Allinone - Openstack controller, Acropolis drivers
OVM configuration:
------------------
1 OVM name : ovm01
IP : 10.1.1.15
Netmask : 255.255.252.0
Gateway : 10.1.1.1
Nameserver : 10.1.1.1
Domain : ntnx.local
Openstack Controllers configuration:
------------------------------------
1 Controller name : ovm01
IP : 10.1.1.15
Auth
Auth strategy : keystone
Auth region : RegionOne
Auth tenant : services
Auth Nova password : ********
Auth Glance password : ********
Auth Cinder password : ********
Auth Neutron password : ********
DB
DB Nova : mysql
DB Cinder : mysql
DB Glance : mysql
DB Neutron : mysql
DB Nova password : ********
DB Glance password : ********
DB Cinder password : ********
DB Neutron password : ********
RPC
RPC backend : rabbit
RPC username : guest
RPC password : ********
Image cache : disable
Nutanix Clusters configuration:
-------------------------------
None
Version:
--------
Version : 2015.1.0
Release : 1
Summary : Acropolis drivers for Openstack Kilo.
Nutanix クラスタ側の準備
Nutanix CE のクラスタで、default という名前のストレージコンテナを作成しておきます。ovmctl でコンテナ名を指定することも可能ですが、自動的にデフォルトで作成されるコンテナ名が長いので、今回は「default」コンテナを作成しました。
Prism で「Storage」→「₊ Container」をクリックします。
名前を「default」にして、Save します。
default というコンテナが作成されました。
OVM への Nutanix クラスタ追加
念のため、Nutanix クラスタの VIP に疎通が取れることを確認しておきます。
[root@ovm01 ~]# ping -c 1 10.1.1.12 PING 10.1.1.12 (10.1.1.12) 56(84) bytes of data. 64 bytes from 10.1.1.12: icmp_seq=1 ttl=64 time=4.45 ms --- 10.1.1.12 ping statistics --- 1 packets transmitted, 1 received, 0% packet loss, time 0ms rtt min/avg/max/mdev = 4.451/4.451/4.451/0.000 ms
「ovmctl --add cluster」でクラスタを追加します。
[root@ovm01 ~]# ovmctl --add cluster --name ntnx-ce --ip 10.1.1.12 --username admin --password ＜パスワード＞ 1/3: Start VNC proxy: Started vnc proxy service Successful 2/3: Enable services: Service compute enabled Service volume enabled Service network enabled Successful 3/3: Restart services: Redirecting to /bin/systemctl restart openstack-nova-api.service Redirecting to /bin/systemctl restart openstack-nova-consoleauth.service Redirecting to /bin/systemctl restart openstack-nova-scheduler.service Redirecting to /bin/systemctl restart openstack-nova-conductor.service Redirecting to /bin/systemctl restart openstack-nova-compute.service Redirecting to /bin/systemctl restart openstack-nova-cert.service Redirecting to /bin/systemctl restart openstack-nova-novncproxy.service Redirecting to /bin/systemctl restart openstack-cinder-api.service Redirecting to /bin/systemctl restart openstack-cinder-scheduler.service Redirecting to /bin/systemctl restart openstack-cinder-volume.service Redirecting to /bin/systemctl restart openstack-cinder-backup.service Redirecting to /bin/systemctl restart openstack-glance-registry.service Redirecting to /bin/systemctl restart openstack-glance-api.service Redirecting to /bin/systemctl restart neutron-server.service Redirecting to /bin/systemctl restart neutron-dhcp-agent.service Redirecting to /bin/systemctl restart neutron-l3-agent.service Redirecting to /bin/systemctl restart neutron-metadata-agent.service Redirecting to /bin/systemctl restart neutron-openvswitch-agent.service Note: Forwarding request to 'systemctl enable prism-vnc-proxy.service'. Redirecting to /bin/systemctl stop iptables.service Note: Forwarding request to 'systemctl disable iptables.service'. Redirecting to /bin/systemctl restart httpd.service Successful
Nutanix Clusters configuration にクラスタが追加されました。Container name は default になっています。これで OpenStack から Nutanix を操作できるようになりました。
[root@ovm01 ~]# ovmctl --show
Role:
-----
Allinone - Openstack controller, Acropolis drivers
OVM configuration:
------------------
1 OVM name : ovm01
IP : 10.1.1.15
Netmask : 255.255.252.0
Gateway : 10.1.1.1
Nameserver : 10.1.1.1
Domain : ntnx.local
Openstack Controllers configuration:
------------------------------------
1 Controller name : ovm01
IP : 10.1.1.15
Auth
Auth strategy : keystone
Auth region : RegionOne
Auth tenant : services
Auth Nova password : ********
Auth Glance password : ********
Auth Cinder password : ********
Auth Neutron password : ********
DB
DB Nova : mysql
DB Cinder : mysql
DB Glance : mysql
DB Neutron : mysql
DB Nova password : ********
DB Glance password : ********
DB Cinder password : ********
DB Neutron password : ********
RPC
RPC backend : rabbit
RPC username : guest
RPC password : ********
Image cache : disable
Nutanix Clusters configuration:
-------------------------------
1 Cluster name : ntnx-ce
IP : 10.1.1.12
Username : admin
Password : ********
Vnc : 38362
Vcpus per core : 4
Container name : default
Services enabled : compute, volume, network
Version:
--------
Version : 2015.1.0
Release : 1
Summary : Acropolis drivers for Openstack Kilo.
できたものの様子
nova コマンドで様子を見てみます。
OVM の /root に keystonerc_admin というファイルがあります。
[root@ovm01 ~]# ls -l total 392 -rw-------. 1 root root 1068 Feb 4 16:17 anaconda-ks.cfg -rw-------. 1 root root 223 Feb 4 17:35 keystonerc_admin -rw-------. 1 root root 223 Feb 4 17:35 keystonerc_demo -rw-r--r--. 1 root root 336100 Feb 11 07:30 nutanix_openstack-2015.1.0-1.noarch.rpm drwxrwxr-x. 9 500 500 4096 Oct 27 12:31 openstack -rw-r--r--. 1 root root 43005 Feb 4 17:26 openstack-controller-packstack-install-answer.txt [root@ovm01 ~]# cat keystonerc_admin unset OS_SERVICE_TOKEN export OS_USERNAME=admin export OS_PASSWORD=admin export OS_AUTH_URL=http://127.0.0.1:5000/v2.0 export PS1='[\u@\h \W(keystone_admin)]\$ ' export OS_TENANT_NAME=admin export OS_REGION_NAME=RegionOne
これを source コマンドもしくは .（ドット）で読み込みます。
[root@ovm01 ~]# source keystonerc_admin [root@ovm01 ~(keystone_admin)]#
nova hypervisor-list を見てみます。クラスタのノード（AHV）ではなく、クラスタ単位で Nova の Compute Host として扱われるようです。VMware Integrated OpenStack（VIO）で vCenter 配下のクラスタが Nova のホストに見えるのと似た感じです。
[root@ovm01 ~(keystone_admin)]# nova hypervisor-list +----+---------------------+-------+---------+ | ID | Hypervisor hostname | State | Status | +----+---------------------+-------+---------+ | 10 | ntnx-ce | up | enabled | +----+---------------------+-------+---------+
hypervisor_type は AHV（Acropolis Hypervisor）になっています。
[root@ovm01 ~(keystone_admin)]# nova hypervisor-show ntnx-ce +---------------------------+-----------+ | Property | Value | +---------------------------+-----------+ | cpu_info_arch | x86_64 | | cpu_info_model | x86_64 | | cpu_info_topology_cores | 4 | | cpu_info_topology_sockets | 4 | | cpu_info_topology_threads | 4 | | cpu_info_vendor | Intel | | current_workload | 0 | | disk_available_least | 414 | | free_disk_gb | 414 | | free_ram_mb | 3087 | | host_ip | 10.1.1.15 | | hypervisor_hostname | ntnx-ce | | hypervisor_type | AHV | | hypervisor_version | 1 | | id | 10 | | local_gb | 414 | | local_gb_used | 0 | | memory_mb | 3599 | | memory_mb_used | 512 | | running_vms | 0 | | service_disabled_reason | - | | service_host | ovm01 | | service_id | 14 | | state | up | | status | enabled | | vcpus | 14 | | vcpus_used | 0 | +---------------------------+-----------+
Horizon Dashboard からもアクセス可能です。ハイパーバイザのホスト名は登録した Nutanix クラスタで、種類は AHV と表示されています。
まだつづく。
