Editing Setup OpenStack with Virtuozzo 7

Jump to: navigation, search

Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.

The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then save the changes below to finish undoing the edit.
Latest revision Your text
Line 1: Line 1:
 
{{Virtuozzo}}
 
{{Virtuozzo}}
<translate>
 
<!--T:1-->
 
This article describes how to install OpenStack on [[Virtuozzo]] 7.
 
== Introduction ==
 
  
Virtuozzo 7 supports OpenStack as cloud management solution since version 6. With Virtuozzo 7 we are going to add a lot of new capabilities to OpenStack integration.  
+
This howto describes steps by step installation of OpenStack devstack with [[Virtuozzo]] 7.
  
This guide describes two ways of installing OpenStack on Virtuozzo nodes. The first is for quick/development/POC needs. The second is for production. Please keep in mind that devstack allows you to install OpenStack for demo/POC/development purposes only. That means it will be reset after host reboot.
+
Execute the following commands within you Virtuozzo 7 host as root:
  
You need the following infrastructure to setup OpenStack with Virtuozzo 7:
+
Install RDO repo:
#controller host: physical host or virtual machine with at least 4CPU, 8GB RAM, 150GB disk. This host will act as a controller and Virtuozzo containers host.
 
#compute host: physical host or virtual machine with at least 4CPU, 8GB RAM, 150GB disk. This host will act as a virtual machines host.
 
  
== Prerequisites ==
+
$ yum install -y https://rdoproject.org/repos/rdo-release.rpm
  
You need to install and update your Virtuozzo nodes first. Install Virtuozzo 7 on your controller and compute hosts as usual. You can use basic (local) or Virtuozzo Storage. Update Virtuozzo hosts
+
Install EPEL repo:
$ yum update -y
 
 
 
If you have br0 bridge configured as an IP interface, then you should move an IP address assigned to it to the physical ethernet interface bridged to br0.
 
You can check you configuration with the following command:
 
 
 
$ if=$(brctl show | grep '^br0' | awk ' { print $4 }') && addr=$(ip addr | grep -w 'br0' | grep inet | awk ' {print $2} ') && gw=$(ip route | grep default | awk ' { print $3 } ') && echo "My interface is '$if', gateway is '$gw', IP address '$addr'"
 
 
 
For instance you have the following output after execution the above script:
 
 
 
My interface is 'en33', gateway is '192.168.190.2', IP address '192.168.190.134/24'.
 
 
 
Then edit your /etc/sysconfig/network-scripts/ifcfg-ens33 to have the following content and remove BRIDGE="br0" string from it:
 
...
 
ONBOOT=yes
 
IPADDR=192.168.190.134
 
GATEWAY=192.168.190.2
 
PREFIX=24
 
...
 
 
 
Remove /etc/sysconfig/network-scripts/ifcfg-br0 file.
 
 
 
$ rm /etc/sysconfig/network-scripts/ifcfg-br0
 
 
   
 
   
Then restart network service:
+
$ yum install -y http://fedora-mirror01.rbc.ru/pub/epel//epel-release-latest-7.noarch.rpm
  
  $ systemctl restart network
+
Install required packages:
 +
  $ yum install -y git patch redhat-lsb-core euca2ools mysql-connector-python scsi-target-utils
  
== Setup OpenStack Controller Node with Virtuozzo Containers Support (*Developer/POC Setup*) == <!--T:1-->
+
Reinstall http and mod_wsgi:
  
<!--T:3-->
+
$ yum remove -y httpd httpd-tools mod_wsgi
You are able to setup OpenStack controller node together with compute node on the same server for demo or test purpose. In this case compute node with Virtuozzo Containers support will be deployed. You can add another compute node with containers or VMs anytime you want as described in Setup OpenStack Compute Node section.
+
$ yum install -y httpd
  
Git must be installed on all your Virtuozzo nodes:
+
Enable IP connection tracking for CT0:
$ yum install git -y
 
  
Clone virtuozzo scripts:
+
$ echo -ne "options nf_conntrack ip_conntrack_disable_ve0=0\n" > /etc/modprobe.d/vz.conf
 +
$ echo -ne "options nf_conntrack ip_conntrack_disable_ve0=0\n" > /etc/modprobe.d/parallels.conf
 +
$ echo 0 > /sys/module/nf_conntrack/parameters/ip_conntrack_disable_ve0
  
$ cd /vz
+
Create user "stack" and add him to sudoers:
$ git clone https://github.com/virtuozzo/virtuozzo-openstack-scripts
 
$ cd virtuozzo-openstack-scripts
 
  
If you want to use Virtuozzo Storage with OpenStack and your Virtuozzo Storage is running on another node and not on the compute you need to setup Virtuozzo Storage client and authorize compute node in the Virtuozzo Storage Cluster.
+
$ adduser stack -d /vz/stack
 +
$ echo "stack ALL=(ALL) NOPASSWD: ALL" >> /etc/sudoers
  
Setup Virtuozzo Storage client:
+
Download and unpack container image:
$ yum install vstorage-client -y
 
Check cluster discovery is working fine first:
 
$ vstorage discover
 
Output will show the discovered clusters.
 
Now you need to authenticate controller node on the Virtuozzo Storage cluster:
 
$ vstorage -c $CLUSTER_NAME auth-node
 
Enter the virtuozzo storage cluster password and press Enter.
 
Check the cluster properties:
 
$ vstorage -c $CLUSTER_NAME top
 
Output will show Virtuozzo storage cluster properties and state.
 
  
Configure the script on the CONTROLLER node. Please read full script description here https://github.com/virtuozzo/virtuozzo-openstack-scripts/blob/master/README.md
+
$ su stack -c "cd ~ && wget http://updates.pvs.parallels.com/server/virtuozzo/en_us/odin/7/techpreview/centos7-exe.hds.tar.gz"
 +
$ su stack -c "cd ~ && tar -xzvf centos7-exe.hds.tar.gz"
  
Example:
+
Clone devstack:
$ source vzrc --host_ip 10.24.41.25 --password Virtuozzo1! --use_provider_network true  --fixed_range 192.168.0.0/24 --floating_range 10.24.41.0/24 --floating_pool "start=10.24.41.151,end=10.24.41.199" --public_gateway 10.24.41.1 --gateway 192.168.0.1 --vzstorage vstorage1 --mode ALL
 
 
 
Run the script on your CONTROLLER node and follow instructions (if any):
 
$ ./setup_devstack_vz7.sh
 
 
 
Installation can take up to 30 minutes depending on your Internet connection speed. Finished!
 
 
 
== Setup OpenStack Compute Node (*Developer/POC Setup*) ==
 
 
 
Git must be installed on all your Virtuozzo nodes:
 
$ yum install git -y
 
 
 
Clone Virtuozzo scripts to your COMPUTE node:
 
$ cd /vz
 
$ git clone https://github.com/virtuozzo/virtuozzo-openstack-scripts
 
$ cd /vz/virtuozzo-openstack-scripts
 
 
 
If you want to use Virtuozzo Storage with OpenStack and your Virtuozzo Storage is running on another node and not on the compute you need to setup Virtuozzo Storage client and authorize compute node in the Virtuozzo Cluster.
 
Setup Virtuozzo Storage client:
 
$ yum install vstorage-client -y
 
Check cluster discovery is working fine first:
 
$ vstorage discover
 
Output will show the discovered clusters.
 
Now you need to authenticate controller node on the Virtuozzo Storage cluster:
 
$ vstorage -c $CLUSTER_NAME auth-node
 
Enter the virtuozzo storage cluster password and press Enter.
 
Check the cluster properties:
 
$ vstorage -c $CLUSTER_NAME top
 
Output will show the virtuozzo storage cluster properties and state.
 
 
 
Configure the script on the COMPUTE node. Please read script description here https://github.com/virtuozzo/virtuozzo-openstack-scripts/blob/master/README.md
 
 
 
Example:
 
$ source vzrc --host_ip 10.24.41.26 --password Virtuozzo1!  --use_provider_network true --mode COMPUTE --controller 10.24.41.25
 
 
 
Run the script on your COMPUTE node and follow instructions (if any):
 
$ ./setup_devstack_vz7.sh
 
 
 
== How to change Virtualization Type to Virtual Machines on the Compute Node ==
 
 
 
If you want to use virtual machines instead of containers on your compute node you need to change virtualization type to KVM on the selected compute node.
 
 
 
Open nova configuration file:
 
$ vi /etc/nova/nova.conf
 
 
 
Change the following lines:
 
 
 
[libvirt]
 
...
 
virt_type = parallels
 
images_type = qcow2
 
connection_uri = vz:///system
 
 
 
Delete the line:
 
inject_partition = -2
 
 
 
Save the file.
 
 
 
Restart nova-compute service:
 
$ su stack
 
$ screen -r
 
Press Ctrl-c
 
$ sg libvirtd '/usr/bin/nova-compute --config-file /etc/nova/nova.conf' & echo $! >/vz/stack/status/stack/n-cpu.pid; fg || echo "n-cpu failed to start" | tee "/vz/stack/status/stack/n-cpu.failure"
 
 
 
To exit from screen session:
 
Press Ctrl+a+d
 
 
 
== How to redeploy OpenStack on the same nodes ==
 
 
 
Your OpenStack setup will be reset after node restart. To redeploy OpenStack on the same nodes do the following:
 
# <code>cd /vz/virtuozzo-openstack-scripts</code>
 
# <code>git pull</code>
 
# Run ./setup_devstack_vz7.sh with options you need.
 
 
 
== Installing OpenStack with help of packstack on [[Virtuozzo]] 7 (*Production Setup*) ==
 
 
 
 
 
* Install Virtuozzo Platform Release package to all Virtuozzo OpenStack nodes:
 
 
 
$ yum install vz-platform-release
 
 
 
* Install packstack package:
 
 
 
$ yum install openstack-packstack
 
 
 
* Download sample Vz7 packstack answer file:
 
 
 
$ wget https://raw.githubusercontent.com/virtuozzo/virtuozzo-openstack-scripts/master/vz7-packstack-ocata.txt
 
 
 
* Edit vz7-packstack-ocata.txt enabling/disabling necessary services
 
* Replace all references to 'localhost' and '127.0.0.1' host addresses to correct valuses
 
* Set all passwords parameters containing PW_PLACEHOLDER string to some meaninful values
 
* If you are going to use Virtuozzo Storage as a Cinder Volume backend set the following parameters:
 
 
 
  # Enable Virtuozzo Storage
 
  CONFIG_VSTORAGE_ENABLED=y
 
 
 
  # VStorage cluster name.
 
  CONFIG_VSTORAGE_CLUSTER_NAME=
 
 
 
  # VStorage cluster password.
 
  CONFIG_VSTORAGE_CLUSTER_PASSWORD=
 
 
 
  # Bridge mappings
 
  CONFIG_NEUTRON_OVS_BRIDGE_MAPPINGS=extnet1:br-ex
 
 
 
  # Bridge interfaces
 
  CONFIG_NEUTRON_OVS_BRIDGE_IFACES=br-ex:eth0
 
 
 
  # Bridge mapping for compute node
 
  CONFIG_NEUTRON_OVS_BRIDGES_COMPUTE=extnet1:br-ex
 
 
 
* Then run packstack:
 
 
 
$ packstack --answer-file=vz7-packstack-ocata.txt
 
 
 
== Install and configure a nova controller node on [[Virtuozzo]] 7 (*Production Setup*) == <!--T:18-->
 
 
 
<!--T:19-->
 
* Follow instructions on [http://docs.openstack.org/newton/install-guide-rdo/nova-controller-install.html OpenStack.org]
 
 
 
* Download the container [http://updates.virtuozzo.com/server/virtuozzo/en_us/odin/7/techpreview-ct/centos7-exe.hds.tar.gz image]
 
* Unpack it
 
 
 
$ tar -xzvf centos7-exe.hds.tar.gz
 
 
 
* Upload the image to glance:
 
NOTE: this image was created for testing purposes only. Don't use it in production as is!
 
 
 
$ glance image-create --name centos7-exe --disk-format ploop --min-ram 512 --min-disk 1 --container-format bare --property vm_mode=exe --property hypervisor_type=vz --property cinder_img_volume_type=vstorage-ploop --file centos7-exe.hds
 
 
 
$ glance image-create --name centos7-hvm --disk-format qcow2 --min-ram 1024 --min-disk 10 --container-format bare --property cinder_img_volume_type=vstorage-qcow2 --file CentOS-7-x86_64-GenericCloud.qcow2
 
 
 
* CentOS image one can get here [http://cloud.centos.org/centos/7/images/CentOS-7-x86_64-GenericCloud.qcow2 ]
 
 
 
== Install and configure a compute node on [[Virtuozzo]] 7 (*Production Setup*) == <!--T:16-->
 
 
 
<!--T:17-->
 
Please use this chapter if you are going to run containers OR virtual machines on your compute node, but not containers AND virtual machines simultaneously. If you need to run containers and VMs simultaneously, please use next chapter.
 
 
 
* Follow instructions on [http://docs.openstack.org/newton/install-guide-rdo/nova-compute-install.html OpenStack.org]
 
* In addition to above instructions change /etc/nova/nova.conf:
 
 
 
[DEFAULT]
 
...
 
vnc_keymap =
 
force_raw_images = False
 
pointer_model = ps2mouse
 
 
 
[libvirt]
 
...
 
vzstorage_mount_user = nova
 
vzstorage_mount_group = root
 
virt_type = parallels
 
images_type = ploop
 
connection_uri = vz:///system
 
 
 
* Remove 'cpu_mode' parameter or set the following:
 
 
 
cpu_mode = none
 
 
 
* Then restart nova-compute service:
 
 
 
$ systemctl restart openstack-nova-compute.service
 
 
 
* If you plan to run Virtual Machines on your Compute node, change 'images_type' parameter to 'qcow2'
 
 
 
== Install and configure a block storage node on [[Virtuozzo]] 7 (*Production Setup*) == <!--T:16-->
 
 
 
<!--T:17-->
 
If you are going to run containers AND virtual machines simultaneously on your compute node you have to use this approach.
 
 
 
* Follow instructions on [http://docs.openstack.org/mitaka/install-guide-rdo/cinder-controller-install.html OpenStack.org]
 
* In addition to above instructions change /etc/cinder/cinder.conf:
 
 
 
[DEFAULT]
 
...
 
enabled_backends = lvmdriver-1,vstorage-ploop,vstorage-qcow2
 
...
 
 
 
[vstorage-ploop]
 
vzstorage_default_volume_format = ploop
 
vzstorage_shares_config = /etc/cinder/vzstorage-shares-vstorage.conf
 
volume_driver = cinder.volume.drivers.vzstorage.VZStorageDriver
 
volume_backend_name = vstorage-ploop
 
 
 
[vstorage-qcow2]
 
vzstorage_default_volume_format = qcow2
 
vzstorage_shares_config = /etc/cinder/vzstorage-shares-vstorage.conf
 
volume_driver = cinder.volume.drivers.vzstorage.VZStorageDriver
 
volume_backend_name = vstorage-qcow2
 
 
 
* Create /etc/cinder/vzstorage-shares-vstorage.conf with the following content:
 
 
 
YOUR-CLUSTER-NAME ["-u", "cinder", "-g", "root", "-m", "0770"]
 
 
 
* Create two new volume types:
 
 
 
$ cinder type-create vstorage-qcow2
 
$ cinder type-key vstorage-qcow2 set volume_backend_name=vstorage-qcow2
 
 
 
$ cinder type-create vstorage-ploop
 
$ cinder type-key vstorage-ploop set volume_backend_name=vstorage-ploop
 
 
 
* Create directory for storage logs:
 
 
 
$ mkdir /var/log/pstorage
 
 
 
* Authenticate your Virtuozzo Storage client nodes in oreser to allow them to mount cluster:
 
 
 
$ echo $CLUSTER_PASSWD | vstorage auth-node -c YOUR-CLUSTER-NAME -P
 
 
   
 
   
* Then restart cinder services:
+
  $ su stack -c "cd ~ && git clone git://git.openstack.org/openstack-dev/devstack"
 
 
$ systemctl restart openstack-cinder-api
 
  $ systemctl restart openstack-cinder-scheduler
 
$ systemctl restart openstack-cinder-volume
 
 
 
== How to create a new ploop image ready to upload to Glance == <!--T:17-->
 
 
 
* Select os template. The following templates are possible: vzlinux-7, centos-7, ubuntu-16.04, ubuntu-14.04, debian-8.0, centos-6, debian-8.0-x86_64-minimal
 
 
 
$ ct=centos-7
 
 
 
* Create a new container based on necessary os distribution
 
 
 
$ prlctl create glance-$ct --vmtype ct --ostemplate $ct
 
 
 
* Set IP address and DNS to be able to connect to internet from the container
 
 
 
$ prlctl set glance-$ct --ipadd IPADDR --nameserver DNS_IPADDR
 
 
 
* Add additional network adapter
 
 
 
$ prlctl set glance-$ct --device-add net --network Bridged --dhcp on
 
 
 
* Start the container
 
 
 
$ prlctl start glance-$ct
 
 
 
* Install cloud-init packet
 
 
 
$ prlctl exec glance-$ct yum install cloud-init -y
 
 
 
* Stop the container and mount it
 
 
 
$ prlctl stop glance-$ct
 
$ prlctl mount glance-$ct
 
 
 
* Store the container uuid
 
 
 
$ uuid=$(vzlist glance-$ct | awk ' NR>1 { print $1 }')
 
 
 
* Remove the following modules from cloud.cfg
 
 
 
$ sed -i '/- growpart/d' /vz/root/$uuid/etc/cloud/cloud.cfg
 
$ sed -i '/- resizefs/d' /vz/root/$uuid/etc/cloud/cloud.cfg
 
  
* Prepare network scripts
+
Create local.conf file:
  
  cat > /vz/root/$uuid/etc/sysconfig/network-scripts/ifcfg-eth0 << _EOF
+
  $ cat > ~stack/devstack/local.conf << _EOF
  DEVICE=eth0
+
<nowiki>[[local|localrc]]</nowiki>
  ONBOOT=yes
+
FORCE=yes
  NM_CONTROLLED=no
+
HOST_IP=1.1.1.1
  BOOTPROTO=dhcp
+
MYSQL_PASSWORD=password
 +
SERVICE_TOKEN=password
 +
SERVICE_PASSWORD=password
 +
ADMIN_PASSWORD=password
 +
LIBVIRT_TYPE=parallels
 +
RABBIT_PASSWORD=password
 +
#Basic services
 +
ENABLED_SERVICES=key,rabbit,mysql,horizon
 +
# Enable Nova services
 +
ENABLED_SERVICES+=,n-api,n-crt,n-cpu,n-cond,n-sch,n-novnc,n-cauth
 +
# Enable Glance services
 +
ENABLED_SERVICES+=,g-api,g-reg
 +
# Enable Cinder services
 +
#ENABLED_SERVICES+=,c-sch,c-api,c-vol
 +
# Enable Heat, to test orchestration
 +
#ENABLED_SERVICES+=,heat,h-api,h-api-cfn,h-api-cw,h-eng
 +
# Enable Neutron services
 +
ENABLED_SERVICES+=,q-svc,q-agt,q-dhcp,q-l3,q-meta,neutron
 +
# Destination path for installation
 +
DEST=/vz/stack
 +
# Destination for working data
 +
DATA_DIR=/vz/stack/data
 +
# Destination for status files
 +
SERVICE_DIR=/vz/stack/status
 +
LOG_COLOR=False
 +
LOGDAYS=3
 +
LOGFILE=/vz/stack/logs/stack.sh.log
 +
  SCREEN_LOGDIR=/vz/stack/logs/screen
 +
  ENABLE_METADATA_NETWORK=True
 +
  ENABLE_ISOLATED_METADATA=True
 +
  IMAGE_URLS="file:///vz/stack/centos7-exe.hds"
 
  _EOF
 
  _EOF
  
* If you need more than one network adapters within a container, make as many copies as you need
+
Change HOST_IP within created ~stack/devstack/local.conf to a valid IP address of your Virtuozzo 7 host.
 +
Change password for OpenStack services to whatever you prefer in ~stack/devstack/local.conf.
 +
Make libvirt daemon accessible via socket for stack user:
  
  $ cp /vz/root/$uuid/etc/sysconfig/network-scripts/ifcfg-eth0 /vz/root/$uuid/etc/sysconfig/network-scripts/ifcfg-eth1
+
  $ sed -i s/"#unix_sock_group = \"libvirt\""/"unix_sock_group = \"stack\""/ /etc/libvirt/libvirtd.conf
  $ sed -i '/eth0/eth1' /vz/root/$uuid/etc/sysconfig/network-scripts/ifcfg-eth1
+
$ sed -i s/"#unix_sock_ro_perms = \"0777\""/"unix_sock_ro_perms = \"0777\""/ /etc/libvirt/libvirtd.conf
 +
$ sed -i s/"#unix_sock_rw_perms = \"0770\""/"unix_sock_rw_perms = \"0770\""/ /etc/libvirt/libvirtd.conf
 +
$ sed -i s/"#unix_sock_dir = \"\/var\/run\/libvirt\""/"unix_sock_dir = \"\/var\/run\/libvirt\""/ /etc/libvirt/libvirtd.conf
 +
  $ sed -i s/"#auth_unix_ro = \"none\""/"auth_unix_ro = \"none\""/ /etc/libvirt/libvirtd.conf
 +
$ sed -i s/"#auth_unix_rw = \"none\""/"auth_unix_rw = \"none\""/ /etc/libvirt/libvirtd.conf
  
* Perform some cleanup
+
Clone nova repository:
  
  $ rm -f /vz/root/$uuid/etc/sysconfig/network-scripts/ifcfg-venet0*
+
  $ su stack -c "cd ~ && git clone git://git.openstack.org/openstack/nova"
$ rm -f /vz/root/$uuid/etc/resolv.conf
 
  
* Create ploop disk and copy files
+
Make libvirt 1.2.8 be minimum required version to run with Virtuozzo:
  
  $ mkdir /tmp/ploop-$ct
+
  $ sed -i -e "s/MIN_LIBVIRT_PARALLELS_VERSION = (1, 2, 12)/MIN_LIBVIRT_PARALLELS_VERSION = (1, 2, 8)/" ~stack/nova/nova/virt/libvirt/driver.py
$ ploop init -s 950M /tmp/ploop-$ct/$ct.hds
 
  $ mkdir /tmp/ploop-$ct/dst
 
$ ploop mount -m /tmp/ploop-$ct/dst /tmp/ploop-$ct/DiskDescriptor.xml
 
$ cp -Pr --preserve=all /vz/root/$uuid/* /tmp/ploop-$ct/dst/
 
$ ploop umount -m /tmp/ploop-$ct/dst/
 
  
* Unmount the container
+
Start devstack:
  
  $ prlctl umount glance-$ct
+
  $ su stack -c "~/stack.sh"
  
* Now the image tmp/ploop-$ct/$ct.hds is ready to be uploaded to Glance
+
After script finishes, setup your iptables rules to allow incoming http trafic if you want to use OpenStack dashboard. For instance:
  
== See also == <!--T:100-->
+
$ iptables -D INPUT -j REJECT
* [http://docs.openstack.org/newton/install-guide-rdo/nova-controller-install.html Controller Node Installation Guide]
+
$ iptables -A INPUT -p tcp --dport http -j ACCEPT
* [http://docs.openstack.org/newton/install-guide-rdo/nova-compute-install.html Compute Node Installation Guide]
+
$ iptables -A INPUT -j REJECT
* [http://docs.openstack.org/newton/install-guide-rdo/environment-packages.html OpenStack Installation Guide]
 
* [https://docs.openvz.org/ Virtuozzo Documentation]
 
* [[Virtuozzo ecosystem]]
 
  
</translate>
+
Here you are!
  
 
[[Category: HOWTO]]
 
[[Category: HOWTO]]

Please note that all contributions to OpenVZ Virtuozzo Containers Wiki may be edited, altered, or removed by other contributors. If you don't want your writing to be edited mercilessly, then don't submit it here.
If you are going to add external links to an article, read the External links policy first!

To edit this page, please answer the question that appears below (more info):

Cancel Editing help (opens in new window)

Template used on this page: