Trusted, Bureaucrats, Administrators
12,424
edits
Changes
From Amahi Wiki
Infrastructure Virtualization Project (view source)
Revision as of 02:23, 26 May 2022
, 02:23, 26 May 2022→Configuration
{{WorkInProgress}}
'''Last Update:''' May 22, 2022
=Objective=
This is a project to update and modernize the infrastructure that keeps the Amahi web sites and services running.
=Goals=
We have multiple goals:
* run some of Operate internal build machines in a reliable, efficient way, so that we have consistent and updated builds/releases* have consistent Consistent and recent backups making things recoverable* run Execute some testing of Amahi apps more easily and efficiently* test Test new features in an isolated manner =Known Issues=* Cannot use multiple SSH keys via Dashboard ([https://bugs.launchpad.net/nova/+bug/1499751 OpenStack Bug #1499751])
=Configuration=
'''Dell Server(F1DH):'''
* Dual Xeon E5450 3.0 GHz Processors
* Two Gigabit Network InterfacesInterface
* KVM Network Interface
* RAID Controller
<br>
'''OSServer #1 (CURRENT):''' * OpenStack release Yoga* Operating System: CentOS 7.6.1810<br>8 Stream* 32GB PC2-5300 RAM (8x4)* Quick Swap Drive Bays** 1 - 1TB** 2 - 750GB (Backup)** 3 - EMPTY** 4 - EMPTY
<br>
'''Server #1 2 (PRIMARYBACKUP):'''* OpenStack release Wallaby* Operating System: CentOS 8 Stream
* 24GB PC2-5300 RAM (4x2/8x2)
* Four Quick Swap Drive Bays** 1 - 128GB SSD850GB (LVM)** 2 - 800GB HD (LVM)EMPTY** 3 - EMPTY120GB SSD (Backup)
** 4 - EMPTY
=Setup=
The following guidance is based on the latest release of OpenStack (Yoga):
<ul>
<li> Download [https://www.centos.org/download/ CentOS8 Stream] minmal image and install following [httphttps://www.if-not-true-then-falselinuxhint.com/2014/centos-7-netinstall-guideinstall_centos8_netboot_iso/ Installing CentOS 7.2 Netinstall Guide8 using NetBoot ISO Image] tutorial(use LVM, but remove ''/home'' partition and redistribute space to ''/''). </li><li> [https://linuxconfig.org/rhel-8-configure-static-ip-address Set Static IP Address] and [https://techjourney.net/how-to-set-change-hostname-fqdn-fully-qualified-domain-name-in-rhel-centos-7/ Configure configure Fully Qualified Domain Name] and , then reboot</li><li> Follow step 0 - 2 3 of the [[mediahttps:Packstack quickstart//www.rdoproject.pdf|org/install/packstack/ RDO Packstack Quickstart]] for the OpenStack installation (ensure step 0 prerequisites are completed first).</li><li> At step 34, follow the [[mediahttps:Neutron //www.rdoproject.org/networking/neutron-with -existing -external -network.pdf|/ Neutron with existing network guidance]]:</li>
<ul>
<li> Use command: <code>packstack --allinone --provision-demo=n --cinder-volumes-size=100G --keystone-admin-passwd={set password} --os-neutron-ml2-mechanism-drivers=openvswitch --os-neutron-ml2-tenant-network-types=vxlan --os-neutron-ml2-type-drivers=vxlan,flat,vlan --os-neutron-l2-agent=openvswitch --os-neutron-ovs-bridge-mappings=extnet:br-ex --os-neutron-ovs-bridge-interfaces=br-ex:eth0 --osnova-neutronlibvirt-ml2virt-type-drivers=vxlan,flatkvm</code> (replace {set password} and ''eth0'' with appropriate interfacevalues)</li><li> Skip down to ''Create Now, create the external networkwith Neutron.'' and follow guidance.</li><li> Next move to ''Create Then create a routerand set its gateway using the external network...'' and follow remaining guidance.</li>
</ul>
<li> Set up the floating IP addresses to the external network using web UI.</li>
<li> Create flavors named ''amahi.small'' of 10GB and ''amahi.medium'' of 15GB.
<li> Add the following rules to ''default'' Security Group (Ingress, IPv4, Remote IP 0.0.0.0):
<li> TCP / 80</li>
<li> TCP / 3000</li>
<li> TCP / 443 (<i>Optional</i>)</li>
</ul>
<li> Add users and private keys for SSH login</li>
<li> Disable SSH password and root login</li>
<li> Add user users to web UI access</li><li> Ensure OS updates applied and reboot</li>
<li> Create a single instance with floating IP</li>
<li> Verify all is working as expected.</li>
</ul>
<b>NOTE:</b> A terminal script has been developed to automate the installation steps above for OpenStack after CentOS is installed.
=Naming Convention=
The following is recommended for standardization:
* Instances: '''os-function''' (i.e. ''f24-bot'', ''f24-repo'', ''f24-dev'', etc)
* Images: '''os-type''' (i.e. ''f24-cd'', ''f24-dvd'', etc)
* Snapshot: '''os-function-ss#''' (i.e. ''f24-repo-ss1'', ''f24-bot-ss2'', etc)
* Volumes: '''instance-vol''' (i.e. ''f24-repo-vol'', ''mirrormgr-vol'', ''dl-masterdlmaster-vol'', etc)
=Build Images=
This will outline how to build OpenStack images using [https://www.proxmox.com/en/ Proxmox VE](alternate method in development).
* Log into Proxmox VE web UI
* Create a VM or clone an existing one(<code><i>type</i>=qemu64</code>)
** If creating a VM, install the OS
** If using a clone, start the VM
* Open a console window for the VM
** Log in and as <code>root </code> do the following
*** <code>dd if=/dev/zero of=/mytempfile bs=1M</code> (zero out any unused space)
*** <code>rm -f /mytempfile</code>
** Shutdown VM
** Log into Proxmox VE via SSH and execute the following from command line
*** Navigate to <code>/vardev/lib/vz/images/###pve</code> (number of VM)*** <code>mv original_image.qcow2 original_image.qcow2_backup</code> (rename original image)*** <code>qemu-img convert -O qcow2 original_image.qcow2_backup original_imagenew_image.qcow2</code>*** Copy new <code>new_image.qcow2</code> image to a safe location for uploading into OpenStack*** Remove <code>.backup</code> file
*** Delete the VM from Proxmox VE web UI
* Use WINScp WinSCP or similar program to copy the <code>new_image.qcow2</code> image to client machine
* Upload into OpenStack via the web UI
'''REFReference:''' [httphttps://wwwgazelle.jamescoyleihe.net/how-tobook/323-reclaim-disk-space-from-a-sparse-image-file-qcow2-vmdk Reclaim disk space from .qcow2 or .vmdk imageexport/html/917 Transfer Proxmox VM]
=Create Instance=
This is a nice straightforward tutorial on [https://www.tecmint.com/create-deploy-and-launch-virtual-machines-in-openstack/ how to deploy and launch an instance (VM)].
Also refer to [https://docs.openstack.org/mitaka/user-guide/cli_nova_launch_instance_using_ISO_image.html launch instance from ISO] for an alternate method.
=Backup=
* Back up scripts have been created to synchronize instances, volumes, and snapshots to a secondary drive on demand.
* Minimal of monthly back ups be done in case of catastrophic failure.
=Tips=
==Command Line==
[https://docs.openstack.org/python-openstackclient/ussuri/ OpenStack Command Line Guide]
==Network Issues==
If the DNS server is changed or networking appears inoperable, check the following to ensure the DNS is correct:
Next restart neutron network services:
<blockquotecode><code>:service neutron-server restart<br />:service neutron-dhcp-agent restart<br />:service neutron-l3-agent restart<br />:service neutron-metadata-agent restart<br />:service neutron-openvswitch-agent restart</code></blockquote>
==Volume Issues==
==Update/Reboot/Shutdown Process==
Follow guidelines below to prevent corruption:
* Shutdown/Disconnect
** Stop all instances
** Verify all instances stopped
** Perform Update/Reboot/Shutdown <br>
* Once system Started/Rebooted:
** Start all needed instances
* As root user, execute <code>source keystonerc_admin</code>
* Use the following to reserve the IP address:
* Create the instance and boot via command-line vs the web UI:
:'''NOTE:''' If image name has spaces, enclose it in double quotes.
See [https://docs.openstack.org/newton/user-guide/cli-change-the-size-of-your-server Change the size of your server] for command line guidance.
==Fedora Cloud Base Images==See [https://wwwalt.linuxtechifedoraproject.comorg/use-fedora-23-cloud-image-redhat-openstack/ Launch Fedora 23 Cloud imageBase Images] for guidance.
== Migration ==
Ref: [https://ask.openstack.org/en/question/91352/openstack-mitaka-can-not-access-dashboard/ OpenStack cannot access Dashboard]
==Miscellaneous=Known Issues=Refer to Cannot use multiple SSH keys via Dashboard ([https://bugs.amahilaunchpad.orgnet/nova/issues+bug/2050 Amahi 1499751 OpenStack Bug #20501499751] for some OpenStack Command-Line syntax.)----<br>
