A lot of newer installs will automatically prohibit the root user from logging in directly, for security reasons or they will only allow key based access.

If you know what you are doing/don't care about security or have an incredibly secure password for testing, then you can enable it.

Edit this file: /etc/ssh/sshd_config

Find the following line: PermitRootLogin

Set it like this:

PermitRootLogin yes

Now restart sshd

systemctl restart sshd

1. Let's work from an environment where we can install Ansible on.

Requirements: A Linux machine (eg. VM whether in the Cloud or a local VM on Vbox/VMWare/Proxmox) that you can easily install Anisble on (eg. Debian/Ubuntu/Mint).  The VM requires proper/working internet between the Ansible Controller and to the internet.

This will be on our "controller" / source machine which is where we deploy the Ansible Playbooks (.yaml) files from.

Install Ansible

sudo apt install ansible

Reading package lists... Done
Building dependency tree       
Reading state information... Done
The following additional packages will be installed:
  ieee-data python-jinja2 python-netaddr python-yaml
Suggested packages:
  python-jinja2-doc ipython python-netaddr-docs
Recommended packages:
  python-selinux
The following NEW packages will be installed:
  ansible ieee-data python-jinja2 python-netaddr python-yaml
0 upgraded, 5 newly installed, 0 to remove and 153 not upgraded.
Need to get 2,463 kB of archives.
After this operation, 15.7 MB of additional disk space will be used.
Do you want to continue? [Y/n] y
Get:1 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 python-jinja2 all 2.8-1ubuntu0.1 [106 kB]
Get:2 http://archive.ubuntu.com/ubuntu xenial/main amd64 python-yaml amd64 3.11-3build1 [105 kB]
Get:3 http://archive.ubuntu.com/ubuntu xenial/main amd64 ieee-data all 20150531.1 [830 kB]
Get:4 http://archive.ubuntu.com/ubuntu xenial/main amd64 python-netaddr all 0.7.18-1 [174 kB]
Get:5 http://archive.ubuntu.com/ubuntu xenial-backports/universe amd64 ansible all 2.1.1.0-1~ubuntu16.04.1 [1,249 kB]
Fetched 2,463 kB in 1s (1,474 kB/s)
Selecting previously unselected package python-jinja2.
(Reading database ... 434465 files and directories currently installed.)
Preparing to unpack .../python-jinja2_2.8-1ubuntu0.1_all.deb ...
Unpacking python-jinja2 (2.8-1ubuntu0.1) ...
Selecting previously unselected package python-yaml.
Preparing to unpack .../python-yaml_3.11-3build1_amd64.deb ...
Unpacking python-yaml (3.11-3build1) ...
Selecting previously unselected package ieee-data.
Preparing to unpack .../ieee-data_20150531.1_all.deb ...
Unpacking ieee-data (20150531.1) ...
Selecting previously unselected package python-netaddr.
Preparing to unpack .../python-netaddr_0.7.18-1_all.deb ...
Unpacking python-netaddr (0.7.18-1) ...
Selecting previously unselected package ansible.
Preparing to unpack .../ansible_2.1.1.0-1~ubuntu16.04.1_all.deb ...
Unpacking ansible (2.1.1.0-1~ubuntu16.04.1) ...
Processing triggers for man-db (2.7.5-1) ...
Setting up python-jinja2 (2.8-1ubuntu0.1) ...
Setting up python-yaml (3.11-3build1) ...
Setting up ieee-data (20150531.1) ...
Setting up python-netaddr (0.7.18-1) ...
Setting up ansible (2.1.1.0-1~ubuntu16.04.1) ...


Setup Ansible Hosts File

vi /etc/ansible/hosts

Let's make a new section/group called "lamp"

Change the IP 10.0.2.16 to the IP of your destination Linux VM

[lamp]
host1 ansible_ssh_host=10.0.2.16  #you could add host2,host3 and as many extra hosts as you want

Setup ssh root Username for "lamp" group

sudo mkdir -p /etc/ansible/group_vars

vi /etc/ansible/group_vars/lamp

#note that the file name is lamp, if the group was called "abcgroup" then the filename would be "abcgroup" instead otherwise it has no impact if the filename does not match the group name.

ansible_ssh_user: root

Let's make sure things work, let's just ping all hosts (we only have 1 so far)

ansible -m ping all

#We also could have specified ansible -m ping lamp to just check connectivity to the lamp group

Oops it didn't work!? But I can ping and ssh to it manually

host1 | UNREACHABLE! => {
    "changed": false,
    "msg": "Failed to connect to the host via ssh.",
    "unreachable": true
}
 

But since ansible is automated there is no way you could run this command and expect ansible to prompt for the password.  You'll need ssh key based authentication like this link.

Try again now that you have your key auth working (if it works you should be able to ssh as root to the server without any password)

host1 | SUCCESS => {
    "changed": false,
    "ping": "pong"
}
 

Check the uptime or run other shell commands from host1:

ansible -m shell -a 'free -m' host1
host1 | SUCCESS | rc=0 >>
              total        used        free      shared  buff/cache   available
Mem:           3946          84        3779           5          82        3700
Swap:           974           0         974

*Note we could swap host1 for "all" to do all servers or specify "lamp" for just the lamp group to execute that command on.


What Is An Ansible Play/PlayBook And How Does It Work?

The sports analogy or possibly theatre inspired terms are really just slang for "it's a YAML" config file that Ansible then translates into specific commands and operations to achieve the automated task on the destination hosts.

Essentially the YAML you create is the equivalent of a script, think of YAML as a high-end language that is then translated into more complex, high-end commands to the destination server.

The difference between the Play and Playbook, is that a Play is more like a single chapter book (a single play, possibly something like just starting Apache).  A Playbook is made up of "multiple Plays" or chapters, that essentially execute a number of ordered plays, usually to achieve a larger and more complex task (eg. install LAMP, then create a DB for Wordpress, then install and configure Wordpress etc.. would be done as a Playbook normally).

What Does A Valid .YAML Play Look Like?

1.) It has a list of hosts (eg. a group like lamp that we created earlier).

2.) A list of task(s) to execute on the remote host(s)

*Note that it is indenation sensitive and spacing sensitive, as in the real syntax is based on spacing and the dashes -

---
- hosts: lamp
  become: yes
  tasks:
    - name: install apache2
      apt: name=apache2 update_cache=yes state=latest


How do we execute a playbook? (use ansible-playbook)

ansible-playbook areebapache.yaml

 _____________
< PLAY [lamp] >
 -------------
           ^__^
           (oo)_______
            (__)       )/
                ||----w |
                ||     ||

 ______________
< TASK [setup] >
 --------------
           ^__^
           (oo)_______
            (__)       )/
                ||----w |
                ||     ||

ok: [host1]
 ________________________
< TASK [install apache2] >
 ------------------------
           ^__^
           (oo)_______
            (__)       )/
                ||----w |
                ||     ||



changed: [host1]
 ____________
< PLAY RECAP >
 ------------
           ^__^
           (oo)_______
            (__)       )/
                ||----w |
                ||     ||

host1                      : ok=2    changed=1    unreachable=0    failed=0   
 

 You should be able to visit the IP of each host in the lamp group and see the default Apache2 Debian index

Format Quiz

Which playbook works and why, what is different about the two?  (Feel free to run each one).

#book 1

---
- hosts: lamp
  become: root
  tasks:
    - name: Install apache2
      apt: name=apache2 state=latest
 

#book 2

 ---
 - hosts: lamp
  become: root
  tasks:
     - name: Install apache2
       apt: name=apache2 state=latest

Expanding To A Playbook, Let's install the full LAMP stack with a custom index.html!

---
- hosts: lamp
  become: root


  tasks:
   - name: Install apache2
     apt: name=apache2 state=latest

   - name: Install MySQL (really MariaDB now)
     apt: name=mariadb-server state=latest

   - name: Install php
     apt: name=php state=latest

   - name: Install php-cgi
     apt: name=php-cgi state=latest

   - name: Install php-cli
     apt: name=php-cli state=latest

   - name: Install apache2 php module
     apt: name=libapache2-mod-php state=latest

   - name: Install php-mysql
     apt: name=php-mysql state=latest

But wait, don't we need to restart apache to make PHP work, how do we do that?


Add this to the end of the above playbook.

  handlers:
   - name: restart apache2
     service: name=apache2 state=restarted

How do we enable a service so it works upon boot?

   - name: enable Apache2 service
     service: name=apache2 enabled=yes

 
How can we tell Apache to use a custom index.html?


   - name: Copy index test page
     template:
        src: "files/index.html.j2"
        dest: "/var/www/html/index.html"

How can we enable htaccess?

Inside your files directory (based on the relative dir) place these contents into a file called "htaccess.conf"

*Note you would change the /var/www to another path such as /www/vhosts/ if your vhost directory was different than Apache's default /var/www

Create a new task to actually copy the htaccess enable file into Apache2's config directory on the target server:

     - name: Enable htaccess support in /var/www
       template:
         src: "files/htaccess.conf"
         dest: "/etc/apache2/sites-available/htaccess.conf"

Don't forget to symlink it to sites-enabled (which actually enables the htaccess
 

- name: Enable the htaccess.conf by copying to sites-enabled
  file:
    src: /etc/apache2/sites-available/htaccess.conf
    dest: /etc/apache2/sites-enabled/htaccess.conf
    state: link

How do we enable a service so it works upon boot?

   - name: enable Apache2 service
     service: name=apache2 enabled=yes

How can we enable an Apache module?

-name: Apache Module - mod_rewrite
  apache2_module:
    state: present
    name: rewrite

References:

https://docs.ansible.com/ansible/latest/user_guide/playbooks_reuse_roles.html

https://docs.ansible.com/ansible/latest/reference_appendices/YAMLSyntax.html

https://docs.ansible.com/ansible/2.3/playbooks_variables.html

https://docs.ansible.com/ansible/latest/collections/ansible/builtin/index.html

https://github.com/ansible/ansible-examples

https://docs.ansible.com/ansible-core/devel/reference_appendices/YAMLSyntax.html

https://docs.ansible.com/ansible-core/devel/reference_appendices/playbooks_keywords.html

https://docs.ansible.com/

This normally happens when you interrupt the install of Ceph:

 pveceph install
update available package list
start installation
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
gdisk is already the newest version (1.0.6-1.1).
ceph-common is already the newest version (15.2.15-pve1).
ceph-fuse is already the newest version (15.2.15-pve1).
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
 ceph-base : Depends: ceph-common (= 14.2.21-1) but 15.2.15-pve1 is to be installed
 ceph-osd : PreDepends: ceph-common (= 14.2.21-1) but 15.2.15-pve1 is to be installed
E: Unable to correct problems, you have held broken packages.
apt failed during ceph installation (25600)
 

Solution

I have not been able to make it work without reinstalling Proxmox, it seems to completely break things if you interrupt the Ceph install.


This is normally caused by the fact that you don't have an Enterprise Subscription, either update your subscription or comment the Enterprise repo out in /etc/apt/sources.list.d/pve-enterprise.list
 

apt update
Hit:1 http://security.debian.org bullseye-security InRelease
Err:2 https://enterprise.proxmox.com/debian/pve bullseye InRelease             
  401  Unauthorized [IP: 144.217.225.162 443]
Hit:3 http://ftp.hk.debian.org/debian bullseye InRelease                       
Hit:4 http://ftp.hk.debian.org/debian bullseye-updates InRelease
Hit:5 http://download.proxmox.com/debian/ceph-pacific bullseye InRelease
Reading package lists... Done
E: Failed to fetch https://enterprise.proxmox.com/debian/pve/dists/bullseye/InRelease  401  Unauthorized [IP: 144.217.225.162 443]
E: The repository 'https://enterprise.proxmox.com/debian/pve bullseye InRelease' is not signed.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.



For a lot of reasons, it may be convenient to detach or attach live disks to a running VM without having to reboot it.  Sure, you can use some network based storage, but when performance counts, attaching a new virtual disk will usually give you better throughput and lower latency in a quick testing situation.

This doesn't work, why not?

drive_add 0 if=virtio,file=/tmp/vm.qcow2,if=virtio,format=qcow2,id=rtt

Can't hot-add drive to type 7

You need to do add the drive but without attaching it instead:

We achieve this by setting if=none so it has no physical interface but we make QEMU aware that the virtual disk does exist.

drive_add 0 if=virtio,file=/tmp/vm.qcow2,if=none,format=qcow2,id=rtt

Now we can hot add the drive to the OS by referencing the id which we defined as rtt:

device_add virtio-blk-pci,drive=rtt

There should be no output which means it is all good now!

Congrats, you've now hotadded a virtual drive to QEMU without having to restart

How To Install Ceph

If you stopped an install of Ceph midway you will need to manually restart it with "pveceph install"

Remember that your VM needs to have working internet (gateway) and DNS in order to connect to the apt repo to download all of the packages that Ceph requires.

Remember to repeat these steps for each node that you want Ceph on.

Let's Create an OSD on a Spare Disk (/dev/sdb on our case) and then Create a Ceph Pool that we can install our VMs on

Now let's install a VM on the Ceph Pool we created

Click on "Create VM".

How to Balance Load/Disk Usage Across OSDs:

Without the balancer, some OSDs may be overused while some underused, many configurations could have better redundancy and more effiicent usage with the balancer.

ceph mgr module enable balancer


ceph balancer on


ceph balancer mode upmap

Here is the scenario, you are using QEMU/KVM and are using something like the AC97 sound driver to pass the host audio to the guest via pulseaudio.  This is useful because you can transparently pass your mic input from the host which means you can mute your microphone from the host, which prevents the guest from receiving any mic input even if unmuted.

Here is the relevant CLI that makes this audio config happen that gets passed to QEMU:

-audiodev driver=pa,id=pa1,server=unix:/run/user/1000/pulse/native -device intel-hda -device AC97,audiodev=pa1

You would change the /run/user/1000 with your numeric uid which can be retrieved with id -u

But the problem is that input/mic audio will break (note that output is unaffected though) on the guest if there is any change to the pulseaudio on the host side during this time:

You will get pulseaudio errors like this:

pulseaudio: pa_threaded_mainloop_lock failed
pulseaudio: Reason: Invalid argument
pulseaudio: pa_threaded_mainloop_lock failed
pulseaudio: Reason: Invalid argument
pulseaudio: pa_threaded_mainloop_lock failed
pulseaudio: Reason: Invalid argument
 

I am not aware of any solution for this other than to hard restart the guest VM (not just a graceful reset initiated from the VM but a full hard poweroff of the VM).

One other config that I have tried is to use the -device hda-duplex but this seems to be buggy as shortly after starting the VM, mic audio input seems to fail on the guest which means the mic stops working.  This is why I use AC97, as it seems to be persistent so long as you don't unpug the microphone (config CLI below).

-audiodev driver=pa,id=pa1,server=unix:/run/user/1000/pulse/native -device intel-hda -device hda-duplex,audiodev=pa1

Volume control will often stop working, if your sound server (normally pulseaudio) dies or restarts whether by itself or by you.  The reason pulseaudio may need to be restarted is due to some sort of crash or other issue that prevents sound from working (normally restarting or doing a killall pulseaudio fixes things).

However, you will normally find at least in OS's like Ubuntu/Mint 16/18+ that you cannot control the volume whether adjusting the level, changing input/outputs and muting.

This is because the instance of your volume control in the task manager was tied to the instance of pulseaudio at the time.  Since pulseaudio was killed/restarted for some reason, the volume control applet doesn't work since it is trying to adjust the volume on an instance of pulseaudio that no longer exists.

To fix the issue of volume/sound settings not working, just kill and restart the applet:

killall mate-volume-control-applet


nohup mate-volume-control-applet&

If you are using another distro/flavor doing a "ps aux|grep volume-control" should get you the name of your volume control applet.

There are many reasons why Proxmox services may not start, but one common one, is if you have changed your /etc/hostname or /etc/hosts and don't have a valid FQDN (eg. proxmox01 instead proxmox01.com).

Failed to start The Proxmox VE cluster filesystem.
Failed to start Proxmox VE firewall.
Failed to start PVE Status Daemon.
Failed to start Proxmox VE scheduler.
Failed to start PVE Cluster HA Resource Manager Daemon.
Failed to start PVE Local HA Resource Manager Daemon.

Solution:

The above issue can cause error messages like these upon boot where nothing works.  IF this happens, make sure you have the same and valid FQDN (eg. yournode01.com) in /etc/hostname and /etc/hosts

How To Enable HA in Proxmox

 Test Your HA

 Shutdown the node that has the HA VM.

Can't Login To the GUI after changing your password?

Make sure you are using PAM authentication, but if you change your password for root, pveproxy will not accept the new password as it seems to cache the existing one.  To fix this problem, restart pveproxy:

systemctl restart pveproxy

If you get a 401 ticket error and cannot see your disks, this appears to be an issue in newer version like 7.x. 

If this happens when you have multiple Proxmox GUI's open, close the others (logout) and it should go away.

Did You Clone Your Proxmox Nodes?

You will need to follow the IP Change Guide and also the SSL Proxmox Same Certificate Error.

IP Changes/Hostname Changes

Be warned that the message "Welcome to the Proxmox Virtual Environment. Please use your web browser to configure this server - connect to: https://10.0.2.15" is static and set during install.

This means if you have DHCP or change the IP, the message will not update the correct IP.  You can see yourself that this message is set in /etc/issue.

For example look at the message, but to verify you should run "ip a" to see if the IP is really the one that Proxmox says to use. 

If you need to delete your cluster it is easier to start fresh this way:

If you need to delete your cluster it is easier to start fresh this way:

#stop proxmox cluster and corosync services so we can edit and remove the relevant files
systemctl stop pve-cluster
systemctl stop corosync
#mount proxmox filesystem in local mode so we can edit the files instead of being read only
pmxcfs -l
#delete all bad corosync files don't worry about the error about not being able to delete the subdir "rm: cannot remove '/etc/corosync/uidgid.d': Is a directory"
rm /etc/pve/corosync.conf
rm /etc/corosync/*
#now we can restart proxmox filesystem and the cluster service
killall pmxcfs
systemctl start pve-cluster

#if you wanted to delete a node
#pvecm cluster manager needs to be told it only needs a single vote otherwise you won't be able to delete it due to quorum requirements
pvecm expected 1
pvecm delnode nodenametodelete

Cluster Issues - Node Joined and shows under pvecm status and under "Datacenter" but not under Cluster Members.

This is often caused by ssl issues

cat /var/log/syslog|grep pve-ssl

If you get an error about SSL in the above, your certificates may be missing.

Follow the commands from here:

Proxmox Forum tips 

If the above doesn't work, it is probably best to reinstall the node (turn it off, then on the good node run pvecm delnode nodename)

Cluster Join Address Has Wrong IP?

Note the actual IP is 10.10.10.101 but the Cluster Join IP is 10.0.2.15 which is not correct.

Solution: edit /etc/hosts and update the IP, then reboot and the correct join IP will be there.

Proxmox Same Certificate Error:

proxmox you are attempting to import a cert with the same issuer/serial as an existing cert, but is not the same cert.

Error code: SEC_ERROR_REUSED_ISSUER_AND_SERIAL

rm /etc/pve/local/pve-ssl.*
rm /etc/pve/pve-root-ca.pem
pvecm updatecerts --force
systemctl restart pveproxy

When I restart a node, another goes down or reboots itself.

If you have 3 nodes and want the cluster to work with just 2, take the third node down (so only 2 are running) and then run this:

pvecm expected 2

You will get a "Unable to set expected votes: CS_ERROR_INVALID_PARAM" if you try to set the number to less than the currently running number of nodes.

Note that the number of expected votes will always by default be, how many nodes are running and it will automatically adjust itself up if you check pvecm status later on when the nodes are back online.

Ceph Issues

If you get an error 500 after install, even though it was successful the easiest way is to use this:

pveceph purge

Check all ceph services

root@vh01:~# systemctl status ceph*


● ceph-mds.target - ceph target allowing to start/stop all ceph-mds@.service instances at once
     Loaded: loaded (/lib/systemd/system/ceph-mds.target; enabled; vendor preset: enabled)
     Active: active since Wed 2022-01-12 16:11:41 EST; 27min ago

Jan 12 16:11:41 vh01 systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once.

● ceph-osd@0.service - Ceph object storage daemon osd.0
     Loaded: loaded (/lib/systemd/system/ceph-osd@.service; enabled-runtime; vendor preset: enabled)
    Drop-In: /usr/lib/systemd/system/ceph-osd@.service.d
             └─ceph-after-pve-cluster.conf
     Active: active (running) since Wed 2022-01-12 16:17:37 EST; 21min ago
    Process: 7778 ExecStartPre=/usr/libexec/ceph/ceph-osd-prestart.sh --cluster ${CLUSTER} --id 0 (code=exited, status=0/SUCCESS)
   Main PID: 7782 (ceph-osd)
      Tasks: 59
     Memory: 37.7M
        CPU: 4.036s
     CGroup: /system.slice/system-cephx2dosd.slice/ceph-osd@0.service
             └─7782 /usr/bin/ceph-osd -f --cluster ceph --id 0 --setuser ceph --setgroup ceph

Jan 12 16:17:37 vh01 systemd[1]: Starting Ceph object storage daemon osd.0...
Jan 12 16:17:37 vh01 systemd[1]: Started Ceph object storage daemon osd.0.
Jan 12 16:17:39 vh01 ceph-osd[7782]: 2022-01-12T16:17:39.818-0500 7f661f1bdf00 -1 osd.0 0 log_to_monitors {default=true}
Jan 12 16:17:41 vh01 ceph-osd[7782]: 2022-01-12T16:17:41.314-0500 7f661c169700 -1 osd.0 0 waiting for initial osdmap
Jan 12 16:17:41 vh01 ceph-osd[7782]: 2022-01-12T16:17:41.338-0500 7f66176c6700 -1 osd.0 4 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory

● ceph-crash.service - Ceph crash dump collector
     Loaded: loaded (/lib/systemd/system/ceph-crash.service; enabled; vendor preset: enabled)
     Active: active (running) since Wed 2022-01-12 16:11:39 EST; 27min ago
   Main PID: 3785 (ceph-crash)
      Tasks: 1 (limit: 4635)
     Memory: 5.6M
        CPU: 59ms
     CGroup: /system.slice/ceph-crash.service
             └─3785 /usr/bin/python3.9 /usr/bin/ceph-crash

Jan 12 16:11:39 vh01 systemd[1]: Started Ceph crash dump collector.
Jan 12 16:11:39 vh01 ceph-crash[3785]: INFO:ceph-crash:monitoring path /var/lib/ceph/crash, delay 600s

● ceph-mon.target - ceph target allowing to start/stop all ceph-mon@.service instances at once
     Loaded: loaded (/lib/systemd/system/ceph-mon.target; enabled; vendor preset: enabled)
● ceph-mds.target - ceph target allowing to start/stop all ceph-mds@.service instances at once
     Loaded: loaded (/lib/systemd/system/ceph-mds.target; enabled; vendor preset: enabled)
     Active: active since Wed 2022-01-12 16:11:41 EST; 27min ago

Jan 12 16:11:41 vh01 systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once.

● ceph-osd@0.service - Ceph object storage daemon osd.0
     Loaded: loaded (/lib/systemd/system/ceph-osd@.service; enabled-runtime; vendor preset: enabled)
    Drop-In: /usr/lib/systemd/system/ceph-osd@.service.d
             └─ceph-after-pve-cluster.conf
     Active: active (running) since Wed 2022-01-12 16:17:37 EST; 21min ago
    Process: 7778 ExecStartPre=/usr/libexec/ceph/ceph-osd-prestart.sh --cluster ${CLUSTER} --id 0 (code=exited, status=0/SUCCESS)
   Main PID: 7782 (ceph-osd)
      Tasks: 59
     Memory: 37.7M
        CPU: 4.036s
     CGroup: /system.slice/system-cephx2dosd.slice/ceph-osd@0.service
             └─7782 /usr/bin/ceph-osd -f --cluster ceph --id 0 --setuser ceph --setgroup ceph

Jan 12 16:17:37 vh01 systemd[1]: Starting Ceph object storage daemon osd.0...
Jan 12 16:17:37 vh01 systemd[1]: Started Ceph object storage daemon osd.0.
Jan 12 16:17:39 vh01 ceph-osd[7782]: 2022-01-12T16:17:39.818-0500 7f661f1bdf00 -1 osd.0 0 log_to_monitors {default=true}
Jan 12 16:17:41 vh01 ceph-osd[7782]: 2022-01-12T16:17:41.314-0500 7f661c169700 -1 osd.0 0 waiting for initial osdmap
Jan 12 16:17:41 vh01 ceph-osd[7782]: 2022-01-12T16:17:41.338-0500 7f66176c6700 -1 osd.0 4 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory

● ceph-crash.service - Ceph crash dump collector
     Loaded: loaded (/lib/systemd/system/ceph-crash.service; enabled; vendor preset: enabled)
     Active: active (running) since Wed 2022-01-12 16:11:39 EST; 27min ago
   Main PID: 3785 (ceph-crash)
      Tasks: 1 (limit: 4635)
     Memory: 5.6M
        CPU: 59ms
     CGroup: /system.slice/ceph-crash.service
             └─3785 /usr/bin/python3.9 /usr/bin/ceph-crash

Jan 12 16:11:39 vh01 systemd[1]: Started Ceph crash dump collector.
Jan 12 16:11:39 vh01 ceph-crash[3785]: INFO:ceph-crash:monitoring path /var/lib/ceph/crash, delay 600s

● ceph-mon.target - ceph target allowing to start/stop all ceph-mon@.service instances at once
     Loaded: loaded (/lib/systemd/system/ceph-mon.target; enabled; vendor preset: enabled)
     Active: active since Wed 2022-01-12 16:11:41 EST; 27min ago

Jan 12 16:11:41 vh01 systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once.

● ceph.target - ceph target allowing to start/stop all ceph*@.service instances at once
     Loaded: loaded (/lib/systemd/system/ceph.target; enabled; vendor preset: enabled)
     Active: active since Wed 2022-01-12 16:05:27 EST; 34min ago

Warning: journal has been rotated since unit was started, output may be incomplete.

● ceph-mgr@vh01.service - Ceph cluster manager daemon
     Loaded: loaded (/lib/systemd/system/ceph-mgr@.service; enabled; vendor preset: enabled)
    Drop-In: /usr/lib/systemd/system/ceph-mgr@.service.d
             └─ceph-after-pve-cluster.conf
     Active: active (running) since Wed 2022-01-12 16:12:51 EST; 26min ago
   Main PID: 5175 (ceph-mgr)

In newer of versions of Virtualbox, especially above 6.0 (eg. 6.1 like the example below), a lot of times the "Enable Nested VT-x/AMD-V".

If you are having this issue, you will see the option is grayed out.  It doesn't mean that your computer does not support virtualization, although it is possible it is disabled in the BIOS.  You can verify if Virtualization is enabled by following this for Linux

To fix this issue just run this command:

VBoxManage modifyvm YourVMName --nested-hw-virt on

 If you get errors, sometimes the name you assign is not the name vbox has for it internally. 

VBoxManage modifyvm "Mint 18" -nested-hw-virt on
VBoxManage: error: Could not find a registered machine named 'Mint 18'
VBoxManage: error: Details: code VBOX_E_OBJECT_NOT_FOUND (0x80bb0001), component VirtualBoxWrap, interface IVirtualBox, callee nsISupports
VBoxManage: error: Context: "FindMachine(Bstr(a->argv[0]).raw(), machine.asOutParam())" at line 546 of file VBoxManageModifyVM.cpp
 

Check the correct name like this:

Notice that there is " h1" VM, even though the name I typed was "h1" without any space when I created the VM Name in Virtualbox.

VBoxManage -nologo list vms

"CUCM-Pub" {1f28c07b-6222-4a18-9c60-bebbc220bf1f}
"LiveVM" {7eb31cc8-f82b-4162-9edd-8baf423db8e9}
"CUCM-Sub" {516c8ba9-03ff-4692-b479-535a6233ccd7}
"Mint18" {e24bf666-e8cc-43a8-aa45-bc1d113db1e6}
"Windows1" {dd6a0748-2062-4995-82de-3ec2453f9df6}
"Windows2" {ddb92f1f-c52f-40a0-9edb-f4e7df7acf6c}
"test boot" {41ef6d2b-cd97-4452-9618-ca68c7c89c6f}
"Mint20 - Kubernetes" {d2df24f0-f54e-4c1b-9fe2-562dfc0c5745}
" h1" {01fdbdb3-298d-4359-b043-5ef4e235668e}

Use the name above to identify the correct name.

NAT Network, the VMs can communicate but your host cannot access them by default. 

NAT VMs have internet but cannot communicate with each other.

Bridged is simple and allows full LAN access as if you had a physical machine plugged in but is often bad for testing, work or corporate environments and is not very portable when it comes to moving your VMs to other locations and networks.

Here is how you can use NAT Network to port forward to access services on your NAT Network guests.

Another quick and dirty way is to use another VM on the same NAT Network (eg a live Linux CD).

File -> Preferences -> Network

Click on "Port Forwarding"

From the terminal do this:

cat /proc/cpuinfo|grep -E "svm|vmx"

You should get output like this (svm = AMD-v and vmx=Intel-VTx):

flags        : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx lahf_lm epb pti tpr_shadow vnmi flexpriority ept vpid xsaveopt dtherm ida arat pln pts



If you have no output then your CPU does not support hardware Virtualization.

zip is useful to share files across multiple platforms.

A simple way if you want to zip all pdfs:

zip Labs.zip *.pdf

If you want to zip everything in the current directory and subdirectories do this:

zip -r stuff.zip *

First of all make sure that you don't have the write-lock or write-protect switch enabled on the SDCard or USB drive.

If the above is not the case, then follow these instructions:

Solution - Clear Read Only Attribute

Hit "Windows Key+R" and enter "cmd" to enter the command prompt:

Now type the following :

After each step hit the enter key

1. type DISKPART
2. type LIST VOLUME
3. type SELECT VOLUME X (where X is the volume number you want to remove the write protect from.)
4. type ATTRIBUTES DISK CLEAR READONLY
5. type EXIT

The Linux Mint team has disabled it by setting an apt preference, you can edit or just remove the file:

sudo apt install snapd
Reading package lists... Done
Building dependency tree       
Reading state information... Done
Package snapd is not available, but is referred to by another package.
This may mean that the package is missing, has been obsoleted, or
is only available from another source

E: Package 'snapd' has no installation candidate


Solution, delete the preference to disable snapd

sudo rm /etc/apt/preferences.d/nosnap.pref


realtechtalkcom@realtechtalkcom-VirtualBox:~$ sudo apt install snapd
Reading package lists... Done
Building dependency tree       
Reading state information... Done
The following NEW packages will be installed:
  snapd
0 upgraded, 1 newly installed, 0 to remove and 279 not upgraded.
Need to get 30.4 MB of archives.
After this operation, 134 MB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 snapd amd64 2.51.1+20.04ubuntu2 [30.4 MB]
Fetched 30.4 MB in 3s (10.2 MB/s)
Selecting previously unselected package snapd.
(Reading database ... 279902 files and directories currently installed.)
Preparing to unpack .../snapd_2.51.1+20.04ubuntu2_amd64.deb ...
Unpacking snapd (2.51.1+20.04ubuntu2) ...
Setting up snapd (2.51.1+20.04ubuntu2) ...
Created symlink /etc/systemd/system/multi-user.target.wants/snapd.apparmor.service → /lib/systemd/system/snapd.apparmor.service.
Created symlink /etc/systemd/system/multi-user.target.wants/snapd.autoimport.service → /lib/systemd/system/snapd.autoimport.service.
Created symlink /etc/systemd/system/multi-user.target.wants/snapd.core-fixup.service → /lib/systemd/system/snapd.core-fixup.service.
Created symlink /etc/systemd/system/multi-user.target.wants/snapd.recovery-chooser-trigger.service → /lib/systemd/system/snapd.recovery-chooser-trigger.service.
Created symlink /etc/systemd/system/multi-user.target.wants/snapd.seeded.service → /lib/systemd/system/snapd.seeded.service.
Created symlink /etc/systemd/system/cloud-final.service.wants/snapd.seeded.service → /lib/systemd/system/snapd.seeded.service.
Created symlink /etc/systemd/system/multi-user.target.wants/snapd.service → /lib/systemd/system/snapd.service.
Created symlink /etc/systemd/system/timers.target.wants/snapd.snap-repair.timer → /lib/systemd/system/snapd.snap-repair.timer.
Created symlink /etc/systemd/system/sockets.target.wants/snapd.socket → /lib/systemd/system/snapd.socket.
Created symlink /etc/systemd/system/final.target.wants/snapd.system-shutdown.service → /lib/systemd/system/snapd.system-shutdown.service.
snapd.failure.service is a disabled or a static unit, not starting it.
snapd.snap-repair.service is a disabled or a static unit, not starting it.
Processing triggers for mime-support (3.64ubuntu1) ...
Processing triggers for gnome-menus (3.36.0-1ubuntu1) ...
Processing triggers for man-db (2.9.1-1) ...
Processing triggers for dbus (1.12.16-2ubuntu2.1) ...
Processing triggers for desktop-file-utils (0.24+linuxmint1) ...


Just install these packages and restart the VM:

1.) Enable guest-utils on the host side:

sudo apt install virtualbox-guest-utils virtualbox-guest-x11
 

2.) Enable guest editions on the VM side

This must be done for each VM that you want to have the guest additons for accelerated GPU performance and for drag and drop/clipboard sharing

First insert the Guest Addtions CD image

The installer should popup,  complete the installation as directed by the installer.

Enable Shared Clipboard and Drag and Drop

Remember that you have to restart the VM for this to actually work.

https://kubernetes.io/docs/tasks/tools/install-kubectl-linux/

sudo apt install kubernetes snapd
Reading package lists... Done
Building dependency tree       
Reading state information... Done
The following NEW packages will be installed:
  kubernetes
0 upgraded, 1 newly installed, 0 to remove and 123 not upgraded.
Need to get 3,340 B of archives.
After this operation, 19.5 kB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu focal/universe amd64 kubernetes all 1.0 [3,340 B]
Fetched 3,340 B in 0s (9,475 B/s)      
Selecting previously unselected package kubernetes.
(Reading database ... 378576 files and directories currently installed.)
Preparing to unpack .../kubernetes_1.0_all.deb ...
Unpacking kubernetes (1.0) ...
Setting up kubernetes (1.0) ...
Processing triggers for man-db (2.9.1-1) ...
 

kubernetes install

Create our first app deployment using nginx

microk8s.kubectl create deployment nginx --image nginx
deployment.apps/nginx created
 

enable/expose it so it can start working

microk8s.kubectl expose deployment nginx --port 8000 --target-port 8000 --selector app=nginx --type ClusterIP --name rtttest
service/rtttest exposed
 

View all running services:

microk8s.kubectl get all
NAME                         READY   STATUS    RESTARTS   AGE
pod/nginx-6799fc88d8-sm5gd   1/1     Running   0          3m43s

NAME                 TYPE        CLUSTER-IP       EXTERNAL-IP   PORT(S)    AGE
service/kubernetes   ClusterIP   10.152.183.1             443/TCP    25m
service/areebtest    ClusterIP   10.152.183.191           8000/TCP   2m49s

NAME                    READY   UP-TO-DATE   AVAILABLE   AGE
deployment.apps/nginx   1/1     1            1           3m43s

NAME                               DESIRED   CURRENT   READY   AGE
replicaset.apps/nginx-6799fc88d8   1         1         1       3m43s

Enable Dashboard

microk8s.enable dns dashboard
Enabling DNS
Applying manifest
serviceaccount/coredns created
configmap/coredns created
Warning: spec.template.metadata.annotations[scheduler.alpha.kubernetes.io/critical-pod]: non-functional in v1.16+; use the "priorityClassName" field instead
deployment.apps/coredns created
service/kube-dns created
clusterrole.rbac.authorization.k8s.io/coredns created
clusterrolebinding.rbac.authorization.k8s.io/coredns created
Restarting kubelet
DNS is enabled




Enabling Kubernetes Dashboard
Enabling Metrics-Server
serviceaccount/metrics-server created
clusterrole.rbac.authorization.k8s.io/system:aggregated-metrics-reader created
clusterrole.rbac.authorization.k8s.io/system:metrics-server created
rolebinding.rbac.authorization.k8s.io/metrics-server-auth-reader created
clusterrolebinding.rbac.authorization.k8s.io/metrics-server:system:auth-delegator created
clusterrolebinding.rbac.authorization.k8s.io/system:metrics-server created
service/metrics-server created
deployment.apps/metrics-server created
apiservice.apiregistration.k8s.io/v1beta1.metrics.k8s.io created
clusterrolebinding.rbac.authorization.k8s.io/microk8s-admin created
Metrics-Server is enabled
Applying manifest
serviceaccount/kubernetes-dashboard created
service/kubernetes-dashboard created
secret/kubernetes-dashboard-certs created
secret/kubernetes-dashboard-csrf created
secret/kubernetes-dashboard-key-holder created
configmap/kubernetes-dashboard-settings created
role.rbac.authorization.k8s.io/kubernetes-dashboard created
clusterrole.rbac.authorization.k8s.io/kubernetes-dashboard created
rolebinding.rbac.authorization.k8s.io/kubernetes-dashboard created
clusterrolebinding.rbac.authorization.k8s.io/kubernetes-dashboard created
Warning: spec.template.spec.nodeSelector[beta.kubernetes.io/os]: deprecated since v1.14; use "kubernetes.io/os" instead
deployment.apps/kubernetes-dashboard created
service/dashboard-metrics-scraper created
deployment.apps/dashboard-metrics-scraper created

If RBAC is not enabled access the dashboard using the default token retrieved with:

token=$(microk8s kubectl -n kube-system get secret | grep default-token | cut -d " " -f1)
microk8s kubectl -n kube-system describe secret $token

In an RBAC enabled setup (microk8s enable RBAC) you need to create a user with restricted
permissions as shown in:
https://github.com/kubernetes/dashboard/blob/master/docs/user/access-control/creating-sample-user.md


  microk8s.kubectl get all --all-namespaces
NAMESPACE     NAME                                             READY   STATUS              RESTARTS       AGE
default       pod/nginx-6799fc88d8-sm5gd                       1/1     Running             1 (134m ago)   147m
kube-system   pod/coredns-7f9c69c78c-jhhkq                     1/1     Running             0              2m25s
kube-system   pod/calico-node-2jnsp                            1/1     Running             1 (134m ago)   169m
kube-system   pod/calico-kube-controllers-58d7965c58-qpw8j     1/1     Running             1 (134m ago)   169m
kube-system   pod/dashboard-metrics-scraper-58d4977855-7dnzm   0/1     ContainerCreating   0              13s
kube-system   pod/kubernetes-dashboard-59699458b-7t52l         0/1     ContainerCreating   0              13s
kube-system   pod/metrics-server-85df567dd8-7rfsm              0/1     Running             0              13s

NAMESPACE     NAME                                TYPE        CLUSTER-IP       EXTERNAL-IP   PORT(S)                  AGE
default       service/kubernetes                  ClusterIP   10.152.183.1             443/TCP                  169m
default       service/areebtest                   ClusterIP   10.152.183.191           8000/TCP                 146m
kube-system   service/kube-dns                    ClusterIP   10.152.183.10            53/UDP,53/TCP,9153/TCP   2m25s
kube-system   service/metrics-server              ClusterIP   10.152.183.124           443/TCP                  97s
kube-system   service/kubernetes-dashboard        ClusterIP   10.152.183.109           443/TCP                  77s
kube-system   service/dashboard-metrics-scraper   ClusterIP   10.152.183.24            8000/TCP                 77s

NAMESPACE     NAME                         DESIRED   CURRENT   READY   UP-TO-DATE   AVAILABLE   NODE SELECTOR            AGE
kube-system   daemonset.apps/calico-node   1         1         1       1            1           kubernetes.io/os=linux   169m

NAMESPACE     NAME                                        READY   UP-TO-DATE   AVAILABLE   AGE
kube-system   deployment.apps/calico-kube-controllers     1/1     1            1           169m
default       deployment.apps/nginx                       1/1     1            1           147m
kube-system   deployment.apps/coredns                     1/1     1            1           2m26s
kube-system   deployment.apps/dashboard-metrics-scraper   0/1     1            0           77s
kube-system   deployment.apps/metrics-server              0/1     1            0           97s
kube-system   deployment.apps/kubernetes-dashboard        0/1     1            0           77s

NAMESPACE     NAME                                                   DESIRED   CURRENT   READY   AGE
kube-system   replicaset.apps/calico-kube-controllers-58d7965c58     1         1         1       169m
default       replicaset.apps/nginx-6799fc88d8                       1         1         1       147m
kube-system   replicaset.apps/coredns-7f9c69c78c                     1         1         1       2m26s
kube-system   replicaset.apps/dashboard-metrics-scraper-58d4977855   1         1         0       13s
kube-system   replicaset.apps/metrics-server-85df567dd8              1         1         0       13s
kube-system   replicaset.apps/kubernetes-dashboard-59699458b         1         1         0       13s
 

Resources:

https://kubernetes.io/docs/concepts/

vi is very handy when doing a lot of config file editing and can save you time over using the mouse or using the x or delete keys to manually delete.

Solution:

Just type "dw" in non-input mode.

Say you have a config file like this:

 address-range low 10.10.2.1 high 10.10.2.5;

Let's say you wanted to just remove the whole line, yes you could hit dd but what if you just want everything after address range gone?

Just move your cursor to before the "low" and type "dw" and it will be instantly erased.

This assumes that you've already installed the relevant HWIC cards eg. Cisco Asynchronous Serial NIM

These are essentially cards that you install into your router, once installed you connect an Async cable to one of the ports on the card which normally gives you 8 console cables and are normally labelled 1 through 8.

You connect all of the cables to the devices you need (even non-Cisco devices) whether switches, routers or firewalls, they will usually work.

The real magic happens in just checking your lines and configuring them with telnet for easy access (of course the router should be secured to only authorized users only for this reason).
 

1.) Check your cables/ports

First just type show line to know what ports and cables are available.

Normally as you can see that the lines will start with 33.  To remotely connect to line 33 you would telnet to the IP of the router on port 2033 as all ports start with 2000.  The TTY types are the ASYNC lines.

show line

2.) Configure line access

The standard way is to just enable telnet access like this:

From config mode just do this:

line tty 33 64


password realtechtalk.com


login


transport input all


end

The line tty 33 64 specifies that we are applying this config to all of our async lines as shown in the previous screen they are tty 33-64.

Then we set a password, enable login and enable all input or we could have just enabled transport input telnet etc...

3.) telnet into the correct line

telnet yourIP 2064

Then enter your password and you will be at the console of the attached device.

This would connect you to line 64.  It is useful to label the physical devices according to the async number, as a rule you can normally just divide by 8 to get an idea of which group of lines go where (assuming you've connected them in a sequential order).

There aren't too many simple guides that show you how to use commands to setup your USB or other drive as a normal bootable drive where you can easily boot custom kernels or whatever OS you would like.

1. Get the tools we need:

We install "syslinux" for MBR and "syslinux-efi" for EFI and "MBR" as we need a tool that embeds the actual MBR into our USB:

sudo apt install syslinux syslinux-efi mbr

2.) Format the Drive as VFAT/FAT:

This assumes your USB is partitioned and is partition 1 on drive sdj /dev/sdj1

mkfs.vat /dev/sdj1

#you may need to mark the partition as bootable in fdisk by hitting the "b" flag

3.) Install MBR onto the drive

Install the MBR on /dev/sdj

sudo install-mbr /dev/sdj

Now install syslinux to the partition

sudo syslinux -i /dev/sdj1

Download syslinux 6.04

https://mirrors.edge.kernel.org/pub/linux/utils/boot/syslinux/Testing/6.04/syslinux-6.04-pre1.zip

Extract it.

Install the EFI syslinux:

Mount it first:

mount /dev/sdj1 /mnt/sdj1

cd /mnt/sdj1

mkdir -p EFI/BOOT

#copy the EFI32 and EFI64 binaries to EFI/BOOT directory on your USB

BOOTIA32.efi BOOTX64.efi ldlinux.e32 ldlinux.e64

#file locations from .zip file linked above

./efi64/com32/elflink/ldlinux/ldlinux.e64

./efi64/efi/syslinux.efi #rename this to BOOTX64.efi

4.) Create your syslinux.cfg:

add this to syslinux.cfg in the root:

 DEFAULT realtechtalk
  SAY Now booting the kernel from realtechtalk.com SYSLINUX...
 LABEL realtechtalk
  KERNEL kernelfs
  APPEND initrd=initrd.img

 #you can  add extra kernel flags after initrd=initrd.img by adding a specify a flag. eg initrd=initrd.img ro quiet nosplash

More from Syslinux Documentation

Congrats you should now have an MBR and EFI compatible Bootable USB!

This was done on a 2900 but applies to all the switches of the same era.

Step 1 - Power Cycle and enter recovery mode

If you have physical access you can power cycle and hold the mode button down for 15 seconds.  After that the SYS light will flash on the switch and you will see the following screenshot.

If you don't have physical access (eg. it is a datacenter swich over console only) then power cycle and hit "Ctrl+Pause/Break" repeatedly once the power is on until you see the below.

Step 2 - Disable startup config file

Type: flash_init

Type: dir flash:

This shows us all of the files on the flash card, normally the startup file will be "config.text".  We will be renaming it temporarily until we boot.

Rename the config.text: rename flash:config.text flash:config.text.orig

Step 3 - Boot

Type: boot

You will see output like this

At this point you could just default the switch but we want to reset the password and presumbly look at the existing config and just reset the password for now.

When it asks us if we want the initial configuration dialog? [yes/no]: Answer no

Type: no

Step 4 - Enter Enable Mode, Restore Config And Reset Password

Enter enable mode

Type: en

Restore our config file: 

Type: rename flash:config.text.orig flash:config.text

Set a new password of "realtechtalk.com" (obviously change to the password you want for security reasons).

Type: enable secret realtechtalk.com

Save The New Config/Password You Set

Type: do wr

A lot of older devices either support telnet or very old SSH keyx algorithms which are insecure and disabled by all newer/modern SSH clients for security reasons.  However, sometimes you may be on a LAN via VPN or some other secured network or for whatever reason, absolutely, need to connect to this device and sometimes old/embedded devices may not be possible to update to a newer SSH server.

If you run into this you may be using a modern/newer SSH client and get this error:

Unable to negotiate with 192.168.20.2 port 22: no matching key exchange method found. Their offer: diffie-hellman-group-exchange-sha1,diffie-hellman-group14-sha1,diffie-hellman-group1-sha1

Solution:

You can solve it by adding at least one of the algorithms it lists and to choose another cipher like this:

ssh -o KexAlgorithms=+diffie-hellman-group1-sha1 -o Ciphers=aes256-cbc rttuser@192.168.20.2
 

We add the Ciphers option above as many devices still won't work unless you specify a cipher like above.

It has been renamed to kde-spectacle so you install it like so:

sudo apt install kde-spectacle

You'll find it in your start menu listed as "Take Screenshot"

Just edit your ~/.bashrc and add this at the very end:

export PS1="realtechtalk.com"

Then your prompt will look like this:
 

bladeblox:uptime
 08:47:14 up 48 min,  1 user,  load average: 1.00, 1.07, 0.96
 

If you wanted a dollar sign at the end then you would change it like this:

export PS1="realtechtalk.com$:"

You can add other characters into it like spaces or even colon's etc into the PS1 variable above.

h = show the hostname

W = show the current path

It is common that you may get access to undocumented equipment and need to reset the password.  This applies to many Cisco routers whether 2600, 2900, 3900 etc...

Cisco's Guide says to hit Ctrl + Pause/Break but if it doesn't work on some devices causing people to say "cisco password reset pause break does not work", you can see Cisco's alternative key combinations here: 

Step 1: Power Cycle The Router/Switch to enter rommon mode

Immediately and within 60 seconds hit Ctrl + Pause/Break repeatedly until you see the "rommon 1" prompt.  If the image boots normally to the console, then you've hit the keys too late or maybe you need to check the alternative key combinations above.

Type "confreg 0x2142" and then "reset".  This will then give you root access without authentication.

Step 2 - Wait for the reboot, load config and reset the password

Once the image loads, make sure that you hit "no" to the "Would you like to enter the initial configuration dialog".

Type "en" or "enable" to enter enable mode.

copy start run

Then hit "enter" to accept the default destination filename of "running-config"

Now Reset Your Enable Password:

conf t


enable secret oursecretpassword

Remember to save the current config:

wr

or

copy run start

If you need to reset the console password:

This is wise to do as presumably you don't have access in any other mode at this point and if you exit enable mode you won't be able to re-enter if there is a password on the console.

Be sure to do a "wr" or copy run start after this to save the changes.

Step 3 - Reset config register

in config mode you have to set the register back to 2102, otherwise the router will keep booting without the startup config.

config-register 0x2102

This seems to be an ongoing issue that is still reproducable in the latest Ubuntu Vbox 6.x.

The default NAT Network range is usually 10.0.2.0/24.  If you change this range it does not seem to work properly.

Say we change the range to 10.50.1.0/24

If you get a new lease you will find that you get an IP from the old range but the default gateway is from the new range.

Solution

Delete this Network from Nat Networks and create a brand new one with the correct range and assign the new Nat Network to your VMs with the range that you wanted.  There is some sort of bug that prevents VBOX from handing out the updated range.

So you're trying to browse to a properly configured Samba share but you get this error:

Unable to mount location
Failed to retrieve share list from server: Connection timed out
 

If your config is right, it can be due to a protocol miss-match where your client has not enabled SMB3 but by default the other side (server) has enabled it.

You can test this out to see with the smbclient tool

smbclient -L YourIP
protocol negotiation failed: NT_STATUS_INVALID_NETWORK_RESPONSE
 

If you got the above error it is likely a protocol error that can be fixed and solved like this:

Just edit your smb.conf file on the client side

#add this to globals in /etc/samba/smb.conf
client max protocol = smb3
 

After that you should be able to view the share successfully.

This is a common issue when e-mailing or uploading video files.

One note is that you should make the filesize you choose below about 20% smaller than you need.  For example I took a 219MB video and told it to be 20M.  The resulting file was still about 21.9M but it was OK when I said 18M and was barely below the 20M size.

ffmpeg is our friend here, just use this command:

1. Change the -fs 100M to the size you want eg. 20M, 500M
2. Change the -i TheLargeVideo.mp4 to the name of your video
3. Change the TheLargeVideo-resize.mp4

ffmpeg -i TheLargeVideo.mp4 -fs 100M TheLargeVideo-resize.mp4

1.) gg and dG

The easiest way is to type "gg" to bring yourself to the first line of the file and the "dG" clears the contents.

2.) :1,$d

Hit Escape and colon and then type: 1,$d and all contents / lines of the file will be cleared.

If you are using the stock 5.4 kernel this is normal but I can confirm it is fixed in newer 5.8 kernels.

To fix it just install the 5.8 kernel and reboot:

sudo apt install linux-headers-5.8.0-64-generic linux-modules-extra-5.8.0-64-generic linux-image-5.8.0-64-generic

Usually if you get the grub boot loader and it doesn't show any boot options, it's because grub was not installed correctly and/or the partition that it is supposed to be on has changed or does not exist.  It can also happen if you install Linux to one drive, but the boot loader to another by accident, whether EFI or MBR/Legacy mode.

You can normally fix it by chrooting into your root partition:

#become root

sudo su

#make a directory called target where we will mount your root partition
mkdir /target

#mount /dev/sda3 to target (change to match your root partition)
mount /dev/sda3 /target

#if you are using EFI mount your EFI partition to /target/boot/efi (assume here it is /dev/sda1)
mount /dev/sda1 /target/boot/efi


#we need to mount dev proc and sys for the chroot to work like it was booted normally so we can fix it

for mount in dev proc sys; do
  mount -o bind /$mount /target/$mount
done


#now chroot
chroot /target

#run grub install on the drive that you installed Linux to
grub-install /dev/sda

Just a quick note and warning is that if you are testing to see if EFI PXE booting works on a VM, MAKE SURE it actually works.  For example I initially tested using my Distro's QEMU 2.5+dfsg-5ubuntu10.46 and ovmf BIOS firmware (OVMF supports EFI). However, I found on old versions of QEMU (like 2.5), EFI booting with GRUB NEVER works so it may appear that you have made a mistake when everything is fine when you boot a physical machine.  But it does work fine with QEMU 4.2.0 that I compiled.

So if you've followed this guide and verified your firewall is not blocking things, that your tftp server IP is correct, and your DHCP is configured correctly, and your tftp server is configured correctly, then consider trying a physical machine or newer version of whatever emulation you are using to test via VM.

The only way I could get this to work was to use my own compiled grub 2.04 (some previous versions of grub are said to be buggy and don't work with EFI apparently).

Step 1 - Compile grub 2.04 and create your EFI image to be served from your tftp server

Download grub 2.04 source: https://ftp.gnu.org/gnu/grub/grub-2.02.tar.gz

Make sure you run ./configure --with-platform=efi otherwise there will be no EFI built.

Enter your compiled grub 2.04 directory and execute this:

./grub-mkimage -d grub-core --format=x86_64-efi -p "/" --output=BOOTx64.EFI  `ls grub-core | sed -n 's/.mod$//gp'`
 

We use our own grub 2.04 compiled mkimage: ./grub-mkimage

We tell it to make a 64-bit EFI grub2 boot image: --format=x86_64-efi

We tell it where to look for the grub.cfg file which we declare to be the root of the tftp server: -p "/"

*eg if your tftp is in /tftpboot then grub.cfg is /tftpboot/grub.cfg, or if it's /srv/tftp then it will search for grub.cfg in /srv/tftp/grub.cfg

We declare the output file to be called "BOOTx64.EFI" but in theory it could be output anywhere and called anything: --output=BOOTx64.EFI

We compile ALL grub modules into the .EFI image so there is no issues with grub trying to find or load modules in x86_64-efi directory: `ls grub-core | sed -n 's/.mod$//gp'`

grub-core is relative to your manually compiled grub2.04 directory and the command finds all grub modules (by searching for anything ending in .mod) and including them.  There is little penalty for doing this as a normal tftp and efi module include would make an image about 232K and including all modules makes it about 2.5M.

Step 2 - Install and configure your tftpd-hpa server

apt install tftpd-hpa

If you install the tftpd-hpa server in a newer Debian, the default serving directory is /srv/tftp. 

You can edit /etc/default/tftpd-hpa and restart the service to change this TFTP_DIRECTORY="/srv/tftp"

I recommend editing the above config file to add -v to the options so you can see a log in /var/log/daemon.log of what if any files are being requested for troubleshooting purposes: TFTP_OPTIONS="--secure -v"
 

Copy the BOOTx64.EFI created in the previous step to /srv/tftp

*do not use a pre-existing one from your distro or ISO as it will probably NOT work and only give you the plain grub screen without any menu)

Create grub.cfg in /srv/tftp

Example (modify to suite your needs/distro you are serving):

if loadfont /boot/grub/font.pf2 ; then
        set gfxmode=auto
        insmod efi_gop
        insmod efi_uga
        insmod gfxterm
        terminal_output gfxterm
fi

set menu_color_normal=white/black
set menu_color_highlight=black/light-gray

menuentry "Start Linux Mint 20.1 MATE 64-bit" --class linuxmint {
        set gfxpayload=keep
        linux   images/mint20/casper/vmlinuz root=/dev/nfs ip=dhcp boot=casper netboot=nfs nfsroot=192.168.1.250:/srv/tftp/images/mint20
        initrd  images/mint20/casper/initrd.lz
}
 

Step 3- Now you need to configure your DHCP server to tell clients where to find your tftp server:

Linux ISC DHCP server/dhcpd:

I assume your tftp server is 10.10.10.200 in this example and that your IP range for clients is the same /24

Be sure to change the IPs + ranges to match your needs. 

next-server= the IP of your tftp server

vi /etc/dhcp/dhcpd.conf

allow booting;
allow bootp;
option option-128 code 128 = string;
option option-129 code 129 = text;
#filename "/pxelinux.0";
#filename "pxelinux.0";
filename "BOOTx64.EFI";
option option-209 code 209 = string;
next-server 10.10.10.200;
authoritative;
ddns-update-style none;
subnet 10.10.10.0 netmask 255.255.255.0 {
  range 10.10.10.2 10.10.10.200;
  #deny unknown-clients;
  option routers 10.10.10.1;
  option domain-name-servers 208.67.222.222;
  filename "BOOTx64.EFI";

}

 

In Juniper's JunOS you will do something like this

Enter config mode and enter these commands:

#create DHCP pool with your range

set system services dhcp pool 10.10.10.0/24

#set your default gateway as 10.10.10.1

set system services dhcp pool 10.10.10.0/24 router 10.10.10.1

# set the dns servers that clients use to be OpenDNS's servers

set system services dhcp pool 10.10.10.0/24 name-server 208.67.222.222                  
set system services dhcp pool 10.10.10.0/24 name-server 208.67.220.220  

#tell the DHCP clients to use the BOOTx64.EFI file for grub

set system services dhcp boot-file BOOTx64.EFI

#set tftp and next server to be the tftp server .200 (without next-server the client may try to retrieve the files from the dhcp server instead.


set system services dhcp boot-server 10.10.10.200
set system services dhcp next-server 10.10.10.200

#set the range of IPs to be given out eg. .2 to .200  
set system services dhcp pool 10.10.10.0/24 address-range low 10.10.10.2 high 10.10.10.200

#an example of how to exclude certain addresses if they are within the range you define to be given out (if possible just leave them out of the range and then there's no need to exclude)

set system services dhcp pool 10.10.10.0/24 exclude-address 10.10.10.50


Step 4 - Test It

If all went well you should be able to see the proper grub screen and menu on your client.  If not check your config above and work backwards (eg. does the client get a proper DHCP IP. is it hitting your tftp server at all?).

Aruba has a very traditional "admin" for user and password by default for many of its appliances.  If you've reset or just got some new units this will be the default password that you should change immediately for security reasons.

If you want to start fresh a lot of people falsely assume that an apt remove and then reinstall or apt --reinstall install package will start you off fresh.  To be sure and remove all associated config files do the below with the example of ssh server (don't remove it though if you actually use it!)

The key below is using the --purge flag or apt-get purge proftpd (eg sudo apt --purge remove packagename)

apt purge proftpd; apt install proftpd

Traditionally kernels were numbered starting from 0 but by default the "new style" of grub boot loading considers each subkernel item to be different so if you have 3 entries for 4.40-148 rather than counting for 1.

To get the expected behavior let's show this example and how we can boot it

We do a grep on menuentry in /boot/grub/grub.cfg to see all of the bootable kernels rather than scrolling through loads of extra entries we don't care about (though grub does care and won't boot without them so don't mess things up here if you are editing grub.cfg!)

grep menuentry /boot/grub/grub.cfg

if [ x"${feature_menuentry_id}" = xy ]; then
  menuentry_id_option="--id"
  menuentry_id_option=""
export menuentry_id_option
menuentry 'Linux Mint 17.2 MATE 64-bit' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-simple-61f69d26-da8e-4317-a5cb-834402b90501' {
submenu 'Advanced options for Linux Mint 17.2 MATE 64-bit' $menuentry_id_option 'gnulinux-advanced-61f69d26-da8e-4317-a5cb-834402b90501' {
    menuentry 'Linux Mint 17.2 MATE 64-bit, with Linux 4.4.0-148-generic' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-4.4.0-148-generic-advanced-61f69d26-da8e-4317-a5cb-834402b90501' {
    menuentry 'Linux Mint 17.2 MATE 64-bit, with Linux 4.4.0-148-generic (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-4.4.0-148-generic-recovery-61f69d26-da8e-4317-a5cb-834402b90501' {
    menuentry 'Linux Mint 17.2 MATE 64-bit, with Linux 4.4.0-134-generic' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-4.4.0-134-generic-advanced-61f69d26-da8e-4317-a5cb-834402b90501' {
    menuentry 'Linux Mint 17.2 MATE 64-bit, with Linux 4.4.0-134-generic (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-4.4.0-134-generic-recovery-61f69d26-da8e-4317-a5cb-834402b90501' {
    menuentry 'Linux Mint 17.2 MATE 64-bit, with Linux 4.4.0-108-generic' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-4.4.0-108-generic-advanced-61f69d26-da8e-4317-a5cb-834402b90501' {
    menuentry 'Linux Mint 17.2 MATE 64-bit, with Linux 4.4.0-108-generic (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-4.4.0-108-generic-recovery-61f69d26-da8e-4317-a5cb-834402b90501' {
    menuentry 'Linux Mint 17.2 MATE 64-bit, with Linux 4.4.0-98-generic' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-4.4.0-98-generic-advanced-61f69d26-da8e-4317-a5cb-834402b90501' {
    menuentry 'Linux Mint 17.2 MATE 64-bit, with Linux 4.4.0-98-generic (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-4.4.0-98-generic-recovery-61f69d26-da8e-4317-a5cb-834402b90501' {
    menuentry 'Linux Mint 17.2 MATE 64-bit, with Linux 4.4.0-64-generic' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-4.4.0-64-generic-advanced-61f69d26-da8e-4317-a5cb-834402b90501' {
    menuentry 'Linux Mint 17.2 MATE 64-bit, with Linux 4.4.0-64-generic (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-4.4.0-64-generic-recovery-61f69d26-da8e-4317-a5cb-834402b90501' {
    menuentry 'Linux Mint 17.2 MATE 64-bit, with Linux 3.19.0-80-generic' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-3.19.0-80-generic-advanced-61f69d26-da8e-4317-a5cb-834402b90501' {
    menuentry 'Linux Mint 17.2 MATE 64-bit, with Linux 3.19.0-80-generic (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-3.19.0-80-generic-recovery-61f69d26-da8e-4317-a5cb-834402b90501' {
    menuentry 'Linux Mint 17.2 MATE 64-bit, with Linux 3.16.0-38-generic' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-3.16.0-38-generic-advanced-61f69d26-da8e-4317-a5cb-834402b90501' {
    menuentry 'Linux Mint 17.2 MATE 64-bit, with Linux 3.16.0-38-generic (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-3.16.0-38-generic-recovery-61f69d26-da8e-4317-a5cb-834402b90501' {
menuentry 'Memory test (memtest86+)' {
menuentry 'Memory test (memtest86+, serial console 115200)' {
 

Say we want to boot 3.19.0-80

If we look at all the unique kernels listed (not duplicates) and count from 0 then 3.19 is #5

Let's edit the default grub file to tell it to boot 3.19 or menu entry #5

sudo vi /etc/default/grub


GRUB_DEFAULT=5
GRUB_DISABLE_SUBMENU=y

*Note we need the GRUB_DISABLE_SUBMENU=y above or things won't work as expected and won't restore the good old "legacy" days of how grub handles kernel entries.

Update grub so the changes take effect

sudo update-grub


After rebooting you should boot into the desired kernel and don't have to rely on the normally correct assumption that the latest and newest kernel is the one you should boot by default/automatically.

 

It seems that QEMU/KVM's default PS2 mouse and keyboard doesn't work right in most cases.  I have especially observed issues using Ctrl+C and Ctrl+V and in Linux you may see repeated key presses in the terminal and you will wonder why you copied something and it's not in the clipboard when you try to paste.  The way to temporarily fix it is to press the key that is repeating once (works in Linux but not really in Windows).

Sometimes when moving your mouse it will also select everything on the screen or click something on it's own (possible click repetition similar to the repeating key issue).

The way around this is to NEVER use the default QEMU PS2 mouse and keyboard (if you run qemu-system-x86_64 without specifying a USB keyboard and mouse, it gives you the bad / buggy PS2 by default).

The solution.

When starting QEMU just pass these flags to give yourself a USB keyboard and mouse:

-usb -device usb-mouse -device usb-kbd  -device usb-tablet

One simple flag to configure will create a makefile that statically links all the shared objects and embeds them instead the binary execute.  This means as long as you have the same architecture that things should run.

Eg. if you have an old version of Debian with a different version of glibc, then this will solve that problem.

./configure LDFLAGS="-static"

To test that it is really statically linked run ldd:

ldd src/wget
    not a dynamic executable


Whereas the standard dynamic binary will be linked to a bunch of .so shared object files which is obviously a pain if making your own Linux distro or needing portability between distros.

 ldd /usr/bin/wget
    linux-vdso.so.1 =>  (0x00007ffe59ded000)
    libpcre.so.3 => /lib/x86_64-linux-gnu/libpcre.so.3 (0x00007f8d3b786000)
    libuuid.so.1 => /lib/x86_64-linux-gnu/libuuid.so.1 (0x00007f8d3b581000)
    libssl.so.1.0.0 => /lib/x86_64-linux-gnu/libssl.so.1.0.0 (0x00007f8d3b319000)
    libcrypto.so.1.0.0 => /lib/x86_64-linux-gnu/libcrypto.so.1.0.0 (0x00007f8d3aed4000)
    libz.so.1 => /lib/x86_64-linux-gnu/libz.so.1 (0x00007f8d3acba000)
    libidn.so.11 => /usr/lib/x86_64-linux-gnu/libidn.so.11 (0x00007f8d3aa87000)
    libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f8d3a6bd000)
    libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f8d3a4a0000)
    /lib64/ld-linux-x86-64.so.2 (0x00007f8d3bc70000)
    libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f8d3a29c000)


If you get this error, you were probably compiling some sort of binary or package and got this error.  It is normally solved by installing the "gettext" package.

On Debian/Ubuntu just apt-get it:

apt-get install gettext

After that you should be able to configure and make (compile) properly.

Many people may not be aware that you can turn commodity hardware into a Mikrotik OS and there are various options which is "CHR" (Cloud Hosted Router) which is a VM image meant for Virtualization only (seriously, I've tried to dd the image to a physical server and it just crashed as it does not contain any drivers for physical).

One note as well if you are trying to do a baremetal install you may get an error "Error Loading Operating System" or the normal "No OS drive detected" from your computer/server's BIOS.  This is a nice way of letting you know that your BIOS sucks/is not compatible with what I believe is syslinux that is installed as the boot loader.  One particular notorious problem vendor is HP's server line (eg. HP DL360e) will just not boot it.

You can download from here: https://mikrotik.com/download

Recommended CHR image: https://download.mikrotik.com/routeros/7.1beta6/chr-7.1beta6.img.zip

Recommended iso (for bare metal):  https://download.mikrotik.com/routeros/7.1beta6/mikrotik-7.1beta6.iso

Also be warned that not having the right license will mean a speed limitation of just 1mbit on CHR.  You can also get a free 60-day trial which will remove the speed limit for that time.

https://help.mikrotik.com/docs/display/ROS/RouterOS+license+keys

Mikrotik Quick Setup CHR/Router OS Guide

You should set the new password first, before putting the router online, because the default is blank and you should have a secure password.

Set a new password:

/password


List All NICs

This is essential so you don't mess up your routing especially if you have more than one NIC.

The command below will print the interface name along with the MAC address.

/interface/ethernet
print

Add IP Address

Replace ether2 with the interface # and /30 with your subnet mask.

/ip/address add address 172.16.52.20/30 interface=ether2
 

Add Gateway

/ip/route add gateway 172.16.52.19
 

Add DNS

/ip/dns  set servers=4.2.2.1

Ping

/tool/ping 192.168.1.1

Beyond this it is fairly simple as you can just go to / and type ? and for any area such as /tool just type ? and you can see a list of possible commands.  You can even break it down and keep typing ? to see what parameters the tool/command takes.

These work well for me:

sudo apt install libusb-1.0-0-dev

./configure --target-list=x86_64-softmmu --enable-opengl --enable-gtk --enable-kvm --enable-guest-agent --enable-spice --audio-drv-list="oss pa" --enable-libusb
make


make install

The problem seems to be that whatever kernel and initrd you have is tied to an old version of CentOS 7 that is no longer in the current repos of most mirrors.

If you were previously able to PXEboot and install CentOS and you are sure your network and tftp are good the problem is that you have an outdated kernel and initramfs that point to a defunct version.

Solution

To fix this you need to download the most current version of CentOS's NetInstall ISO, mount it and extract the intird and vmlinuz files.

Mount the .iso

mount -o loop CentOS-7-x86_64-NetInstall-2009.iso mount/
 

Copy the initramfs and kernel to whereever the old versions are stored and overwrite them (be sure NOT to wipe out your current versions inside /boot!)

#cd to the location of your Centos 7 PXE boot images

cd /tftpd/images/centos7

#copy initramfs and kernel
cp -a mount/isolinux/vmlinuz .
cp -a mount/isolinux/initrd.img .

 

yum update

Loaded plugins: fastestmirror
Setting up Install Process
Determining fastest mirrors
YumRepo Error: All mirror URLs are not using ftp, http[s] or file.
 Eg. Invalid release/repo/arch combination/
removing mirrorlist with no valid mirrors: /var/cache/yum/x86_64/6/base/mirrorlist.txt
Error: Cannot find a valid baseurl for repo: base
You have mail in /var/spool/mail/root
 

Quick and easy 1 second fix solution

#backup your original repos just in case

cp -a /etc/yum.repos.d/ ~

sed -i s#mirror.centos.org#vault.centos.org#g /etc/yum.repos.d/CentOS-Base.repo
sed -i s/mirrorlist=/#mirrorlist=/g /etc/yum.repos.d/CentOS-Base.repo
sed -i s/#baseurl=/baseurl=/g /etc/yum.repos.d/CentOS-Base.repo

To disable selinux temporarily and immediately:

setenforce 0

To make it permanent edit /etc/selinux/config:

vi /etc/selinux/config

It is different than other Wordpress templates.

You have to edit the following file:

wp-content/themes/hueman/parts/single-heading.php

Add the following PHP code to the bottom:

<?php if( has_post_thumbnail()) { the_post_thumbnail(); } ?>
 

kdenlive is VERY finicky especially if using an older or newer version it can cause crashes, menus not to work, features not to work, things not to work properly.

A good example is that I could NOT get automask to work, there would be no box to control it until I did this full reset.

One caution is that your backup project files will be erased when doing this:

How to Reset kdenlive entirely

rm ~/.config/kdenlive-layoutsrc
rm -rf ~/.cache/kdenlive
rm -rf ~/.config/session/kdenlive_*
rm ~/.config/kdenlive-appimagerc
rm -rf ~/.kdenlive/
rm -rf ~/.local/share/kdenlive/profiles/*

After this a lot of problems went away.  You should do this if features aren't working or if changing your version of kdenlive.  Eg running different appimages or changing your version.

The below appears at first to be a bad mirror DNS error, but if you've ruled that out you just need to clear your broken yum cache and things will be good.

yum update
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
 * base: centos.01link.hk
 * extras: centos.01link.hk
 * updates: centos.01link.hk
http://mirror.worria.com/centos/7.8.2003/os/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found
Trying other mirror.
To address this issue please refer to the below wiki article

https://wiki.centos.org/yum-errors

If above article doesn't help to resolve this issue please use https://bugs.centos.org/.

Solution
 

Delete yum cache and it will be OK

/var/cache/yum/*
 

Teams for Linux is horribly broken, especially because the calendar doesn't show any meetings so unless you are in the right Team and Channel at the right time, you cannot join your meeting or know there is one.

As you can see there is an orange bar to represent the meeting but you cannot click it or it makes a new meeting.  For some reason this bug is only present in the Linux app but not in the Android App or from the web calendar.

This is a horrible design flaw that can easily make you miss your meetings.

I have a Canon MF642c and the scanner wouldn't work.  I tried to use saned but it didn't work with the BJNP like it did for some other Canon models.

Introducing sane-airscan with packages for the most common distributions: https://software.opensuse.org/download.html?project=home%3Apzz&package=sane-airscan

https://github.com/alexpevzner/sane-airscan

Just install the package and you should be able to use normal Linux based tools to scan like SimpleScan, it allows me to use my Canon over the network to scan without doing any extra configuration.

How To Use:

After installing just run airscan-discover:

 airscan-discover
[devices]
  Canon MF642C/643C/644C (d0:e9:68) (d0:e9:68) = http://10.10.1.170:80/eSCL/, eSCL
  Canon MF642C/643C/644C (d0:e9:68) (d0:e9:68) = http://10.10.1.170/active/msu/scan, WSD
 

Then tools like SimpleScan should just work.  I can scan from the tray or have the sheetfed scanner work by choosing "Scan All Pages from Feeder".

sane-airscan is a real hero to those of us with somewhat newer scanners that xsane doesn't support or that don't have a Linux driver from the vendor.

Interestingly enough Windows 2000 works fine on QEMU 64-bit but you have to specify Pentium as your CPU otherwise it doesn't complete the install (it will not pass the detecting/setting up devices phase).

-vga cirrus is wise because it is supported by Windows 2000 and allows higher resolutions and 24-bit color.

-cpu Pentium emulates an old computer and is necessary for install to complete

-device rtl8139 is important as this oldschool Realtek 8139 NIC is supported by Windows 2000 (unless you don't need a NIC).

qemu-system-x86_64 -cpu pentium -bios /usr/share/seabios/bios.bin -enable-kvm -m 128 -cdrom ~/Downloads/"Windows2000 .iso" -drive file=Windows2000.qcow2 -netdev user,id=n0 -device rtl8139,netdev=n0 -vga cirrus

Also keep in mind Windows 2000 has long been unsupported and has a myriad of vulnerabilities.  You should only be running it for "the memories" or because you have a Legacy system or data to migrate/test etc..

Windows 2000 runs amazingly well on QEMU and it is a nice reminder of how unbloated Windows was back then, performing lightning fast with just 128MB of RAM and 5GB of HDD being more than enough space to install Windows.  I also like how it looks like Windows 95 but has the NT kernel and NTFS of course.

$ ./test.sh
bash: ./test.sh: Permission denied

This happens normally because you are on a partition that was mounted as "user" and without the exec option.  Also be sure to add exec at the end so no other options set noexec.

Change your fstab or add exec to your mount options:

/dev/md127 /mnt/md127 ext4 auto,nofail,noatime,rw,user,exec 0 0
 

It took a lot of fiddling to make a Huion Kamvas 13 Pro work in Linux but it simple once you know what to do.  Don't bother searching as it is unlkely there is a guide out there that will actually make your tablet work.

It mainly comes down to the fact that the hid_uclogic kernel module is buggy or doesn't support MANY of these wacom based/Huion tablets properly.

What was happening with me is that I had the Kamvas 13 Huion setup as a secondary screen/monitor.  If I tried to draw it would control the mouse on the original screen so there was a HUGE offset and it was impossible to make it work and draw.

A lot of blogs will say use "xsetwacom" but this will not work if your driver (hid_uclogic.ko) is buggy like me.  The solution is to make and install the updated kernel module and then use xsetwacom to map the stylus so it is tied to our tablet and not our main screen.

1. First of all identify your device using lsusb (which will probably not show you the name but you will know by the identifier).


lsusb


Bus 002 Device 019: ID 256c:006d 

If it starts with 256c you've probably found your device ID which is important for the X11 conf file that will be added to /usr/share/X11/xorg.conf.d

2.) Now we need the digimend drivers that will provide a proper working driver

Download the latest from here: https://github.com/DIGImend/digimend-kernel-drivers/archive/master.zip

unzip master.zip

cd digimend-kernel-drivers

make; make install

3.) Make sure that your tablet was correctly added or list here:

If your ID is not there you can always try to add it manually by adding a | and then your ID like the example in bold which represents my Kamvas 13.  

Section "InputClass"
    Identifier "Huion tablets with Wacom driver"
    MatchUSBID "5543:006e|256c:006e|256c:006d"
    MatchDevicePath "/dev/input/event*"
    MatchIsKeyboard "false"
    Driver "wacom"
EndSection

vi /usr/share/X11/xorg.conf.d/50-digimend.conf

4.) Remove the bad driver and insert the new one

sudo rmmod hid-uclogic


sudo modprobe hid-uclogic

5.) Use xsetwacom so the stylus works only on our tablet:

Remember HEAD is specifying which monitor ID so it's important to choose the right one.

Remember that 11 is the ID in xsetwacom of your stylus. 

How to find your stylus ID

We can see below the ID is 11

 xsetwacom list
Tablet Monitor Pen stylus           id: 11    type: STYLUS   
Tablet Monitor Pad pad              id: 12    type: PAD      
Tablet Monitor Touch Strip pad      id: 13    type: PAD

*Note that each time you unplug or replug the tablet that its ID will change and increase.  Generally the highest number ID is going to be the correct one. 

HEAD-1 = monitor 2 (if you wanted monitor 3 it would be HEAD-2 or if you wanted monitor 1 it would be HEAD-0)

This command maps the stylus to your tablet.  The advantage here is that there is no need to get or set area, the command below does it for us so there's no math involved to make our tablet work!

xsetwacom --verbose set 11 MapToOutput HEAD-1

... 'set' requested for '11'.
... Checking device 'Virtual core pointer' (2).
... Checking device 'Virtual core keyboard' (3).
... Checking device 'Virtual core XTEST pointer' (4).
... Checking device 'Virtual core XTEST keyboard' (5).
... Checking device 'Power Button' (6).
... Checking device 'Power Button' (7).
... Checking device 'PixArt Lenovo USB Optical Mouse' (8).
... Checking device 'Logitech USB Keyboard' (9).
... Checking device 'Logitech USB Keyboard' (10).
... Checking device 'Tablet Monitor Pen stylus' (11).
... Checking device 'Tablet Monitor Pad pad' (12).
... Checking device 'Tablet Monitor Touch Strip pad' (13).
... Checking device 'Tablet Monitor Dial' (14).
... Device 'Tablet Monitor Pen stylus' (11) found.
... RandR extension not found, too old, or NV-CONTROL extension is also present.
... Setting xinerama head 1
... Remapping to output area 1024x768 @ 1600,0.
... Transformation matrix:
...     [ 0.390244 0.000000 0.609756 ]
...     [ 0.000000 0.853333 0.000000 ]
...     [ 0.000000 0.000000 1.000000 ]


With ffmpeg it literally takes out what you want so you can use it later. Eg. below -ss means starting time is 16 minutes and 30 seconds and -to means extract until 17 minutes and 23 seconds

-i = the input file

output file = CCME-flash-and-2-phone-setup-final.mp4


ffmpeg -i CCME-flash-and-2-phone-setup.mp4 -ss 00:16:30 -to 00:17:23 -c copy CCME-flash-and-2-phone-setup-final.mp4

 How to specify until the end without specifying the time?

If we don't specify a -to then it will take everything from the start until the end and you don't have to specify when that is.

ffmpeg -i CCME-flash-and-2-phone-setup.mp4 -ss 00:16:30 -c copy CCME-flash-and-2-phone-setup-final.mp4

This normally works but if not use my mencoder solution if the output video does not play past the joined time.

the contents of list.txt need to look like this:

file somefile.mp4


file somefile2.mp4

then run ffmpeg

ffmpeg -f concat -i list.txt -c copy CME-2-router-dial-peer-final.mp4

The result is almost instant joining since there is no video processing since we are copying the video codec as is

The problem for me is that I had two videos with different types of audio streams.  ffmpeg would join them but they would not play past the point of the join.

So I used mencoder like below and it joined the audio and made them both mp3 streams and it worked!

-oac mp3lame specifies the audio to be convered into an mp3 stream using the lame codec.

after the oac the two files are the ones to be joined.

the -o is the name of the output file

mencoder -ovc copy -oac mp3lame CME-2-router-dial-peer-part1.mp4 CME-2-router-dial-peer-part2-edited-audio.mp4 -o CME-dial-peer.mp4
 

When you automount a drive in /etc/fstab even if it's not important like an external drive that you only use sometimes and is not required for booting, it will prevent a successfuly boot.

If you disable quiet mode for booting you will see something like below "A start job is running for dev-disk ...."

How do we fix an fstab entry from preventing our boot?

The drive in question is mounted to /mnt/vdb1

All we have to do is add ",nofail" after defaults on that line entry and it will continue to boot normally if the drive is not found or cannot be mounted.

A very common use case is that you don't want to waste time using a video editor that requires you to open it up and manually import the video clip and audio clip, then manually delete the old audio track and import the video and new audio.  That's too much work and time since we don't want to go through the hassle.

ffmpeg is our solution, all we have to do is specify 3 variables and we're done!

-i Windows2019-Server-Noaudio.mp4 is our input / source file

-i Windows2019-Server-NoAudio.wav is our new audio file that we want to replace.

Windows2019-Server-NoAudio-audio-fix.mp4 is our final output file that will have our updated audio file

ffmpeg -i Windows2019-Server-NoAudio.mp4 -i Windows2019-Server-NoAudio.wav -c:v copy -map 0:v:0 -map 1:a:0 Windows2019-Server-NoAudio-audio-fix.mp4


ffmpeg version 2.8.17-0ubuntu0.1 Copyright (c) 2000-2020 the FFmpeg developers
  built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.12) 20160609
  configuration: --prefix=/usr --extra-version=0ubuntu0.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv
  WARNING: library configuration mismatch
  avcodec     configuration: --prefix=/usr --extra-version=0ubuntu0.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --cc=cc --cxx=g++ --enable-gpl --enable-shared --disable-stripping --disable-decoder=libopenjpeg --disable-decoder=libschroedinger --enable-avresample --enable-avisynth --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxvid --enable-libzvbi --enable-openal --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-frei0r --enable-libx264 --enable-libopencv --enable-version3 --disable-doc --disable-programs --disable-avdevice --disable-avfilter --disable-avformat --disable-avresample --disable-postproc --disable-swscale --enable-libopencore_amrnb --enable-libopencore_amrwb --enable-libvo_aacenc --enable-libvo_amrwbenc
  libavutil      54. 31.100 / 54. 31.100
  libavcodec     56. 60.100 / 56. 60.100
  libavformat    56. 40.101 / 56. 40.101
  libavdevice    56.  4.100 / 56.  4.100
  libavfilter     5. 40.101 /  5. 40.101
  libavresample   2.  1.  0 /  2.  1.  0
  libswscale      3.  1.101 /  3.  1.101
  libswresample   1.  2.101 /  1.  2.101
  libpostproc    53.  3.100 / 53.  3.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'Windows2019-Server-NoAudio.mp4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: mp42mp41isomiso2
    creation_time   : 2020-10-05 16:14:56
    encoder         : x264
  Duration: 00:02:28.60, start: 0.000000, bitrate: 258 kb/s
    Stream #0:0(eng): Video: h264 (High 4:4:4 Predictive) (avc1 / 0x31637661), yuv444p, 1282x958 [SAR 1:1 DAR 641:479], 127 kb/s, 15 fps, 15 tbr, 1500 tbn, 30 tbc (default)
    Metadata:
      creation_time   : 2020-10-05 16:14:56
      handler_name    : VideoHandler
    Stream #0:1(eng): Audio: mp3 (mp4a / 0x6134706D), 44100 Hz, mono, s16p, 127 kb/s (default)
    Metadata:
      creation_time   : 2020-10-05 16:14:56
      handler_name    : SoundHandler
Guessed Channel Layout for  Input Stream #1.0 : mono
Input #1, wav, from 'Windows2019-Server-NoAudio.wav':
  Duration: 00:02:28.56, bitrate: 705 kb/s
    Stream #1:0: Audio: pcm_s16le ([1][0][0][0] / 0x0001), 44100 Hz, 1 channels, s16, 705 kb/s
[mp4 @ 0x1702ca0] Codec for stream 0 does not use global headers but container format requires global headers
Output #0, mp4, to 'Windows2019-Server-NoAudio-audio-fix.mp4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: mp42mp41isomiso2
    encoder         : Lavf56.40.101
    Stream #0:0(eng): Video: h264 ([33][0][0][0] / 0x0021), yuv444p, 1282x958 [SAR 1:1 DAR 641:479], q=2-31, 127 kb/s, 15 fps, 15 tbr, 12k tbn, 1500 tbc (default)
    Metadata:
      creation_time   : 2020-10-05 16:14:56
      handler_name    : VideoHandler
    Stream #0:1: Audio: aac (libvo_aacenc) ([64][0][0][0] / 0x0040), 44100 Hz, mono, s16, 128 kb/s
    Metadata:
      encoder         : Lavc56.60.100 libvo_aacenc
Stream mapping:
  Stream #0:0 -> #0:0 (copy)
  Stream #1:0 -> #0:1 (pcm_s16le (native) -> aac (libvo_aacenc))
Press [q] to stop, [?] for help
frame= 2229 fps=1183 q=-1.0 Lsize=    4701kB time=00:02:28.57 bitrate= 259.2kbits/s    
video:2320kB audio:2322kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 1.275361%
 

qemu-img can convert many formats.

Here is an example

-f raw = this means the format of the source image (instead of raw it could be vdi, vmdi, qcow2 etc..)

-O vdi = the output format that you are converting to (instead of vdi it could be vmdk or qcow2)

windows2019.img = the source file

windows2019.vdi = the output file (you should give it the extension of the format you converted to

qemu-img convert -f raw -O vdi windows2019.img windows2019.vdi

The problem is that Linux uses UTC and Windows uses the local time from the RTC.

This results in very annoying issues when booting between the two because the clock is set based on the different standards once you boot.

The easiest solution is to change your Linux to use RTC this way:


timedatectl set-local-rtc 1 --adjust-system-clock

To change it back to UTC:

timedatectl set-local-rtc 0 --adjust-system-clock

The idlepc value is very important to dynamips and it is both image and often CPU dependent.  There is no "magic" value that will work for all images and all CPUs so this is why I'll show you a quick and handy way.

Also don't be disappointed, some values do not work well but idlepc gives you several.  For example in my example below #6 didn't help at all but #7 got me down to about 6% CPU from 99-100%.

1.) Make sure your dynagen config file has no idlepc value set or comment it out with a #

2.) Start dynagen

dynagen yourconf.conf

3.) Calculate the idlepc value:

From the dynagen console type:

idlepc get r1

*I assume r1 is the name of the router you want to set idlepc on, if not change it

After a few seconds it will say "Please wait while gather statistics" and show you a list of values.  Generally the ones with the * in front will be the best.  Copy the full value for #7 below you would copy "0xffffffff8000aa40" (without the quotes).

I find that it will say it will set and apply the value but that is not true (it never seems to be able to apply it since dynamips is running), you should kill dynagen, edit your config with the idlepc value and then start it again.

4.) Set the idlepc value. 

Now copy the value above for example "0xffffffff8000aa40"and put it into your conf file:

idlepc = 0xffffffff8000aa40

5.) Enjoy low CPU utilization :)

Startup dynagen again and restart your router.  You should see the CPU utilization is nice and low now.  If not then try another idlepc value.

Below you can see that dynamips is just 6.6% and before that it was 98-100%

1.) Install dynagen and dynamips

2.) Also configure your bridge or br0

If you don't have a br0 on your Linux machine then follow this guide or video for Debian:

Alternatively you can use NIO_linux_eth:eth0 for f0/0 below but remember the host machine cannot talk to the router then.

3.) Create your dynagen config

Save the file below to something.conf

#Example config:

 autostart = False
[127.0.0.1:2000]
workingdir = /home/mint/router
udp = 10100
[[7200]]
image = c7200-adventerprisek9-mz.151-4.M.bin
disk0 = 256
#idlepc = 0x60be916c
[[ROUTER r1]]
model = 7200
console = 2521
aux = 2119
#wic0/0 = WIC-1T
#wic0/1 = WIC-1T
#wic0/2 = WIC-1T

#instead youcould use f0/0=NIO_linux_eth:eth0 but your host would not have communication with the router


f0/0 = nio_tap:tap1
x = 22.0
y = -351.0

4.) Start dynamips

sudo dynamips -H 2000&

5.) Start your router

dynagen yourconffromstep3.conf

6.) Connect to your router and configure

telnet localhost 2521

enable
conf t
int fa0/0
ip address 192.168.5.1 255.255.255.0
no shut


7.) Test connectivity

Make sure you put your tap1 on the bridge and put up tap1.  After this you should be able to ping your router but remember your host's br0:0 should be created and be on the same subnet to work.

sudo brctl addif br0 tap1


sudo ifconfig tap1 up

Performance Tuning

I recommend you set calculate and set idlepc, as a wrong value or no value will guarantee it will use at least ~100% of the CPU core dynamips is on.  Check this guide here to set idlepc for dynamips with dynagen

Helpful Dynagen and Dynamips Startup Script

This script as it is will get your r1 and r2 router up without typing any commands.  All you have to do is change the .conf file name to your own and make sure to save the contents of the script to an "something.sh", chmod +x something.sh and then ./something.sh and it will automatically get you going.  It also kills any other instances of dynamips or dynagen to avoid conflicts.  The only thing it does need is sudo so it will ask for your sudo password.

Remember that you need "expect" installed or this script will not work (use apt install expect or yum install expect).

The script makes a few assumptions but you can of course change it.

1.) Dynamips is to be started on port 2000 if not change it!

2.) That you want to create two tap devices "tap1" and "tap2" and add them to your bridge br0

3.) It also assumes you are in the directory of "yourconffile.conf" in bold in the script below.  Change that name to the name of yours

4.) Finally it also assumes that you have routers r1 and r2 that you want to be started automatically in the send "start r1n" area.  You can add more lines for more routers or change the names according to your needs.

#!/bin/bash
sudo killall dynamips dynagen
sudo dynamips -H 2000 &

sudo ip tuntap add tap1 mode tap
sudo ip tuntap add tap2 mode tap
sudo brctl addif br0 tap1
sudo brctl addif br0 tap2

sudo ifconfig tap1 up
sudo ifconfig tap2 up

expect <(cat <<'EOD'
spawn dynagen yourconffile.conf
expect "Dynagen management console for Dynamips"
send "start r1n"
send "start r2n"
interact
exit
EOD
)



The best way to avoid this problem is to understand how your BIOS is setup to boot.

Often newer machines will default to U(EFI) which is different than the traditional MBR/Legacy mode.

The problem is that this may not be apparent, often a BIOS Boot Menu will show a Legacy Boot Option and EFI Option without defining it.

A good example of this is if your USB is called "Kingston" you may see in your Boot Menu "Kingston" and also "Ubuntu".

Choosing the name of your USB will mean it is booting and installing as Legacy/BIOS mode.  This will normally result in you being unable to boot after installing depending on your BIOS.

The best way forward would be to choose the EFI boot option which is "Ubuntu" to avoid this problem.

Alternatively some BIOS give you the option to have Auto/Dual mode (Legacy and UEFI) but for many that only have one you should be aware of the above.

This assumes your system is a fresh and normally working install.

What often happens is that many new devices have multiple audio outputs which are generally analog and HDMI/Digital out.  Sometimes the OS defaults to the wrong one that you didn't want.

For example if your sound is supposed to play over the HDMI, perhaps the output is set to analog or vice versa.

This happens to a lot of Nvidia users especially users of newer cards like the RTX series.  If for example you are trying to boot and install Linux and you get a black and white grub2 screen instead of a nice graphical welcome installer, you probably suffer from this bug.  It is normally followed by the user booting and finding they just have a blank/black screen.

Here is the quick flow of steps to fix it:

If you get a black grub screen when booting Linux Mint install instead of the graphical Mint you probably have a newer graphics card especially an Nvidia RTX etc...

The problem is that sometimes the kernel and card do not play nicely and the video card is not able to set a resolution.

Solution - By using nomodeset it bypasses this issue.

1.) On the grub screen hit "e" over top of the default kernel that grub will boot (normally indicated with a star).  Example below.

2.) Navigate with the arrows to the end of the line that starts with "linux".
3.) At the end add "nomodeset" (without quotes). Example screenshot below

4.) Then hit Ctrl + X or F10 to boot, it should no longer just be a black screen and you should boot to the installer or Live Desktop.
5.) Install Linux normally
6.) Once again before booting you will have to perform the steps above by hitting e and adding the nomodeset to the linux line.
7.) After booting into your install do this to make the fix permanent otherwise you have to do the steps above each time you boot.

sudo vi /etc/default/grub

add "nomodeset" to the this GRUB_CMDLINE_LINUX_DEFAULT variable so it looks something like below:

GRUB_CMDLINE_LINUX_DEFAULT="quiet splash nomodeset"

8.)  Apply the changes permanently.

You need to update your grub boot files to make it happen each time you boot.

sudo update-grub

If you are RHEL based like Centos, Fedora then you would run this instead:

grub2-mkconfig -o /boot/grub2/grub.cfg

Before you try to install and dual boot it is very important to understand the concept of "what boot mode your BIOS is in" and "what mode you booted the installer to".

Then follow the example of Linux Mint (but most Linux installers are very similar) to carefully understand WHERE you are installing your Boot Loader to whether that be MBR or EFI.

How Am I Booted?

First it's important to check your BIOS to see if it is in UEFI mode or Auto, or both (some BIOS can boot Legacy and UEFI side by side).

The real question inside Linux before you install is to make sure you booted to the right mode.  If your BIOS is set to UEFI you want to check from the installer to make sure which mode you have booted into.

How You Boot The Installer Matters!

When you boot from your USB or CD you will normally be given two choices for it (assuming you have an UEFI supported BIOS):

Here are some examples of what you might see:

As you can see in the first example the first option "USD HDD" would obviously boot Legacy/MBR and the second option would boot EFI "USB HDD EFI"

USB HDD


USB HDD EFI

Below you will see some BIOS' will name your USB so often if your USB stick is made by Kingston it may say "Kingston" or "Kingston USB".  The point it is that once again it is usually easy to understand which is EFI or Legacy/MBR booting mode.

Kingston


Kingston EFI


Sometimes another clue to EFI is that instead of the above the EFI option may say something like "USB (Ubuntu)" and anything that specifies an actual OS name is ALWAYS going to be EFI.

How To Check If You Booted As EFI or Legacy/MBR?

Check for the existence of /sys/firmware/efi/

ls /sys/firmware/efi

If it is present like you see below that means you are using EFI.  If it's not present it means you are in Legacy/MBR mode.

Choose Your Path MBR or EFI?

If you've followed above you can avoid disaster by following along.

MBR Install Guide

EFI Install Guide

MBR/Legacy BIOS/CSM Booting Mode

This a potential problem in any case that you have more than one drive attached to your computer whether by USB, SATA or SAS.  The problem is that by default even though you may tell the Linux Mint installer to install to "/dev/whatever" it will by default install the MBR (Master Boot Record) to your main drive.

In many cases your "main drive" will be running Windows or any OS and this will cause your main OS/drive not to be bootable since the MBR will be pointing to the "other drive" you are installing to.  This would cause a breakage on the target drive and the main drive.

So for example if you are installing Linux Mint to /dev/sdb, the MBR would be installed to /dev/sda.

To avoid this watch below how you can choose "Something Else" to manually choose the drive to install the boot loader to the same drive you are installing Linux Mint to.

Choose the same device you are installing to undet hte drop down for "Device for boot loader installation" below.

All is not lost especially on Windows if you accidentally installed the MBR/Bootloader to your main drive, you can use a standard MBR and restore it by following the link below.

If you do wipe our your MBR you can use this from the LiveCD of Linux Mint:

EFI Install Guide

Installing into EFI is not really much different than MBR except that we DO NOT tell it to put the boot loader on the root of the drive as this is not possible.  You will end up with an empty EFI partition that cannot boot if you install this way.

When installing you still have to choose "Something else" to manually partition:

As you can see below with EFI you will also need to create an "efi" partitin when installing.

The key difference between MBR is that for Boot Loader you want to choose partition 1 which is going to be your EFI to install the boot loader.

In the example below my destination if "/dev/vda", you should change that to the device you are installing to.

For example if you are installing to an external or other internal SSD and it is named "/dev/sdb" then you would choose "/dev/sdb1" as your boot loader destination below.

If you don't do the above then the install will successfully complete but not really, if you chose the wrong drive or the wrong partition it won't have installed the EFI boot files.  If you reboot and cannot see any entry for "Ubuntu" on your destination drive you have probably made this mistake.

The process of creating your EFI boot partition

After that your partition setup should be something like below and notice that "Device for boot loader installation: is /dev/vda1" where /dev/vda is the destination (but your drive will probably be /dev/sdb or something else, be aware that it must match your destination install).

In QEMU 4 or higher you can no longer use the normal "-soundhw ac97" flag and it is much more complicated but here is a simple copy and paste on Linux that will just work:

-audiodev you have to use -audiodev to specify the driver and id

driver=pa


id=someid

-device you have to specify the same audiodev id you used in -audiodev and driver

-audiodev driver=pa,id=pa1 -device AC97,audiodev=pa1

Below creates the audio device based off of your host's pulse audio driver and an id that is "pa1"  the -device AC97 is the AC97 hardware that the guest gets and the audiodev (device) is the same one we specified earlier with id "pa1".
 

Cannot register the hard disk '/some/path/windows-marking.vdi' {f54def00-2252-43f5-9178-0998636cad61} because a hard disk '/other-path/windows-marking.vdi' with UUID {f54def00-2252-43f5-9178-0998636cad61} already exists.

Result Code:
NS_ERROR_INVALID_ARG (0x80070057)
Component:
VirtualBoxWrap
Interface:
IVirtualBox {0169423f-46b4-cde9-91af-1e9d5b6cd945}
Callee RC:
VBOX_E_OBJECT_NOT_FOUND (0x80BB0001)


What causes the error?

This is common if you are restoring a virtualbox VM or let's say you had the .vdi file on a certain partition whether remote share or just another partition.  For example I wanted to move my .vdi from HDD to my SSD partition and got the error above.
 

And no, removing the original .vdi from VBOX won't fix it.  It stores the UUID in the .vbox config file and it cannot be edited directly because VirtualBox will just overwrite any change (I tried to just remove the UUID of the old HDD but the change got overwritten).
 

How to solve the error?

Virtualbox has a command that can assign your .vdi a new UUID which will fix the problem:

VBoxManage internalcommands sethduuid /some/path/windows-marking.vdi
UUID changed to: 4a8debca-b235-4478-8264-c2667a053930

Just change the path to the file in bold above to yours and it will create a new UUID.  When you go back into Virtualbox to add the Virtual Disk it will work.
 

 kernel: [549267.368859] mate-terminal[7871]: segfault at 2000000101 ip 00007f5d0a9548f0 sp 00007fff7012c610 error 4 in libgobject-2.0.so.0.4800.2[7f5d0a920000+52000]

This seems to be a long-time bug in Mint mate-terminal where you sometimes move or detach a terminal and it crashes losing all of the other open terminal sessions.

It really seems limited in that it can mainly give you the things you would see on the physical unit such as load etc..

wget https://downloads.sourceforge.net/project/apcupsd/apcupsd%20-%20Stable/3.14.14/apcupsd-3.14.14.tar.gz?r=https%3A%2F%2Fsourceforge.net%2Fprojects%2Fapcupsd%2Ffiles%2Flatest%2Fdownload&ts=1598115866

 tar -zxvf apcupsd-3.14.14.tar.gz
 cd apcupsd-3.14.14
[root@somebox apcupsd-3.14.14]#
./configure --enable-usb

onfig.status: creating platforms/redhat/awkhaltprog
config.status: creating include/apcconfig.h


Configuration on Sat Aug 22 10:06:14 PDT 2020:

  Host:                       x86_64-unknown-linux-gnu -- redhat
  Apcupsd version:            3.14.14 (31 May 2016)
  Source code location:       .
  Install binaries:           /sbin
  Install config files:       /etc/apcupsd
  Install man files:          ${prefix}/share/man
  Nologin file in:            /etc
  PID directory:              /var/run
  LOG dir (events, status)    /var/log
  LOCK dir (for serial port)  /var/lock
  Power Fail dir              /etc/apcupsd
  Compiler:                   g++ 4.4.7
  Preprocessor flags:          -I/usr/local/include
  Compiler flags:             -g -O2 -fno-exceptions -fno-rtti -Wall -Wno-unused-result
  Linker:                     gcc
  Linker flags:                -L/usr/local/lib64 -L/usr/local/lib
  Host and version:           redhat
  Shutdown Program:           /sbin/shutdown
  Port/Device:                /dev/ttyS0
  Network Info Port (CGI):    3551
  UPSTYPE                     apcsmart
  UPSCABLE                    smart

  drivers (no-* are disabled): apcsmart dumb net no-usb snmp pcnet modbus no-modbus-usb no-test

  enable-nis:                 yes
  with-nisip:                 0.0.0.0
  enable-cgi:                 no
  with-cgi-bin:               /etc/apcupsd
  with-libwrap:              
  enable-pthreads:            yes
  enable-dist-install:        yes
  enable-gapcmon:             no
  enable-apcagent:            no
 
Configuration complete: Run 'make' to build apcuspd.


make




  AR    src/drivers/apcsmart/libapcsmartdrv.a
        src/drivers/dumb
  CXX   src/drivers/dumb/dumboper.c
  CXX   src/drivers/dumb/dumbsetup.c
  AR    src/drivers/dumb/libdumbdrv.a
        src/drivers/net
  CXX   src/drivers/net/net.c
  AR    src/drivers/net/libnetdrv.a
        src/drivers/pcnet
  CXX   src/drivers/pcnet/pcnet.c
  AR    src/drivers/pcnet/libpcnetdrv.a
        src/drivers/snmplite
  CXX   src/drivers/snmplite/apc-mib.cpp
  CXX   src/drivers/snmplite/asn.cpp
  CXX   src/drivers/snmplite/mge-mib.cpp
  CXX   src/drivers/snmplite/mibs.cpp
  CXX   src/drivers/snmplite/rfc1628-mib.cpp
  CXX   src/drivers/snmplite/snmp.cpp
  CXX   src/drivers/snmplite/snmplite.cpp
  AR    src/drivers/snmplite/libsnmplitedrv.a
        src/drivers/modbus
  CXX   src/drivers/modbus/mapping.cpp
  CXX   src/drivers/modbus/modbus.cpp
  CXX   src/drivers/modbus/ModbusComm.cpp
  CXX   src/drivers/modbus/ModbusRs232Comm.cpp
  AR    src/drivers/modbus/libmodbusdrv.a
  CXX   src/drivers/drivers.c
  AR    src/drivers/libdrivers.a
  CXX   src/options.c
  CXX   src/device.c
  CXX   src/reports.c
  CXX   src/action.c
  CXX   src/apcupsd.c
  CXX   src/apcnis.c
  LD    src/apcupsd
  CXX   src/apcaccess.c
  LD    src/apcaccess
  CXX   src/apctest.c
  LD    src/apctest
  CXX   src/smtp.c
  LD    src/smtp
        platforms
        platforms/etc
        platforms/redhat
        doc
  MAN   apcupsd.8 -> apcupsd.man.txt
  MAN   apcaccess.8 -> apcaccess.man.txt
  MAN   apctest.8 -> apctest.man.txt
  MAN   apccontrol.8 -> apccontrol.man.txt
  MAN   apcupsd.conf.5 -> apcupsd.conf.man.txt


mkdir -p /etc/apcupsd/;vi /etc/apcupsd/apcupsd.conf

UPSCABLE smart

UPSTYPE smartups

DEVICE /dev/ttyS0



 ./apcupsd
./apcupsd: Warning: old configuration file found.

./apcupsd: Expected: "## apcupsd.conf v1.1 ##"
./apcupsd: Found:    "
"

./apcupsd: Please check new file format and
./apcupsd: modify accordingly the first line
./apcupsd: of config file.

./apcupsd: Processing config file anyway.
./apcupsd: Bogus configuration value (*invalid-ups-type*)
apcupsd FATAL ERROR in apcconfig.c at line 672
Terminating due to configuration file errors.
[root@somebox src]# vi /etc/apcupsd/apcupsd.conf
[root@somebox src]# ./apcupsd
./apcupsd: Warning: old configuration file found.

./apcupsd: Expected: "## apcupsd.conf v1.1 ##"
./apcupsd: Found:    "UPSCABLE smart
"

./apcupsd: Please check new file format and
./apcupsd: modify accordingly the first line
./apcupsd: of config file.

./apcupsd: Processing config file anyway.
./apcupsd: Bogus configuration value (*invalid-ups-type*)
apcupsd FATAL ERROR in apcconfig.c at line 672
Terminating due to configuration file errors.


#change to this

UPSCABLE usb

UPSTYPE usb
# For USB UPSes, leave the DEVICE directive blank.
DEVICE




 ./apcupsd
./apcupsd: Warning: old configuration file found.

./apcupsd: Expected: "## apcupsd.conf v1.1 ##"
./apcupsd: Found:    "UPSCABLE smart
"

./apcupsd: Please check new file format and
./apcupsd: modify accordingly the first line
./apcupsd: of config file.

./apcupsd: Processing config file anyway.
./apcupsd: Bogus configuration value (*invalid-ups-type*)
apcupsd FATAL ERROR in apcconfig.c at line 672
Terminating due to configuration file errors.
[root@somebox src]# vi /etc/apcupsd/apcupsd.conf
[root@somebox src]# ./apcupsd
./apcupsd: Warning: old configuration file found.

./apcupsd: Expected: "## apcupsd.conf v1.1 ##"
./apcupsd: Found:    "UPSCABLE usb
"

./apcupsd: Please check new file format and
./apcupsd: modify accordingly the first line
./apcupsd: of config file.

./apcupsd: Processing config file anyway.

Apcupsd driver usb not found.
The available apcupsd drivers are:
dumb
apcsmart
net
snmplite
pcnet
modbus

Most likely, you need to add --enable-usb to your ./configure options.

apcupsd FATAL ERROR in apcupsd.c at line 196
Apcupsd cannot continue without a valid driver.





#recompile

./src/apcupsd: Warning: old configuration file found.

./src/apcupsd: Expected: "## apcupsd.conf v1.1 ##"
./src/apcupsd: Found:    "UPSCABLE usb
"

./src/apcupsd: Please check new file format and
./src/apcupsd: modify accordingly the first line
./src/apcupsd: of config file.

./src/apcupsd: Processing config file anyway.



./src/apcaccess
: Warning: old configuration file found.

: Expected: "## apcupsd.conf v1.1 ##"
: Found:    "UPSCABLE usb
"

: Please check new file format and
: modify accordingly the first line
: of config file.

: Processing config file anyway.
APC      : 001,037,0887
DATE     : 2020-08-22 10:11:18 -0700 
HOSTNAME : somebox.home
VERSION  : 3.14.14 (31 May 2016) redhat
UPSNAME  : somebox.home
CABLE    : USB Cable
DRIVER   : USB UPS Driver
UPSMODE  :
STARTTIME: 2020-08-22 10:11:16 -0700 
SHARE    :
MODEL    : Back-UPS NS 1500M2
STATUS   : ONLINE
LINEV    : 120.0 Volts
LOADPCT  : 4.0 Percent
BCHARGE  : 100.0 Percent
TIMELEFT : 131.9 Minutes
MBATTCHG : 10 Percent
MINTIMEL : 5 Minutes
MAXTIME  : 0 Seconds
SENSE    : Medium
LOTRANS  : 88.0 Volts
HITRANS  : 142.0 Volts
ALARMDEL : No alarm
BATTV    : 27.3 Volts
LASTXFER : Unacceptable line voltage changes
NUMXFERS : 0
TONBATT  : 0 Seconds
CUMONBATT: 0 Seconds
XOFFBATT : N/A
SELFTEST : NO
STATFLAG : 0x05000008
SERIALNO : 3B1938X20056 
BATTDATE : 2019-09-16
NOMINV   : 120 Volts
NOMBATTV : 24.0 Volts
NOMPOWER : 900 Watts
FIRMWARE : 957.e3 .D USB FW:e3
END APC  : 2020-08-22 10:11:51 -0700 
 

If you've come here, don't be embarraassed, working in IT, this is the MOST common computer problem that almost everyone will encounter.  The reason why I'm doing this post is because I've seen an increase from colleagues and admins having this problem and many times it's not even your fault.  A common scenario is that someone acquires a new or used computer which they weren't given the password for.  Fortunately I have a detailed list of all the options whether free or paid to get you back in and save you time and stress!  Especially during COVID-19 or other stressful times, this is bound to happen whether you are a full time worker, student, parent, etc.. it happens to ALL of us at some point.

Whether you're using a laptop, server, VM, Cloud, VPS, workstation, Desktop on Windows 10, Windows 8, Windows 7, Vista, XP etc.. and any version of Windows Server such as 2019, 2016, 2012, 2008, 2003, 2000 or even NT this article still applies to you.  For the majority who are using Windows 2019 server or Windows 10, please read this article before anything else so you don't waste your time on solutions that don't work due to Microsoft patching against them. 

I've used these very same options on thousands of computers before whether at work or for friends.  This is why I'm making this post now because they don't know there are simple and quick options rather than wasting time on Youtube or random blogs and then mess up their system or data.  Then they end up spending more time and money with someone like me to undo their mistake.  Rather than spending hundreds of dollars on someone like me or a computer store, just use the Windows Geeks software that I use to reset your password or I'll charge much more to use the same solution when you call me.  I'd rather have people stay safe than call over someone into their office or home during COVID-19 that they don't have to.  With recession looming and everyone depending more on their computer, this is no time to lose data or get locked out when there are very simple and quick solutions anyone can use.

When it comes to Windows passwords a lot has changed, even though the general way that the SAM and SECURITY files located in c:windowssystem32config has not really changed in terms of functionality.

Important Notes Before Researching Windows Password Solutions

Be careful what sites you go to, some sites have been known to offer free downloads which are actually trojans to get access to your computer.  The more common issue is that there is a lot of bad and outdated advice, especially when it comes to Windows 10 and Windows 2019 Server.  I've tried some sites that had trojans after friends complained and also was shocked to see that many blogs claim they have working solutions that don't work anymore including the methods I address below from my own personal experience.

What has changed is the fact that many oldschool tricks and backdoors such as using the Recovery Mode in Windows 10/2019 has been patched (you cannot break in that way anymore, it will ask for the password of the user).  Also the hack that you use to change the screensaver or magnifier to cmd.exe doesn't work anymore (Windows will detect it and copy this back).

Windows Password Free and Paid Solutions That Work

I recommend this resource because it has a more comprehensive list of what to do.  There are even free solutions that they offer and explain but what I like is that they are honest and straight forward and have proper information and what works and what doesn't even for free solutions (source/credit part of the information about the oldschool hacks being closed comes from them and my own experience).

Possible Solutions free and paid to Reset Windows 10,8,7 Server 2019, 2016, 2012, 2008, 2003, 2000, NT Server Accounts

I often send friends to the above link because it doesn't waste your time.  It talks about what free methods and solutions will work.  In general almost all free solutions involve some advanced or ability to learn advanced computer and administration skills.  If you are not confident I don't recommend trying free solutions as you could type one wrong command that may wipe your your partition or data altogether.  If your data is not backed up, time is not of the essence and the data is not important to you then by all means give the free shots a whirl.

What Are My Options To Get Back Into Windows?

The easiest one is if another person has admin access to the computer you can simply just have them login and reset your password.

My Recommended Paid Solution

This is where I tell even my non-tech savvy friends and family when I am too busy or unable to go and help them.  The reason I like it even as an Admin is that "it is automatic".  Once you boot it, it does it all for you, no commands, it just detects your Windows partition, mounts it, backs up your SAM file (which other software doesn't), just in case and then removes all passwords without typing any command, clicking, or even choosing the users.  Then it lists all users and unlocks all accounts including the Administrator account.  To me this is the true way of "resetting", "unlocking", and "bypassing" Windows passwords including for the Admin account.  The key thing is "unlocking" because some software will "reset" or "remove" the password but won't unlock the account, the chances are that your account is probably locked from too many wrong passwords so "unlocking" is required to actually allow you to login again.

I've also been told by a friend who said he already heard of them and apparently someone at Microsoft recommended them too which I was thought was interesting because you would think they would have their own solution!

Where I've personally used solutions like Windows Geeks on the job on laptops, servers, workstations and even VMs to get the job done because it is all automated (even though I have the ability I don't want to remember steps, commands etc.. or even risk the small chance I mess something up).  For $17 a license or the unlimited for $299 it's not worth my hassle or time.

The other advantage is that there is no "password reset disk" from Microsoft or original install disc required.

Windows Geeks has been around since 2006 and unlike the majority of "OTHER" sites is from Canada and not registered overseas.  In fact many of the largest looking competitors like iSunshare, sPower are actually from China so there's no local support and English is often an issue and in my experience, below, that the other solutions don't support as much hardware as Windows Geek does.  The few times out of thousands of uses that I found an old laptop or server that had an issue, their Windows Geeks devs resolved it quite fast.

This is also because other paid solutions I've tried have not been as successful.  For example some other software won't work on KVM/Virtio because they don't have the drivers.  Most other software won't work on a lot of high end workstations, some newer laptops and a lot of servers because the RAID/SCSI/SAS/SATA controller support is not very good on the majority of software.

And so I admit I recommend the Windows Geeks because their solution is Linux based and supports virtually every machine I've thrown at it.  There was one case recently where an ancient PII computer wouldn't boot their software but they sent a patch (using an old patched Kernel for OLD computers).  And another thing is that a lot of other software is FAR too big to boot on lowend machines or old machines.  If you are an IT professional you will be surprised at how many crappy/old systems you come across that run important or mission critical.

Windows Geeks Windows 10, 8, 7 Password Reset and Unlock Solution

This seems to happen on most if not all Nvidia cards but the good news is that if you are using any of the Linux drivers and have the nvidia-settings tool installed it is just a simple command.

Solution:

nvidia-settings --assign CurrentMetaMode="nvidia-auto-select +0+0 { ForceFullCompositionPipeline = On }"

Enter the above command in your terminal and the screentearing will be fixed which is like enabling Tear Free on AMD cards.  What it does is Force Full Composition Pipeline which means that it won't show any video frames that aren't completely processed, thus eliminating the annoying to the eye screen tearing.

This of course works on all Linux versions whether Debian based Ubuntu, Mint etc.. or even Centos, Fedora, RHEL if using the Nvidia and not Nouveau drivers.

You can make this permanent or automatic by the following:

vi ~/.config/autostart/nvidia-settings.desktop

[Desktop Entry]
Type=Application
Exec=nvidia-settings --assign CurrentMetaMode="nvidia-auto-select +0+0 { ForceFullCompositionPipeline = On }"
Hidden=false
X-MATE-Autostart-enabled=true
Name[en_CA]=nvidia startup realtechtalk.com
Name=nvidia startup realtechtalk.com
Comment[en_CA]=
Comment=
 

This makes the command from our solution above execute each time you login into your Desktop session on Ubuntu/Debian/Gnome based OS's. 

You can also accomplish the same using the GUI like so by going to  Menu -> Preferences -> Startup Applications

Then click on "Add" and create a new entry like this:

You can't see it but just copy the command from above "nvidia-settings --assign CurrentMetaMode="nvidia-auto-select +0+0 { ForceFullCompositionPipeline = On }" into the "Command" field and click "Add"

-??????????  ? ?    ?       ?            ? shadow
----------.  1 root root  748 Jul 10 04:35 shadow-


cat: shadow: Input/output error

If you see this you are probably in big trouble, it could be a physical error or if it's a VM image that it is corrupted due to a physical error on the underlying disk/array/NAS or it could also be that somehow the image was accessed and mounted more than once concurrently.  This is almost always impossible to fix but you can always try to fsck anyway!

fsck /dev/mapper/loop5p1
fsck 1.45.6 (20-Mar-2020)
e2fsck 1.45.6 (20-Mar-2020)
/dev/mapper/loop5p1 contains a file system with errors, check forced.
Pass 1: Checking inodes, blocks, and sizes
Deleted inode 11383 has zero dtime.  Fix<y>? yes
Deleted inode 11387 has zero dtime.  Fix<y>? yes
Deleted inode 11388 has zero dtime.  Fix<y>? yes
Pass 2: Checking directory structure
Entry 'shadow' in /etc (13) has deleted/unused inode 11390.  Clear<y>? yes
Entry 'shadow-202007141594765348' in /etc (13) has deleted/unused inode 11386.  Clear<y>? yes
Entry 'shadow-202007141594770924' in /etc (13) has deleted/unused inode 11386.  Clear<y>? yes
Pass 3: Checking directory connectivity
Pass 4: Checking reference counts
Inode 11328 ref count is 1, should be 3.  Fix<y>? yes
Pass 5: Checking group summary information
Block bitmap differences:  -(45056--47103) -(68608--70172) -(71680--73727) -(77824--77828) -(83968--84460)
Fix<y>? yes
Free blocks count wrong for group #1 (10183, counted=12231).
Fix<y>? yes
Free blocks count wrong for group #2 (11477, counted=15588).
Fix<y>? yes
Free blocks count wrong (675912, counted=682073).
Fix<y>? yes
Inode bitmap differences:  -11340 -11383 -(11387--11388)
Fix<y>? yes
Free inodes count wrong for group #1 (4671, counted=4675).
Fix<y>? yes
Free inodes count wrong (242659, counted=242665).
Fix<y>? yes

/dev/mapper/loop5p1: ***** FILE SYSTEM WAS MODIFIED *****
/dev/mapper/loop5p1: 39015/281680 files (0.2% non-contiguous), 442791/1124864 blocks
 

Is a mdadm check on your trusty software RAID array happening at the worst time and slowing down your server or NAS?

cat /proc/mdstat
Personalities : [raid1] [raid10]
md127 : active raid10 sdb4[0] sda4[1]
      897500672 blocks super 1.2 2 near-copies [2/2] [UU]
      [==========>..........]  check = 50.4% (452485504/897500672) finish=15500.3min speed=478K/sec
      bitmap: 5/7 pages [20KB], 65536KB chunk

Solution

Just tell it to idle"

echo idle >  /sys/devices/virtual/block/md127/md/sync_action
 

After that check again and you'll see it has stopped.

cat /proc/mdstat
Personalities : [raid1] [raid10]
md127 : active raid10 sdb4[0] sda4[1]
      897500672 blocks super 1.2 2 near-copies [2/2] [UU]
      bitmap: 5/7 pages [20KB], 65536KB chunk

 

/usr/libexec/qemu-kvm -enable-kvm -boot order=cd,once=dc -vga cirrus -m 4096 -drive file=~/23815135.img,if=virtio -usbdevice tablet -net nic,macaddr=DE:AD:BE:EF:D4:AB -netdev bridge,br=br0,id=net0
qemu-kvm: -usbdevice tablet: '-usbdevice' is deprecated, please use '-device usb-...' instead
access denied by acl file
qemu-kvm: bridge helper failed
[root@CentOS-82-64-minimal 23815135]# /usr/libexec/qemu-kvm -enable-kvm -boot order=cd,once=dc -vga cirrus -m 4096 -drive file=/root/kvmguests/23815135/23815135.img,if=virtio -usbdevice tablet -net nic,macaddr=DE:AD:BE:EF:D4:AB -netdev bridge,br=br0,id=net0
 

So you're trying to use a bridge are told you are being denied.  Make sure you create a bridge.conf file and allow br0 or whatever your bridge device in that file and it will work after.

Solution:

mkdir -p /etc/qemu
echo "allow br0" >> /etc/qemu/bridge.conf
 

Remember those also requires that you have a bridge called br0, here is a guide for the bridge.

I was using a small box as a router and one of the ports started going off and coming back at 100M.  I truly believe it is simply that it was a case of overheating.  Although CPU temps were only about 67 degrees, the physical box itself was almost burning hot.  I solved the cooling issue and never had the issue again.

Jul 28 15:09:27 swithbox kernel: e1000e: eth1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: Rx/Tx
Jul 28 15:09:28 swithbox kernel: e1000e: eth1 NIC Link is Down
Jul 28 15:09:30 swithbox kernel: e1000e: eth1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: Rx/Tx
Jul 28 15:09:31 swithbox kernel: e1000e: eth1 NIC Link is Down
Jul 28 15:09:33 swithbox kernel: e1000e: eth1 NIC Link is Up 100 Mbps Full Duplex, Flow Control: Rx/Tx
Jul 28 15:09:33 swithbox kernel: e1000e 0000:02:00.0: eth1: 10/100 speed: disabling TSO

I just want to shed light that sometimes we may assume the port is just bad or the cable is bad, sometimes this can happen because of overheating.  It has never happened again since I fixed the cooling where the CPU and physical box reached scorching temperatures that have never been seen.

On that note, it probably signals it is time to apply some new thermal paste onto the bridges and CPU, as it has probably dried out especially if your load is almost non-existent.

You should only get this if you are using a Pentium II or something really old.  The problem here is that newer kernels than 2.6 don't have true i386 support even if you tell it to compile as i386.  It will still include features like cmov that break older computers from being able to work.

Generally for very old computers like above, you need to use a 2.6.x kernel and of course make sure it is i386 and all the binaries are as well.

http://vault.centos.org/5.9/os/i386/repodata/filelists.xml.gz: [Errno -1] Metadata file does not match checksum


yum clean all
yum makecache
yum update

This is very frustrating but the fix is usually easy once you read this blog. It's very frustrating when you find that your Linux / Ubuntu laptop's wifi will NEVER work unless it is plugged into the power.  The wifi menu may say "Wifi disabled by hardware switch".  You may find that your laptop has no switch or has a function wifi button on the keyboard but this does not work or have any effect.

The cause is usual a "wmi" kernel module and simply doing an rmmod / unloading this module will instantly allow your wifi to work.

Go to your terminal and type:

lsmod|grep wmi

If you see something like "acer_wmi"

type:

sudo rmmod acer_wmi

To make the fix permanent type this:

sudo vi /etc/modprobe.d/blacklist

#add a new line

blacklist acer_wmi

Of course be sure to replace acer_wmi with whatever your wmi is

Now you can finally enjoy true wireless wifi without having your laptop plugged into the AC power socket.

yum -y install gcc make gperf genisoimage flex bison ncurses ncurses-devel pcre-devel augeas-devel augeas readline-devel
 
checking for cpio... cpio
checking for gperf... no
configure: error: gperf must be installed

configure: error: Package requirements (augeas >= 1.2.0) were not met:

Requested 'augeas >= 1.2.0' but version of augeas is 1.0.0

yum remove augeas augeas-libs augeas-devel
wget http://download.augeas.net/augeas-1.2.0.tar.gz
tar -zxvf augeas-1.2.0.tar.gz
cd augeas-1.2.0
yum -y install readline-devel
./configure
make
make install


configure: error: Package requirements (augeas >= 1.2.0) were not met:

No package 'augeas' found

Consider adjusting the PKG_CONFIG_PATH environment variable if you
installed software in a non-standard prefix.

Alternatively, you may set the environment variables AUGEAS_CFLAGS
and AUGEAS_LIBS to avoid the need to call pkg-conf

#fix
#recompile augeas like this:
./configure --prefix=/usr
make;make install

export PKG_CONFIG_PATH=/usr/local/bin/


#
find /usr|grep aug|grep -v share
/usr/bin/augparse
/usr/bin/augtool
/usr/local/bin/augparse
/usr/local/bin/augtool
/usr/local/lib/libaugeas.la
/usr/local/lib/pkgconfig/augeas.pc
/usr/local/lib/libaugeas.so.0.18.0
/usr/local/lib/libaugeas.so.0
/usr/local/lib/libaugeas.a
/usr/local/lib/libaugeas.so
/usr/local/include/augeas.h
/usr/lib/libaugeas.la
/usr/lib/pkgconfig/augeas.pc
/usr/lib/libaugeas.so.0.18.0
/usr/lib/libaugeas.so.0
/usr/lib/libaugeas.a
/usr/lib/libaugeas.so
/usr/include/augeas.h

export PKG_CONFIG_PATH=/usr/lib/pkgconfig/


configure: error: libmagic (part of the "file" command) is required.
                   Please install the file devel package

yum install file-devel

yum install jansson-devel hivex-devel.x86_64


checking for supermin... no
checking for --with-supermin-packager-config option... not set
checking for --with-supermin-extra-options option... not set
configure: error: supermin >= 5.1 must be installed


#yum -y install febootstrap-*

yum -y install ocaml ocaml-findlib

http://download.libguestfs.org/supermin/5.2-stable/supermin-5.2.0.tar.gz
tar -zxvf supermin-5.2.0.tar.gz
cd supermin-5.2.0
./configure
make

ocamlfind ocamlopt -warn-error CDEFLMPSUVXYZ-3  -package unix,str -c format_ext2_initrd.ml -o format_ext2_initrd.cmx
ocamlfind ocamlopt -warn-error CDEFLMPSUVXYZ-3  -package unix,str -c format_ext2_kernel.ml -o format_ext2_kernel.cmx
File "format_ext2_kernel.ml", line 293, characters 12-24:
Error: Unbound value Bytes.create
make[3]: *** [format_ext2_kernel.cmx] Error 2
make[3]: Leaving directory `/root/supermin-5.2.0/src'
make[2]: *** [all] Error 2
make[2]: Leaving directory `/root/supermin-5.2.0/src'
make[1]: *** [all-recursive] Error 1
make[1]: Leaving directory `/root/supermin-5.2.0'
make: *** [all] Error 2


checking for EXT2FS... no
configure: error: Package requirements (ext2fs) were not met:

No package 'ext2fs' found

Consider adjusting the PKG_CONFIG_PATH environment variable if you
installed software in a non-standard prefix.

Alternatively, you may set the environment variables EXT2FS_CFLAGS
and EXT2FS_LIBS to avoid the need to call pkg-config.
See the pkg-config man page for more details.


yum -y install e2fsprogs-devel

make
/usr/bin/ld: cannot find -lc
collect2: ld returned 1 exit status
make[2]: *** [init] Error 1
make[2]: Leaving directory `/root/supermin-5.2.0/init'
make[1]: *** [all-recursive] Error 1
make[1]: Leaving directory `/root/supermin-5.2.0'
make: *** [all] Error 2


yum install glibc-static

ocamlfind ocamlopt -warn-error CDEFLMPSUVXYZ-3  -package unix,str -c format_ext2_kernel.ml -o format_ext2_kernel.cmx
File "format_ext2_kernel.ml", line 293, characters 12-24:
Error: Unbound value Bytes.create
make[3]: *** [format_ext2_kernel.cmx] Error 2
make[3]: Leaving directory `/root/supermin-5.2.0/src'
make[2]: *** [all] Error 2
make[2]: Leaving directory `/root/supermin-5.2.0/src'
make[1]: *** [all-recursive] Error 1
make[1]: Leaving directory `/root/supermin-5.2.0'
make: *** [all] Error 2


 

chroot /root/kvmguests/4591915/mount
FATAL: kernel too old

This happens for example if you are in Centos 6 and trying to chroot into a system based on a newer kernel like 4.x+

You'll have to use a newer OS/kernel system to chroot into the environment or a VM running a newer kernel.

apt install software-properties-common
add-apt-repository ppa:deadsnakes/ppa
apt update
apt install python3-pip
apt install python3.7 curl gnupg python3.7-dev git
ln -s /usr/bin/python3.7 /usr/bin/python3
pip3 install numpy keras_preprocessing
curl https://bazel.build/bazel-release.pub.gpg | sudo apt-key add -
echo "deb [arch=amd64] http://storage.googleapis.com/bazel-apt stable jdk1.8" | sudo tee /etc/apt/sources.list.d/bazel.list
apt update
apt install bazel-3.1.0
wget https://github.com/tensorflow/tensorflow/archive/master.zip
unzip master.zip
cd tensorflow-master

#be warned it takes forever and a lot of HDD space to compile tensorflow!
bazel build //tensorflow/tools/pip_package:build_pip_package
pip3 install --upgrade pip
pip3 install gpt-2-simple

/usr/env/python: 'python': No such file or directory
ln -s /usr/bin/python3.7 /usr/bin/python

Here is a lot of the hacking and slashing that I did to get it going to make the above:

root@gpt2:/# sudo add-apt-repository ppa:deadsnakes/ppa
sudo: add-apt-repository: command not found
root@gpt2:/# ^Cadd-apt-repository ppa:deadsnakes/ppa
root@gpt2:/# apt-cache search apt-add-repository
root@gpt2:/# ^Ct-cache search apt-add-repository
root@gpt2:/# ^C
root@gpt2:/# apta install^C
root@gpt2:/# apt install software-properties-common
Reading package lists... Done
Building dependency tree... Done
E: Unable to locate package software-properties-common
root@gpt2:/# apt update
Get:1 http://archive.canonical.com/ubuntu xenial InRelease [11.5 kB]
Get:2 http://archive.canonical.com/ubuntu xenial/partner amd64 Packages [3120 B]                                                         
Get:3 http://archive.ubuntu.com/ubuntu xenial InRelease [247 kB]             
Get:4 http://security.ubuntu.com/ubuntu xenial-security InRelease [109 kB]
Get:5 http://archive.canonical.com/ubuntu xenial/partner Translation-en [1672 B]                               
Get:6 http://security.ubuntu.com/ubuntu xenial-security/main amd64 Packages [894 kB]                    
Get:7 http://archive.ubuntu.com/ubuntu xenial-updates InRelease [109 kB]       
Get:8 http://archive.ubuntu.com/ubuntu xenial/main amd64 Packages [1201 kB]              
Get:9 http://security.ubuntu.com/ubuntu xenial-security/main Translation-en [333 kB]     
Get:10 http://archive.ubuntu.com/ubuntu xenial/main Translation-en [568 kB]                    
Get:11 http://security.ubuntu.com/ubuntu xenial-security/restricted amd64 Packages [7204 B]        
Get:12 http://security.ubuntu.com/ubuntu xenial-security/restricted Translation-en [2152 B]    
Get:13 http://security.ubuntu.com/ubuntu xenial-security/universe amd64 Packages [495 kB]           
Get:14 http://archive.ubuntu.com/ubuntu xenial/restricted amd64 Packages [8344 B]             
Get:15 http://archive.ubuntu.com/ubuntu xenial/restricted Translation-en [2908 B]        
Get:16 http://archive.ubuntu.com/ubuntu xenial/universe amd64 Packages [7532 kB]               
Get:17 http://security.ubuntu.com/ubuntu xenial-security/universe Translation-en [203 kB]
Get:18 http://security.ubuntu.com/ubuntu xenial-security/multiverse amd64 Packages [6088 B]     
Get:19 http://security.ubuntu.com/ubuntu xenial-security/multiverse Translation-en [2888 B]
Get:20 http://archive.ubuntu.com/ubuntu xenial/universe Translation-en [4354 kB]                  
Get:21 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 Packages [1170 kB]
Get:22 http://archive.ubuntu.com/ubuntu xenial-updates/main Translation-en [440 kB]
Get:23 http://archive.ubuntu.com/ubuntu xenial-updates/restricted amd64 Packages [7576 B]
Get:24 http://archive.ubuntu.com/ubuntu xenial-updates/restricted Translation-en [2272 B]
Get:25 http://archive.ubuntu.com/ubuntu xenial-updates/universe amd64 Packages [799 kB]
Get:26 http://archive.ubuntu.com/ubuntu xenial-updates/universe Translation-en [335 kB]
Fetched 18.8 MB in 6s (2766 kB/s)                                                                                                                                   
Reading package lists... Done
Building dependency tree... Done
205 packages can be upgraded. Run 'apt list --upgradable' to see them.
root@gpt2:/# apt install software-properties-common
Reading package lists... Done
Building dependency tree... Done
The following additional packages will be installed:
  apt apt-utils gir1.2-glib-2.0 iso-codes libapt-inst2.0 libapt-pkg5.0 libcurl3-gnutls libdbus-glib-1-2 libgirepository-1.0-1 librtmp1 powermgmt-base
  python-apt-common python3-apt python3-dbus python3-gi python3-pycurl python3-software-properties unattended-upgrades
Suggested packages:
  aptitude | synaptic | wajig dpkg-dev apt-doc python-apt isoquery python3-apt-dbg python-apt-doc python-dbus-doc python3-dbus-dbg libcurl4-gnutls-dev
  python-pycurl-doc python3-pycurl-dbg needrestart
The following NEW packages will be installed:
  gir1.2-glib-2.0 iso-codes libcurl3-gnutls libdbus-glib-1-2 libgirepository-1.0-1 librtmp1 powermgmt-base python-apt-common python3-apt python3-dbus python3-gi
  python3-pycurl python3-software-properties software-properties-common unattended-upgrades
The following packages will be upgraded:
  apt apt-utils libapt-inst2.0 libapt-pkg5.0
4 upgraded, 15 newly installed, 0 to remove and 201 not upgraded.
Need to get 5358 kB of archives.
After this operation, 21.3 MB of additional disk space will be used.
Do you want to continue? [Y/n] y
Get:1 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libapt-pkg5.0 amd64 1.2.32ubuntu0.1 [713 kB]
Get:2 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libapt-inst2.0 amd64 1.2.32ubuntu0.1 [54.5 kB]
Get:3 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 apt amd64 1.2.32ubuntu0.1 [1087 kB]
Get:4 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 apt-utils amd64 1.2.32ubuntu0.1 [197 kB]
Get:5 http://archive.ubuntu.com/ubuntu xenial/main amd64 libgirepository-1.0-1 amd64 1.46.0-3ubuntu1 [88.3 kB]
Get:6 http://archive.ubuntu.com/ubuntu xenial/main amd64 gir1.2-glib-2.0 amd64 1.46.0-3ubuntu1 [127 kB]
Get:7 http://archive.ubuntu.com/ubuntu xenial/main amd64 iso-codes all 3.65-1 [2268 kB]
Get:8 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 librtmp1 amd64 2.4+20151223.gitfa8646d-1ubuntu0.1 [54.4 kB]
Get:9 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libcurl3-gnutls amd64 7.47.0-1ubuntu2.15 [184 kB]
Get:10 http://archive.ubuntu.com/ubuntu xenial/main amd64 libdbus-glib-1-2 amd64 0.106-1 [67.1 kB]
Get:11 http://archive.ubuntu.com/ubuntu xenial/main amd64 powermgmt-base all 1.31+nmu1 [7178 B]
Get:12 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 python-apt-common all 1.1.0~beta1ubuntu0.16.04.9 [16.8 kB]
Get:13 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 python3-apt amd64 1.1.0~beta1ubuntu0.16.04.9 [145 kB]
Get:14 http://archive.ubuntu.com/ubuntu xenial/main amd64 python3-dbus amd64 1.2.0-3 [83.1 kB]
Get:15 http://archive.ubuntu.com/ubuntu xenial/main amd64 python3-gi amd64 3.20.0-0ubuntu1 [153 kB]
Get:16 http://archive.ubuntu.com/ubuntu xenial/main amd64 python3-pycurl amd64 7.43.0-1ubuntu1 [42.3 kB]
Get:17 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 python3-software-properties all 0.96.20.9 [20.1 kB]
Get:18 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 software-properties-common all 0.96.20.9 [9452 B]
Get:19 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 unattended-upgrades all 1.1ubuntu1.18.04.7~16.04.6 [42.1 kB]
Fetched 5358 kB in 1s (3726 kB/s)            
Preconfiguring packages ...
(Reading database ... 26041 files and directories currently installed.)
Preparing to unpack .../libapt-pkg5.0_1.2.32ubuntu0.1_amd64.deb ...
Unpacking libapt-pkg5.0:amd64 (1.2.32ubuntu0.1) over (1.2.15) ...
Processing triggers for libc-bin (2.23-0ubuntu4) ...
Setting up libapt-pkg5.0:amd64 (1.2.32ubuntu0.1) ...
Processing triggers for libc-bin (2.23-0ubuntu4) ...
(Reading database ... 26041 files and directories currently installed.)
Preparing to unpack .../libapt-inst2.0_1.2.32ubuntu0.1_amd64.deb ...
Unpacking libapt-inst2.0:amd64 (1.2.32ubuntu0.1) over (1.2.15) ...
Preparing to unpack .../apt_1.2.32ubuntu0.1_amd64.deb ...
Unpacking apt (1.2.32ubuntu0.1) over (1.2.15) ...
Processing triggers for libc-bin (2.23-0ubuntu4) ...
Processing triggers for man-db (2.7.5-1) ...
Setting up apt (1.2.32ubuntu0.1) ...
Installing new version of config file /etc/apt/apt.conf.d/01autoremove ...
apt-daily.timer is a disabled or a static unit, not starting it.
Processing triggers for libc-bin (2.23-0ubuntu4) ...
(Reading database ... 26052 files and directories currently installed.)
Preparing to unpack .../apt-utils_1.2.32ubuntu0.1_amd64.deb ...
Unpacking apt-utils (1.2.32ubuntu0.1) over (1.2.15) ...
Selecting previously unselected package libgirepository-1.0-1:amd64.
Preparing to unpack .../libgirepository-1.0-1_1.46.0-3ubuntu1_amd64.deb ...
Unpacking libgirepository-1.0-1:amd64 (1.46.0-3ubuntu1) ...
Selecting previously unselected package gir1.2-glib-2.0:amd64.
Preparing to unpack .../gir1.2-glib-2.0_1.46.0-3ubuntu1_amd64.deb ...
Unpacking gir1.2-glib-2.0:amd64 (1.46.0-3ubuntu1) ...
Selecting previously unselected package iso-codes.
Preparing to unpack .../iso-codes_3.65-1_all.deb ...
Unpacking iso-codes (3.65-1) ...
Selecting previously unselected package librtmp1:amd64.
Preparing to unpack .../librtmp1_2.4+20151223.gitfa8646d-1ubuntu0.1_amd64.deb ...
Unpacking librtmp1:amd64 (2.4+20151223.gitfa8646d-1ubuntu0.1) ...
Selecting previously unselected package libcurl3-gnutls:amd64.
Preparing to unpack .../libcurl3-gnutls_7.47.0-1ubuntu2.15_amd64.deb ...
Unpacking libcurl3-gnutls:amd64 (7.47.0-1ubuntu2.15) ...
Selecting previously unselected package libdbus-glib-1-2:amd64.
Preparing to unpack .../libdbus-glib-1-2_0.106-1_amd64.deb ...
Unpacking libdbus-glib-1-2:amd64 (0.106-1) ...
Selecting previously unselected package powermgmt-base.
Preparing to unpack .../powermgmt-base_1.31+nmu1_all.deb ...
Unpacking powermgmt-base (1.31+nmu1) ...
Selecting previously unselected package python-apt-common.
Preparing to unpack .../python-apt-common_1.1.0~beta1ubuntu0.16.04.9_all.deb ...
Unpacking python-apt-common (1.1.0~beta1ubuntu0.16.04.9) ...
Selecting previously unselected package python3-apt.
Preparing to unpack .../python3-apt_1.1.0~beta1ubuntu0.16.04.9_amd64.deb ...
Unpacking python3-apt (1.1.0~beta1ubuntu0.16.04.9) ...
Selecting previously unselected package python3-dbus.
Preparing to unpack .../python3-dbus_1.2.0-3_amd64.deb ...
Unpacking python3-dbus (1.2.0-3) ...
Selecting previously unselected package python3-gi.
Preparing to unpack .../python3-gi_3.20.0-0ubuntu1_amd64.deb ...
Unpacking python3-gi (3.20.0-0ubuntu1) ...
Selecting previously unselected package python3-pycurl.
Preparing to unpack .../python3-pycurl_7.43.0-1ubuntu1_amd64.deb ...
Unpacking python3-pycurl (7.43.0-1ubuntu1) ...
Selecting previously unselected package python3-software-properties.
Preparing to unpack .../python3-software-properties_0.96.20.9_all.deb ...
Unpacking python3-software-properties (0.96.20.9) ...
Selecting previously unselected package software-properties-common.
Preparing to unpack .../software-properties-common_0.96.20.9_all.deb ...
Unpacking software-properties-common (0.96.20.9) ...
Selecting previously unselected package unattended-upgrades.
Preparing to unpack .../unattended-upgrades_1.1ubuntu1.18.04.7~16.04.6_all.deb ...
Unpacking unattended-upgrades (1.1ubuntu1.18.04.7~16.04.6) ...
Processing triggers for man-db (2.7.5-1) ...
Processing triggers for libc-bin (2.23-0ubuntu4) ...
Processing triggers for systemd (229-4ubuntu12) ...
Setting up libapt-inst2.0:amd64 (1.2.32ubuntu0.1) ...
Setting up apt-utils (1.2.32ubuntu0.1) ...
Setting up libgirepository-1.0-1:amd64 (1.46.0-3ubuntu1) ...
Setting up gir1.2-glib-2.0:amd64 (1.46.0-3ubuntu1) ...
Setting up iso-codes (3.65-1) ...
Setting up librtmp1:amd64 (2.4+20151223.gitfa8646d-1ubuntu0.1) ...
Setting up libcurl3-gnutls:amd64 (7.47.0-1ubuntu2.15) ...
Setting up libdbus-glib-1-2:amd64 (0.106-1) ...
Setting up powermgmt-base (1.31+nmu1) ...
Setting up python-apt-common (1.1.0~beta1ubuntu0.16.04.9) ...
Setting up python3-apt (1.1.0~beta1ubuntu0.16.04.9) ...
Setting up python3-dbus (1.2.0-3) ...
Setting up python3-gi (3.20.0-0ubuntu1) ...
Setting up python3-pycurl (7.43.0-1ubuntu1) ...
Setting up python3-software-properties (0.96.20.9) ...
Setting up software-properties-common (0.96.20.9) ...
Setting up unattended-upgrades (1.1ubuntu1.18.04.7~16.04.6) ...

Creating config file /etc/apt/apt.conf.d/20auto-upgrades with new version

Creating config file /etc/apt/apt.conf.d/50unattended-upgrades with new version
Synchronizing state of unattended-upgrades.service with SysV init with /lib/systemd/systemd-sysv-install...
Executing /lib/systemd/systemd-sysv-install enable unattended-upgrades
Processing triggers for libc-bin (2.23-0ubuntu4) ...
Processing triggers for systemd (229-4ubuntu12) ...
root@gpt2:/# add-apt-repository ppa:deadsnakes/ppa
 This PPA contains more recent Python versions packaged for Ubuntu.

Disclaimer: there's no guarantee of timely updates in case of security problems or other issues. If you want to use them in a security-or-otherwise-critical environment (say, on a production server), you do so at your own risk.

Update Note
===========
Please use this repository instead of ppa:fkrull/deadsnakes.

Reporting Issues
================

Issues can be reported in the master issue tracker at:
https://github.com/deadsnakes/issues/issues

Supported Ubuntu and Python Versions
====================================

- Ubuntu 16.04 (xenial) Python 2.3 - Python 2.6, Python 3.1 - Python3.4, Python 3.6 - Python3.9
- Ubuntu 18.04 (bionic) Python2.3 - Python 2.6, Python 3.1 - Python 3.5, Python3.7 - Python3.9
- Ubuntu 20.04 (focal) Python3.5 - Python3.7, Python3.9
- Note: Python2.7 (all), Python 3.5 (xenial), Python 3.6 (bionic), Python 3.8 (focal) are not provided by deadsnakes as upstream ubuntu provides those packages.
- Note: for focal, older python versions require libssl1.0.x so they are not currently built

The packages may also work on other versions of Ubuntu or Debian, but that is not tested or supported.

Packages
========

The packages provided here are loosely based on the debian upstream packages with some modifications to make them more usable as non-default pythons and on ubuntu.  As such, the packages follow debian's patterns and often do not include a full python distribution with just `apt install python#.#`.  Here is a list of packages that may be useful along with the default install:

- `python#.#-dev`: includes development headers for building C extensions
- `python#.#-venv`: provides the standard library `venv` module
- `python#.#-distutils`: provides the standard library `distutils` module
- `python#.#-lib2to3`: provides the `2to3-#.#` utility as well as the standard library `lib2to3` module
- `python#.#-gdbm`: provides the standard library `dbm.gnu` module
- `python#.#-tk`: provides the standard library `tkinter` module

Third-Party Python Modules
==========================

Python modules in the official Ubuntu repositories are packaged to work with the Python interpreters from the official repositories. Accordingly, they generally won't work with the Python interpreters from this PPA. As an exception, pure-Python modules for Python 3 will work, but any compiled extension modules won't.

To install 3rd-party Python modules, you should use the common Python packaging tools.  For an introduction into the Python packaging ecosystem and its tools, refer to the Python Packaging User Guide:
https://packaging.python.org/installing/

Sources
=======
The package sources are available at:
https://github.com/deadsnakes/

Nightly Builds
==============

For nightly builds, see ppa:deadsnakes/nightly https://launchpad.net/~deadsnakes/+archive/ubuntu/nightly
 More info: https://launchpad.net/~deadsnakes/+archive/ubuntu/ppa
Press [ENTER] to continue or ctrl-c to cancel adding it

gpg: keyring `/tmp/tmp9xripwnf/secring.gpg' created
gpg: keyring `/tmp/tmp9xripwnf/pubring.gpg' created
gpg: requesting key 6A755776 from hkp server keyserver.ubuntu.com
gpg: /tmp/tmp9xripwnf/trustdb.gpg: trustdb created
gpg: key 6A755776: public key "Launchpad PPA for deadsnakes" imported
gpg: Total number processed: 1
gpg:               imported: 1  (RSA: 1)
OK
root@gpt2:/# sudo apt update
Hit:1 http://archive.canonical.com/ubuntu xenial InRelease
0% [1 InRelease gpgv 11.5 kB] [Connecting to archive.ubuntu.com (91.189.88.152)] [Connecting to security.ubuntu.com (91.189.88.142)] [Connecting to ppa.launchpad.net
Hit:2 http://security.ubuntu.com/ubuntu xenial-security InRelease                                                                                                   
Hit:3 http://archive.ubuntu.com/ubuntu xenial InRelease                
Get:4 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu xenial InRelease [18.0 kB]
Hit:5 http://archive.ubuntu.com/ubuntu xenial-updates InRelease                   
Get:6 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu xenial/main amd64 Packages [31.3 kB]
Get:7 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu xenial/main Translation-en [7088 B]
Fetched 56.4 kB in 1s (49.8 kB/s)                  
Reading package lists... Done
Building dependency tree      
Reading state information... Done
201 packages can be upgraded. Run 'apt list --upgradable' to see them.
root@gpt2:/# sudo apt install python3.7
Reading package lists... Done
Building dependency tree      
Reading state information... Done
The following additional packages will be installed:
  libpython3.7-minimal libpython3.7-stdlib python3.7-distutils python3.7-lib2to3 python3.7-minimal
Suggested packages:
  python3.7-venv python3.7-doc binfmt-support
The following NEW packages will be installed:
  libpython3.7-minimal libpython3.7-stdlib python3.7 python3.7-distutils python3.7-lib2to3 python3.7-minimal
0 upgraded, 6 newly installed, 0 to remove and 201 not upgraded.
Need to get 4856 kB of archives.
After this operation, 24.3 MB of additional disk space will be used.
Do you want to continue? [Y/n]



apt install python3-pip
ln --force -s /usr/bin/python3.7 /usr/bin/python3


pip3 install gpt-2-simple
Collecting gpt-2-simple
  Using cached https://files.pythonhosted.org/packages/6f/e4/a90add0c3328eed38a46c3ed137f2363b5d6a07bf13ee5d5d4d1e480b8c3/gpt_2_simple-0.7.1.tar.gz
Collecting regex (from gpt-2-simple)
  Downloading https://files.pythonhosted.org/packages/b6/0b/571619431d3ab416b9ffeca1fdf6cc1b388581b087250fb56e7227d16088/regex-2020.7.14-cp37-cp37m-manylinux1_x86_64.whl (660kB)
    100% |████████████████████████████████| 665kB 1.1MB/s
Collecting requests (from gpt-2-simple)
  Using cached https://files.pythonhosted.org/packages/45/1e/0c169c6a5381e241ba7404532c16a21d86ab872c9bed8bdcd4c423954103/requests-2.24.0-py2.py3-none-any.whl
Collecting tqdm (from gpt-2-simple)
  Using cached https://files.pythonhosted.org/packages/af/88/7b0ea5fa8192d1733dea459a9e3059afc87819cb4072c43263f2ec7ab768/tqdm-4.48.0-py2.py3-none-any.whl
Collecting numpy (from gpt-2-simple)
  Downloading https://files.pythonhosted.org/packages/b4/93/76311932b0c7efd3111f6604609f36d568b912e16bebd86d99f0612d3930/numpy-1.19.0-cp37-cp37m-manylinux1_x86_64.whl (13.5MB)
    100% |████████████████████████████████| 13.5MB 65kB/s
Collecting toposort (from gpt-2-simple)
  Downloading https://files.pythonhosted.org/packages/e9/8a/321cd8ea5f4a22a06e3ba30ef31ec33bea11a3443eeb1d89807640ee6ed4/toposort-1.5-py2.py3-none-any.whl
Collecting chardet<4,>=3.0.2 (from requests->gpt-2-simple)
  Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB)
    100% |████████████████████████████████| 143kB 4.6MB/s
Collecting idna<3,>=2.5 (from requests->gpt-2-simple)
  Downloading https://files.pythonhosted.org/packages/a2/38/928ddce2273eaa564f6f50de919327bf3a00f091b5baba8dfa9460f3a8a8/idna-2.10-py2.py3-none-any.whl (58kB)
    100% |████████████████████████████████| 61kB 5.5MB/s
Collecting certifi>=2017.4.17 (from requests->gpt-2-simple)
  Downloading https://files.pythonhosted.org/packages/5e/c4/6c4fe722df5343c33226f0b4e0bb042e4dc13483228b4718baf286f86d87/certifi-2020.6.20-py2.py3-none-any.whl (156kB)
    100% |████████████████████████████████| 163kB 4.1MB/s
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 (from requests->gpt-2-simple)
  Downloading https://files.pythonhosted.org/packages/e1/e5/df302e8017440f111c11cc41a6b432838672f5a70aa29227bf58149dc72f/urllib3-1.25.9-py2.py3-none-any.whl (126kB)
    100% |████████████████████████████████| 133kB 4.7MB/s
Building wheels for collected packages: gpt-2-simple
  Running setup.py bdist_wheel for gpt-2-simple ... done
  Stored in directory: /root/.cache/pip/wheels/0c/f8/23/b53ce437504597edff76bf9c3b8de08ad716f74f6c6baaa91a
Successfully built gpt-2-simple
Installing collected packages: regex, chardet, idna, certifi, urllib3, requests, tqdm, numpy, toposort, gpt-2-simple
Successfully installed certifi-2020.6.20 chardet-3.0.4 gpt-2-simple-0.7.1 idna-2.10 numpy-1.19.0 regex-2020.7.14 requests-2.24.0 toposort-1.5 tqdm-4.48.0 urllib3-1.25.9



import gpt_2_simple as gpt2
from datetime import datetime
from google.colab import files

sess=gpt2.start_tf_sess()
gpt2.finetune(sess,
dataset=file_name,
model_name='124M',
steps=1000,
restore_from='fresh',
run_name='run1',
print_every=10,
sample_every=200,
save_every=500
)

vi gpt2.py
root@gpt2:~# pyhon3 gpt2.py
-bash: pyhon3: command not found
root@gpt2:~# python3 gpt2.py
Traceback (most recent call last):
  File "gpt2.py", line 1, in <module>
    import gpt_2_simple as gpt2
  File "/usr/local/lib/python3.7/dist-packages/gpt_2_simple/__init__.py", line 1, in <module>
    from .gpt_2 import *
  File "/usr/local/lib/python3.7/dist-packages/gpt_2_simple/gpt_2.py", line 10, in <module>
    import tensorflow as tf
ModuleNotFoundError: No module named 'tensorflow'

pip3 install tensorflow

pip3 install tensorflow
Collecting tensorflow
  Downloading https://files.pythonhosted.org/packages/f4/28/96efba1a516cdacc2e2d6d081f699c001d414cc8ca3250e6d59ae657eb2b/tensorflow-1.14.0-cp37-cp37m-manylinux1_x86_64.whl (109.3MB)
    100% |████████████████████████████████| 109.3MB 7.9kB/s
Collecting wrapt>=1.11.1 (from tensorflow)
  Downloading https://files.pythonhosted.org/packages/82/f7/e43cefbe88c5fd371f4cf0cf5eb3feccd07515af9fd6cf7dbf1d1793a797/wrapt-1.12.1.tar.gz
Requirement already satisfied (use --upgrade to upgrade): wheel>=0.26 in /usr/lib/python3/dist-packages (from tensorflow)
Collecting keras-applications>=1.0.6 (from tensorflow)
  Downloading https://files.pythonhosted.org/packages/71/e3/19762fdfc62877ae9102edf6342d71b28fbfd9dea3d2f96a882ce099b03f/Keras_Applications-1.0.8-py3-none-any.whl (50kB)
    100% |████████████████████████████████| 51kB 4.5MB/s
Collecting gast>=0.2.0 (from tensorflow)
  Downloading https://files.pythonhosted.org/packages/d6/84/759f5dd23fec8ba71952d97bcc7e2c9d7d63bdc582421f3cd4be845f0c98/gast-0.3.3-py2.py3-none-any.whl
Collecting termcolor>=1.1.0 (from tensorflow)
  Downloading https://files.pythonhosted.org/packages/8a/48/a76be51647d0eb9f10e2a4511bf3ffb8cc1e6b14e9e4fab46173aa79f981/termcolor-1.1.0.tar.gz
Collecting six>=1.10.0 (from tensorflow)
  Downloading https://files.pythonhosted.org/packages/ee/ff/48bde5c0f013094d729fe4b0316ba2a24774b3ff1c52d924a8a4cb04078a/six-1.15.0-py2.py3-none-any.whl
Collecting protobuf>=3.6.1 (from tensorflow)
  Downloading https://files.pythonhosted.org/packages/07/63/2c505711827446bfdb544e7bcc0d7694b115d22d56175902a2581fe1172a/protobuf-3.12.2-cp37-cp37m-manylinux1_x86_64.whl (1.3MB)
    100% |████████████████████████████████| 1.3MB 373kB/s
Collecting absl-py>=0.7.0 (from tensorflow)
  Downloading https://files.pythonhosted.org/packages/1a/53/9243c600e047bd4c3df9e69cfabc1e8004a82cac2e0c484580a78a94ba2a/absl-py-0.9.0.tar.gz (104kB)
    100% |████████████████████████████████| 112kB 3.4MB/s
Collecting astor>=0.6.0 (from tensorflow)
  Downloading https://files.pythonhosted.org/packages/c3/88/97eef84f48fa04fbd6750e62dcceafba6c63c81b7ac1420856c8dcc0a3f9/astor-0.8.1-py2.py3-none-any.whl
Collecting tensorflow-estimator<1.15.0rc0,>=1.14.0rc0 (from tensorflow)
  Downloading https://files.pythonhosted.org/packages/3c/d5/21860a5b11caf0678fbc8319341b0ae21a07156911132e0e71bffed0510d/tensorflow_estimator-1.14.0-py2.py3-none-any.whl (488kB)
    100% |████████████████████████████████| 491kB 1.7MB/s
Collecting tensorboard<1.15.0,>=1.14.0 (from tensorflow)
  Downloading https://files.pythonhosted.org/packages/91/2d/2ed263449a078cd9c8a9ba50ebd50123adf1f8cfbea1492f9084169b89d9/tensorboard-1.14.0-py3-none-any.whl (3.1MB)
    100% |████████████████████████████████| 3.2MB 268kB/s
Collecting keras-preprocessing>=1.0.5 (from tensorflow)
  Downloading https://files.pythonhosted.org/packages/79/4c/7c3275a01e12ef9368a892926ab932b33bb13d55794881e3573482b378a7/Keras_Preprocessing-1.1.2-py2.py3-none-any.whl (42kB)
    100% |████████████████████████████████| 51kB 6.5MB/s
Collecting google-pasta>=0.1.6 (from tensorflow)
  Downloading https://files.pythonhosted.org/packages/a3/de/c648ef6835192e6e2cc03f40b19eeda4382c49b5bafb43d88b931c4c74ac/google_pasta-0.2.0-py3-none-any.whl (57kB)
    100% |████████████████████████████████| 61kB 5.7MB/s
Requirement already satisfied (use --upgrade to upgrade): numpy<2.0,>=1.14.5 in /usr/local/lib/python3.7/dist-packages (from tensorflow)
Collecting grpcio>=1.8.6 (from tensorflow)
  Downloading https://files.pythonhosted.org/packages/5e/29/1bd649737e427a6bb850174293b4f2b72ab80dd49462142db9b81e1e5c7b/grpcio-1.30.0.tar.gz (19.7MB)
    100% |████████████████████████████████| 19.7MB 43kB/s
Collecting h5py (from keras-applications>=1.0.6->tensorflow)
  Downloading https://files.pythonhosted.org/packages/3f/c0/abde58b837e066bca19a3f7332d9d0493521d7dd6b48248451a9e3fe2214/h5py-2.10.0-cp37-cp37m-manylinux1_x86_64.whl (2.9MB)
    100% |████████████████████████████████| 2.9MB 304kB/s
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python3/dist-packages (from protobuf>=3.6.1->tensorflow)
Collecting werkzeug>=0.11.15 (from tensorboard<1.15.0,>=1.14.0->tensorflow)
  Downloading https://files.pythonhosted.org/packages/cc/94/5f7079a0e00bd6863ef8f1da638721e9da21e5bacee597595b318f71d62e/Werkzeug-1.0.1-py2.py3-none-any.whl (298kB)
    100% |████████████████████████████████| 307kB 2.6MB/s
Collecting markdown>=2.6.8 (from tensorboard<1.15.0,>=1.14.0->tensorflow)
  Downloading https://files.pythonhosted.org/packages/a4/63/eaec2bd025ab48c754b55e8819af0f6a69e2b1e187611dd40cbbe101ee7f/Markdown-3.2.2-py3-none-any.whl (88kB)
    100% |████████████████████████████████| 92kB 3.4MB/s
Collecting futures>=2.2.0; python_version < "3.2" (from grpcio>=1.8.6->tensorflow)
  Downloading https://files.pythonhosted.org/packages/47/04/5fc6c74ad114032cd2c544c575bffc17582295e9cd6a851d6026ab4b2c00/futures-3.3.0.tar.gz
    Complete output from command python setup.py egg_info:
    This backport is meant only for Python 2.
    It does not work on Python 3, and Python 3 users do not need it as the concurrent.futures package is available in the standard library.
    For projects that work on both Python 2 and 3, the dependency needs to be conditional on the Python version, like so:
    extras_require={':python_version == "2.7"': ['futures']}
   
    ----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-build-tiqpio20/futures/
You are using pip version 8.1.1, however version 20.1.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.


pip3 install --upgrade pip
Collecting pip
  Downloading https://files.pythonhosted.org/packages/43/84/23ed6a1796480a6f1a2d38f2802901d078266bda38388954d01d3f2e821d/pip-20.1.1-py2.py3-none-any.whl (1.5MB)
    100% |████████████████████████████████| 1.5MB 575kB/s
Installing collected packages: pip
  Found existing installation: pip 8.1.1
    Not uninstalling pip at /usr/lib/python3/dist-packages, outside environment /usr
Successfully installed pip-20.1.1



 pip3 install --upgrade pip
Collecting pip
  Downloading https://files.pythonhosted.org/packages/43/84/23ed6a1796480a6f1a2d38f2802901d078266bda38388954d01d3f2e821d/pip-20.1.1-py2.py3-none-any.whl (1.5MB)
    100% |████████████████████████████████| 1.5MB 575kB/s
Installing collected packages: pip
  Found existing installation: pip 8.1.1
    Not uninstalling pip at /usr/lib/python3/dist-packages, outside environment /usr
Successfully installed pip-20.1.1
root@gpt2:~# pip3 install tensorflow
WARNING: pip is being invoked by an old script wrapper. This will fail in a future version of pip.
Please see https://github.com/pypa/pip/issues/5599 for advice on fixing the underlying issue.
To avoid this problem you can invoke Python with '-m pip' instead of running pip directly.
Collecting tensorflow
  Downloading tensorflow-2.2.0-cp37-cp37m-manylinux2010_x86_64.whl (516.2 MB)
     |████████████████████████████████| 516.2 MB 1.9 kB/s
Collecting tensorboard<2.3.0,>=2.2.0
  Downloading tensorboard-2.2.2-py3-none-any.whl (3.0 MB)
     |████████████████████████████████| 3.0 MB 12.8 MB/s
Collecting h5py<2.11.0,>=2.10.0
  Using cached h5py-2.10.0-cp37-cp37m-manylinux1_x86_64.whl (2.9 MB)
Collecting keras-preprocessing>=1.1.0
  Using cached Keras_Preprocessing-1.1.2-py2.py3-none-any.whl (42 kB)
Collecting tensorflow-estimator<2.3.0,>=2.2.0
  Downloading tensorflow_estimator-2.2.0-py2.py3-none-any.whl (454 kB)
     |████████████████████████████████| 454 kB 11.2 MB/s
Collecting six>=1.12.0
  Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting gast==0.3.3
  Using cached gast-0.3.3-py2.py3-none-any.whl (9.7 kB)
Collecting termcolor>=1.1.0
  Using cached termcolor-1.1.0.tar.gz (3.9 kB)
Requirement already satisfied: wheel>=0.26; python_version >= "3" in /usr/lib/python3/dist-packages (from tensorflow) (0.29.0)
Collecting protobuf>=3.8.0
  Using cached protobuf-3.12.2-cp37-cp37m-manylinux1_x86_64.whl (1.3 MB)
Collecting absl-py>=0.7.0
  Using cached absl-py-0.9.0.tar.gz (104 kB)
Collecting opt-einsum>=2.3.2
  Downloading opt_einsum-3.3.0-py3-none-any.whl (65 kB)
     |████████████████████████████████| 65 kB 4.7 MB/s
Collecting scipy==1.4.1; python_version >= "3"
  Downloading scipy-1.4.1-cp37-cp37m-manylinux1_x86_64.whl (26.1 MB)
     |████████████████████████████████| 26.1 MB 11.8 MB/s
Requirement already satisfied: numpy<2.0,>=1.16.0 in /usr/local/lib/python3.7/dist-packages (from tensorflow) (1.19.0)
Collecting astunparse==1.6.3
  Downloading astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Collecting google-pasta>=0.1.8
  Using cached google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting grpcio>=1.8.6
  Downloading grpcio-1.30.0-cp37-cp37m-manylinux2010_x86_64.whl (3.0 MB)
     |████████████████████████████████| 3.0 MB 12.1 MB/s
Collecting wrapt>=1.11.1
  Using cached wrapt-1.12.1.tar.gz (27 kB)
Collecting google-auth<2,>=1.6.3
  Downloading google_auth-1.19.2-py2.py3-none-any.whl (91 kB)
     |████████████████████████████████| 91 kB 5.5 MB/s
Collecting setuptools>=41.0.0
  Downloading setuptools-49.2.0-py3-none-any.whl (789 kB)
     |████████████████████████████████| 789 kB 12.1 MB/s
Collecting google-auth-oauthlib<0.5,>=0.4.1
  Downloading google_auth_oauthlib-0.4.1-py2.py3-none-any.whl (18 kB)
Collecting markdown>=2.6.8
  Using cached Markdown-3.2.2-py3-none-any.whl (88 kB)
Collecting tensorboard-plugin-wit>=1.6.0
  Downloading tensorboard_plugin_wit-1.7.0-py3-none-any.whl (779 kB)
     |████████████████████████████████| 779 kB 11.9 MB/s
Collecting werkzeug>=0.11.15
  Using cached Werkzeug-1.0.1-py2.py3-none-any.whl (298 kB)
Requirement already satisfied: requests<3,>=2.21.0 in /usr/local/lib/python3.7/dist-packages (from tensorboard<2.3.0,>=2.2.0->tensorflow) (2.24.0)
Collecting pyasn1-modules>=0.2.1
  Downloading pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
     |████████████████████████████████| 155 kB 12.1 MB/s
Collecting rsa<5,>=3.1.4; python_version >= "3"
  Downloading rsa-4.6-py3-none-any.whl (47 kB)
     |████████████████████████████████| 47 kB 5.4 MB/s
Collecting cachetools<5.0,>=2.0.0
  Downloading cachetools-4.1.1-py3-none-any.whl (10 kB)
Collecting requests-oauthlib>=0.7.0
  Downloading requests_oauthlib-1.3.0-py2.py3-none-any.whl (23 kB)
Collecting importlib-metadata; python_version < "3.8"
  Downloading importlib_metadata-1.7.0-py2.py3-none-any.whl (31 kB)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.7/dist-packages (from requests<3,>=2.21.0->tensorboard<2.3.0,>=2.2.0->tensorflow) (2020.6.20)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /usr/local/lib/python3.7/dist-packages (from requests<3,>=2.21.0->tensorboard<2.3.0,>=2.2.0->tensorflow) (1.25.9)
Requirement already satisfied: chardet<4,>=3.0.2 in /usr/local/lib/python3.7/dist-packages (from requests<3,>=2.21.0->tensorboard<2.3.0,>=2.2.0->tensorflow) (3.0.4)
Requirement already satisfied: idna<3,>=2.5 in /usr/local/lib/python3.7/dist-packages (from requests<3,>=2.21.0->tensorboard<2.3.0,>=2.2.0->tensorflow) (2.10)
Collecting pyasn1<0.5.0,>=0.4.6
  Downloading pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
     |████████████████████████████████| 77 kB 3.3 MB/s
Collecting oauthlib>=3.0.0
  Downloading oauthlib-3.1.0-py2.py3-none-any.whl (147 kB)
     |████████████████████████████████| 147 kB 11.7 MB/s
Collecting zipp>=0.5
  Downloading zipp-3.1.0-py3-none-any.whl (4.9 kB)
Building wheels for collected packages: termcolor, absl-py, wrapt
  Building wheel for termcolor (setup.py) ... done
  Created wheel for termcolor: filename=termcolor-1.1.0-py3-none-any.whl size=5680 sha256=7a9fdcd26195168e8f383405a3f72398f4f2f759fa4b1bc878462624c1c5a4ce
  Stored in directory: /root/.cache/pip/wheels/3f/e3/ec/8a8336ff196023622fbcb36de0c5a5c218cbb24111d1d4c7f2
  Building wheel for absl-py (setup.py) ... done
  Created wheel for absl-py: filename=absl_py-0.9.0-py3-none-any.whl size=119295 sha256=b6a1c511cd115ac53f2ed6c5c5729e9afe7692ddbf12e30e65fe084475237a4c
  Stored in directory: /root/.cache/pip/wheels/cc/af/1a/498a24d0730ef484019e007bb9e8cef3ac00311a672c049a3e
  Building wheel for wrapt (setup.py) ... done
  Created wheel for wrapt: filename=wrapt-1.12.1-py3-none-any.whl size=21397 sha256=f6d324127c72a2549afe8c669e053ede41c4254291f8bf2190eb0ac54ff98c5c
  Stored in directory: /root/.cache/pip/wheels/62/76/4c/aa25851149f3f6d9785f6c869387ad82b3fd37582fa8147ac6
Successfully built termcolor absl-py wrapt
Installing collected packages: pyasn1, pyasn1-modules, rsa, cachetools, setuptools, six, google-auth, absl-py, grpcio, oauthlib, requests-oauthlib, google-auth-oauthlib, zipp, importlib-metadata, markdown, protobuf, tensorboard-plugin-wit, werkzeug, tensorboard, h5py, keras-preprocessing, tensorflow-estimator, gast, termcolor, opt-einsum, scipy, astunparse, google-pasta, wrapt, tensorflow
  Attempting uninstall: setuptools
    Found existing installation: setuptools 20.7.0
    Uninstalling setuptools-20.7.0:
      Successfully uninstalled setuptools-20.7.0

Successfully installed absl-py-0.9.0 astunparse-1.6.3 cachetools-4.1.1 gast-0.3.3 google-auth-1.19.2 google-auth-oauthlib-0.4.1 google-pasta-0.2.0 grpcio-1.30.0 h5py-2.10.0 importlib-metadata-1.7.0 keras-preprocessing-1.1.2 markdown-3.2.2 oauthlib-3.1.0 opt-einsum-3.3.0 protobuf-3.12.2 pyasn1-0.4.8 pyasn1-modules-0.2.8 requests-oauthlib-1.3.0 rsa-4.6 scipy-1.4.1 setuptools-49.2.0 six-1.15.0 tensorboard-2.2.2 tensorboard-plugin-wit-1.7.0 tensorflow-2.2.0 tensorflow-estimator-2.2.0 termcolor-1.1.0 werkzeug-1.0.1 wrapt-1.12.1 zipp-3.1.0


python3 gpt2.py
Illegal instruction


#it is something weird with tensorflow 2.2.0
#downgrade!
pip3 install tensorflow==1.13.1

#nope
pip3 install tensorflow==1.15.3 
#nope same error

#apparently any Tensorflow newer than 1.5 won't work if your computer does not have AVX CPU extensions

#compile from source
wget https://github.com/tensorflow/tensorflow/archive/master.zip
 cd tensorflow-master

 ./configure
Cannot find bazel. Please install bazel.



apt install curl gnupg
curl https://bazel.build/bazel-release.pub.gpg | sudo apt-key add -
echo "deb [arch=amd64] https://storage.googleapis.com/bazel-apt stable jdk1.8" | sudo tee /etc/apt/sources.list.d/bazel.list

apt update
apt install bazel

Reading package lists... Done                    
E: The method driver /usr/lib/apt/methods/https could not be found.
N: Is the package apt-transport-https installed?
E: Failed to fetch https://storage.googleapis.com/bazel-apt/dists/stable/InRelease 
E: Some index files failed to download. They have been ignored, or old ones used instead.

#edit and change https to http
 /etc/apt/sources.list.d/bazel.list
deb [arch=amd64] https://storage.googleapis.com/bazel-apt stable jdk1.8

apt install bazel

#back to tensorflow
./configure

./configure
WARNING: current bazel installation is not a release version.
Make sure you are running at least bazel 3.1.0
Please specify the location of python. [Default is /usr/bin/python3]:


Found possible Python library paths:
  /usr/lib/python3/dist-packages
  /usr/local/lib/python3.7/dist-packages
Please input the desired Python library path to use.  Default is [/usr/lib/python3/dist-packages]

Do you wish to build TensorFlow with OpenCL SYCL support? [y/N]: n
No OpenCL SYCL support will be enabled for TensorFlow.

Do you wish to build TensorFlow with ROCm support? [y/N]: n
No ROCm support will be enabled for TensorFlow.

Do you wish to build TensorFlow with CUDA support? [y/N]: n
No CUDA support will be enabled for TensorFlow.

Do you wish to download a fresh release of clang? (Experimental) [y/N]: n
Clang will not be downloaded.

Please specify optimization flags to use during compilation when bazel option "--config=opt" is specified [Default is -march=native -Wno-sign-compare]:


Would you like to interactively configure ./WORKSPACE for Android builds? [y/N]: n
Not configuring the WORKSPACE for Android builds.

Preconfigured Bazel build configs. You can use any of the below by adding "--config=<>" to your build command. See .bazelrc for more details.
    --config=mkl             # Build with MKL support.
    --config=monolithic      # Config for mostly static monolithic build.
    --config=ngraph          # Build with Intel nGraph support.
    --config=numa            # Build with NUMA support.
    --config=dynamic_kernels    # (Experimental) Build kernels into separate shared objects.
    --config=v2              # Build TensorFlow 2.x instead of 1.x.
Preconfigured Bazel build configs to DISABLE default on features:
    --config=noaws           # Disable AWS S3 filesystem support.
    --config=nogcp           # Disable GCP support.
    --config=nohdfs          # Disable HDFS support.
    --config=nonccl          # Disable NVIDIA NCCL support.
Configuration finished


#ok weird I have bazel 3.4 what is the issue?

bazel build //tensorflow/tools/pip_package:build_pip_package
ERROR: The project you're trying to build requires Bazel 3.1.0 (specified in /root/tensorflow/tensorflow-master/.bazelversion), but it wasn't found in /usr/bin.

You can install the required Bazel version via apt:
  sudo apt update && sudo apt install bazel-3.1.0

If this doesn't work, check Bazel's installation instructions for help:
  https://docs.bazel.build/versions/master/install-ubuntu.html
root@gpt2:~/tensorflow/tensorflow-master# dpkg -l|grep bazel
ii  bazel                         3.4.1                              amd64        Bazel is a tool that automates software builds and tests.


apt install bazel-3.1.0

bazel build //tensorflow/tools/pip_package:build_pip_package


apt install bazel-3.1.0
Reading package lists... Done
Building dependency tree      
Reading state information... Done
Suggested packages:
  google-jdk | java8-sdk-headless | java8-jdk | java8-sdk | oracle-java8-installer bash-completion
The following NEW packages will be installed:
  bazel-3.1.0
0 upgraded, 1 newly installed, 0 to remove and 180 not upgraded.
Need to get 42.8 MB of archives.
After this operation, 0 B of additional disk space will be used.
Get:1 http://storage.googleapis.com/bazel-apt stable/jdk1.8 amd64 bazel-3.1.0 amd64 3.1.0 [42.8 MB]
Fetched 42.8 MB in 8s (5200 kB/s)                                                                                                                                   
Selecting previously unselected package bazel-3.1.0.
(Reading database ... 33246 files and directories currently installed.)
Preparing to unpack .../bazel-3.1.0_3.1.0_amd64.deb ...
Unpacking bazel-3.1.0 (3.1.0) ...
Setting up bazel-3.1.0 (3.1.0) ...
root@gpt2:~/tensorflow/tensorflow-master# bazel build //tensorflow/tools/pip_package:build_pip_package
Extracting Bazel installation...
Starting local Bazel server and connecting to it...
INFO: Options provided by the client:
  Inherited 'common' options: --isatty=1 --terminal_columns=166
INFO: Reading rc options for 'build' from /root/tensorflow/tensorflow-master/.bazelrc:
  Inherited 'common' options: --experimental_repo_remote_exec
INFO: Reading rc options for 'build' from /root/tensorflow/tensorflow-master/.bazelrc:
  'build' options: --apple_platform_type=macos --define framework_shared_object=true --define open_source_build=true --java_toolchain=//third_party/toolchains/java:tf_java_toolchain --host_java_toolchain=//third_party/toolchains/java:tf_java_toolchain --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --noincompatible_prohibit_aapt1 --enable_platform_specific_config --config=v2
INFO: Reading rc options for 'build' from /root/tensorflow/tensorflow-master/.tf_configure.bazelrc:
  'build' options: --action_env PYTHON_BIN_PATH=/usr/bin/python3 --action_env PYTHON_LIB_PATH=/usr/lib/python3/dist-packages --python_path=/usr/bin/python3 --config=xla --action_env TF_CONFIGURE_IOS=0
INFO: Found applicable config definition build:v2 in file /root/tensorflow/tensorflow-master/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
INFO: Found applicable config definition build:xla in file /root/tensorflow/tensorflow-master/.bazelrc: --action_env=TF_ENABLE_XLA=1 --define=with_xla_support=true
INFO: Found applicable config definition build:linux in file /root/tensorflow/tensorflow-master/.bazelrc: --copt=-w --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --cxxopt=-std=c++14 --host_cxxopt=-std=c++14 --config=dynamic_kernels
INFO: Found applicable config definition build:dynamic_kernels in file /root/tensorflow/tensorflow-master/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS
INFO: Repository local_execution_config_python instantiated at:
  no stack (--record_rule_instantiation_callstack not enabled)
Repository rule local_python_configure defined at:
  /root/tensorflow/tensorflow-master/third_party/py/python_configure.bzl:275:26: in <toplevel>
ERROR: An error occurred during the fetch of repository 'local_execution_config_python':
   Traceback (most recent call last):
    File "/root/tensorflow/tensorflow-master/third_party/py/python_configure.bzl", line 214
        _symlink_genrule_for_dir(<4 more arguments>)
    File "/root/tensorflow/tensorflow-master/third_party/py/python_configure.bzl", line 66, in _symlink_genrule_for_dir
        "n".join(<1 more arguments>)
    File "/root/tensorflow/tensorflow-master/third_party/py/python_configure.bzl", line 66, in "n".join
        read_dir(repository_ctx, <1 more arguments>)
    File "/root/tensorflow/tensorflow-master/third_party/remote_config/common.bzl", line 101, in read_dir
        execute(repository_ctx, <2 more arguments>)
    File "/root/tensorflow/tensorflow-master/third_party/remote_config/common.bzl", line 208, in execute
        fail(<1 more arguments>)
Repository command failed
find: '/usr/include/python3.7m': No such file or directory
INFO: Repository sobol_data instantiated at:
  no stack (--record_rule_instantiation_callstack not enabled)
Repository rule third_party_http_archive defined at:
  /root/tensorflow/tensorflow-master/third_party/repo.bzl:216:28: in <toplevel>
INFO: Repository absl_py instantiated at:
  no stack (--record_rule_instantiation_callstack not enabled)
Repository rule tf_http_archive defined at:
  /root/tensorflow/tensorflow-master/third_party/repo.bzl:131:19: in <toplevel>
INFO: Repository rules_proto instantiated at:
  no stack (--record_rule_instantiation_callstack not enabled)
Repository rule http_archive defined at:
  /root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/http.bzl:336:16: in <toplevel>
INFO: Repository rules_java instantiated at:
  no stack (--record_rule_instantiation_callstack not enabled)
Repository rule http_archive defined at:
  /root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/http.bzl:336:16: in <toplevel>
ERROR: Analysis of target '//tensorflow/tools/pip_package:build_pip_package' failed; build aborted: Traceback (most recent call last):
    File "/root/tensorflow/tensorflow-master/third_party/py/python_configure.bzl", line 214
        _symlink_genrule_for_dir(<4 more arguments>)
    File "/root/tensorflow/tensorflow-master/third_party/py/python_configure.bzl", line 66, in _symlink_genrule_for_dir
        "n".join(<1 more arguments>)
    File "/root/tensorflow/tensorflow-master/third_party/py/python_configure.bzl", line 66, in "n".join
        read_dir(repository_ctx, <1 more arguments>)
    File "/root/tensorflow/tensorflow-master/third_party/remote_config/common.bzl", line 101, in read_dir
        execute(repository_ctx, <2 more arguments>)
    File "/root/tensorflow/tensorflow-master/third_party/remote_config/common.bzl", line 208, in execute
        fail(<1 more arguments>)
Repository command failed
find: '/usr/include/python3.7m': No such file or directory
INFO: Elapsed time: 37.338s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (150 packages loaded, 3343 targets configured)
    currently loading: @bazel_tools//tools/jdk ... (2 packages)



#find: '/usr/include/python3.7m': No such file or directory

apt install python3.7-dev

#ok new error

 bazel build //tensorflow/tools/pip_package:build_pip_package
INFO: Options provided by the client:
  Inherited 'common' options: --isatty=1 --terminal_columns=166
INFO: Reading rc options for 'build' from /root/tensorflow/tensorflow-master/.bazelrc:
  Inherited 'common' options: --experimental_repo_remote_exec
INFO: Reading rc options for 'build' from /root/tensorflow/tensorflow-master/.bazelrc:
  'build' options: --apple_platform_type=macos --define framework_shared_object=true --define open_source_build=true --java_toolchain=//third_party/toolchains/java:tf_java_toolchain --host_java_toolchain=//third_party/toolchains/java:tf_java_toolchain --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --noincompatible_prohibit_aapt1 --enable_platform_specific_config --config=v2
INFO: Reading rc options for 'build' from /root/tensorflow/tensorflow-master/.tf_configure.bazelrc:
  'build' options: --action_env PYTHON_BIN_PATH=/usr/bin/python3 --action_env PYTHON_LIB_PATH=/usr/lib/python3/dist-packages --python_path=/usr/bin/python3 --config=xla --action_env TF_CONFIGURE_IOS=0
INFO: Found applicable config definition build:v2 in file /root/tensorflow/tensorflow-master/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
INFO: Found applicable config definition build:xla in file /root/tensorflow/tensorflow-master/.bazelrc: --action_env=TF_ENABLE_XLA=1 --define=with_xla_support=true
INFO: Found applicable config definition build:linux in file /root/tensorflow/tensorflow-master/.bazelrc: --copt=-w --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --cxxopt=-std=c++14 --host_cxxopt=-std=c++14 --config=dynamic_kernels
INFO: Found applicable config definition build:dynamic_kernels in file /root/tensorflow/tensorflow-master/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS
INFO: Repository io_bazel_rules_docker instantiated at:
  no stack (--record_rule_instantiation_callstack not enabled)
Repository rule git_repository defined at:
  /root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git.bzl:195:18: in <toplevel>
ERROR: An error occurred during the fetch of repository 'io_bazel_rules_docker':
   Traceback (most recent call last):
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git.bzl", line 177
        _clone_or_update(ctx)
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git.bzl", line 36, in _clone_or_update
        git_repo(ctx, directory)
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 91, in git_repo
        _update(ctx, git_repo)
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 101, in _update
        init(ctx, git_repo)
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 115, in init
        _error(ctx.name, cl, st.stderr)
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 181, in _error
        fail(<1 more arguments>)
error running 'git init /root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/io_bazel_rules_docker' while working with @io_bazel_rules_docker:
src/main/tools/process-wrapper-legacy.cc:58: "execvp(git, ...)": No such file or directory
INFO: Repository absl_py instantiated at:
  no stack (--record_rule_instantiation_callstack not enabled)
Repository rule tf_http_archive defined at:
  /root/tensorflow/tensorflow-master/third_party/repo.bzl:131:19: in <toplevel>
INFO: Repository wrapt instantiated at:
  no stack (--record_rule_instantiation_callstack not enabled)
Repository rule tf_http_archive defined at:
  /root/tensorflow/tensorflow-master/third_party/repo.bzl:131:19: in <toplevel>
INFO: Repository rules_python instantiated at:
  no stack (--record_rule_instantiation_callstack not enabled)
Repository rule tf_http_archive defined at:
  /root/tensorflow/tensorflow-master/third_party/repo.bzl:131:19: in <toplevel>
ERROR: Analysis of target '//tensorflow/tools/pip_package:build_pip_package' failed; build aborted: Traceback (most recent call last):
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git.bzl", line 177
        _clone_or_update(ctx)
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git.bzl", line 36, in _clone_or_update
        git_repo(ctx, directory)
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 91, in git_repo
        _update(ctx, git_repo)
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 101, in _update
        init(ctx, git_repo)
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 115, in init
        _error(ctx.name, cl, st.stderr)
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 181, in _error
        fail(<1 more arguments>)
error running 'git init /root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/io_bazel_rules_docker' while working with @io_bazel_rules_docker:
src/main/tools/process-wrapper-legacy.cc:58: "execvp(git, ...)": No such file or directory
INFO: Elapsed time: 1.038s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (7 packages loaded, 108 targets configured)
    Fetching @local_config_python; fetching

#oh it needs git!
apt install git

#another compile error ! :(

bazel build //tensorflow/tools/pip_package:build_pip_package
INFO: Options provided by the client:
  Inherited 'common' options: --isatty=1 --terminal_columns=166
INFO: Reading rc options for 'build' from /root/tensorflow/tensorflow-master/.bazelrc:
  Inherited 'common' options: --experimental_repo_remote_exec
INFO: Reading rc options for 'build' from /root/tensorflow/tensorflow-master/.bazelrc:
  'build' options: --apple_platform_type=macos --define framework_shared_object=true --define open_source_build=true --java_toolchain=//third_party/toolchains/java:tf_java_toolchain --host_java_toolchain=//third_party/toolchains/java:tf_java_toolchain --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --noincompatible_prohibit_aapt1 --enable_platform_specific_config --config=v2
INFO: Reading rc options for 'build' from /root/tensorflow/tensorflow-master/.tf_configure.bazelrc:
  'build' options: --action_env PYTHON_BIN_PATH=/usr/bin/python3 --action_env PYTHON_LIB_PATH=/usr/lib/python3/dist-packages --python_path=/usr/bin/python3 --config=xla --action_env TF_CONFIGURE_IOS=0
INFO: Found applicable config definition build:v2 in file /root/tensorflow/tensorflow-master/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
INFO: Found applicable config definition build:xla in file /root/tensorflow/tensorflow-master/.bazelrc: --action_env=TF_ENABLE_XLA=1 --define=with_xla_support=true
INFO: Found applicable config definition build:linux in file /root/tensorflow/tensorflow-master/.bazelrc: --copt=-w --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --cxxopt=-std=c++14 --host_cxxopt=-std=c++14 --config=dynamic_kernels
INFO: Found applicable config definition build:dynamic_kernels in file /root/tensorflow/tensorflow-master/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS
DEBUG: Rule 'io_bazel_rules_docker' indicated that a canonical reproducible form can be obtained by modifying arguments shallow_since = "1556410077 -0400"
DEBUG: Repository io_bazel_rules_docker instantiated at:
  no stack (--record_rule_instantiation_callstack not enabled)
Repository rule git_repository defined at:
  /root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git.bzl:195:18: in <toplevel>
WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/google/ruy/archive/d492ac890d982d7a153a326922f362b10de8d2ad.zip failed: class com.google.devtools.build.lib.bazel.repository.downloader.UnrecoverableHttpException GET returned 404 Not Found
WARNING: Download from https://mirror.bazel.build/github.com/aws/aws-sdk-cpp/archive/1.7.336.tar.gz failed: class com.google.devtools.build.lib.bazel.repository.downloader.UnrecoverableHttpException GET returned 404 Not Found
WARNING: /root/tensorflow/tensorflow-master/tensorflow/core/BUILD:1720:1: in linkstatic attribute of cc_library rule //tensorflow/core:lib_internal: setting 'linkstatic=1' is recommended if there are no object files. Since this rule was created by the macro 'cc_library', the error might have been caused by the macro implementation
WARNING: /root/tensorflow/tensorflow-master/tensorflow/core/BUILD:2132:1: in linkstatic attribute of cc_library rule //tensorflow/core:framework_internal: setting 'linkstatic=1' is recommended if there are no object files. Since this rule was created by the macro 'tf_cuda_library', the error might have been caused by the macro implementation
WARNING: /root/tensorflow/tensorflow-master/tensorflow/core/BUILD:1745:1: in linkstatic attribute of cc_library rule //tensorflow/core:lib_headers_for_pybind: setting 'linkstatic=1' is recommended if there are no object files. Since this rule was created by the macro 'cc_library', the error might have been caused by the macro implementation
WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/llvm/llvm-project/archive/cf5df40c4cf1a53a02ab1d56a488642e3dda8f6d.tar.gz failed: class com.google.devtools.build.lib.bazel.repository.downloader.UnrecoverableHttpException GET returned 404 Not Found
WARNING: /root/tensorflow/tensorflow-master/tensorflow/python/BUILD:4666:1: in py_library rule //tensorflow/python:standard_ops: target '//tensorflow/python:standard_ops' depends on deprecated target '//tensorflow/python/ops/distributions:distributions': TensorFlow Distributions has migrated to TensorFlow Probability (https://github.com/tensorflow/probability). Deprecated copies remaining in tf.distributions will not receive new features, and will be removed by early 2019. You should update all usage of `tf.distributions` to `tfp.distributions`.
WARNING: /root/tensorflow/tensorflow-master/tensorflow/python/BUILD:115:1: in py_library rule //tensorflow/python:no_contrib: target '//tensorflow/python:no_contrib' depends on deprecated target '//tensorflow/python/ops/distributions:distributions': TensorFlow Distributions has migrated to TensorFlow Probability (https://github.com/tensorflow/probability). Deprecated copies remaining in tf.distributions will not receive new features, and will be removed by early 2019. You should update all usage of `tf.distributions` to `tfp.distributions`.
INFO: Analyzed target //tensorflow/tools/pip_package:build_pip_package (230 packages loaded, 27544 targets configured).
INFO: Found 1 target...
ERROR: /root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/com_google_absl/absl/time/BUILD.bazel:29:1: C++ compilation of rule '@com_google_absl//absl/time:time' failed (Exit 1)

cc1plus: out of memory allocating 236976 bytes after a total of 77238272 bytes
Target //tensorflow/tools/pip_package:build_pip_package failed to build
Use --verbose_failures to see the command lines of failed build steps.
INFO: Elapsed time: 62.789s, Critical Path: 3.15s
INFO: 103 processes: 103 local.
FAILED: Build did NOT complete successfully

#cc1plus: out of memory allocating 236976 bytes after a total of 77238272 bytes


ModuleNotFoundError: No module named 'tensorflow.core'
 

Unless you are using OpenStack, AWS etc then cloud-init is just some bloat that slows down the booting of your VM and can actually halt it from booting if it doesn't have a proper working IP (not good!).

#remove cloud init!

Debian based Ubuntu / Mint

sudo apt remove cloud-init

RHEL / CentOS based

yum remove cloud-init

I am going to build this based on a series of small posts I've made as I feel much of the information is actually hard to find and piece together from the rest of the web.

What I'm going to focus on is how to use virtio as the NIC because if you don't you get very slow NIC speeds but with the virtio NIC model you basically get host speeds.

/usr/libexec/qemu-kvm -enable-kvm -smp 8 -m 16000 -net user -net nic,model=virtio -drive file=ubuntu-gpt2large.img,if=virtio
 

How do I specify local NAT network only? 

By default if you don't specify "-net" as network type it defaults to user mode networking.  Basically you get a standard NAT IP that allows the VM to surf the net, download etc.. but it's not possible to remotely access the VM.

How do specify my NIC as being virtio?

-net nic,model=virtio

How do you start in bridged mode and use the virtio accelerated network card/driver?

-netdev bridge,id=hn1 -device virtio-net-pci,netdev=hn1

You can also specify the mac, which is necessary as if you start multiple VMs they will default to the same MAC which breaks things of course

 -netdev bridge,id=hn1 -device virtio-net-pci,netdev=hn1,mac="DE:AD:BE:EF:06:02"

Most newer distros inexplicably cause your NIC to have what I call "random" non-standard name conventions because of systemd.

This is a big problem for many people and especially those running servers.  Imagine that you have a static IP configured for ens33 but then the hard disk is moved to a newer system, the NIC could be anything from ens33 to enp0s1, meaning that manual intervention is required to go and update the NIC config file (eg. /etc/network/interfaces /etc/sysconfig/network-scripts/ifcfg-ens33).

But there is a solution and it just takes a few seconds to solve and it works on virtually all Linux OS's whether Ubuntu, Linux Mint, CentOS, RHEL/Fedora etc.., Debian

enp0s25

#Edit /etc/grub/default

Step 1. ) Add this to the line below "net.ifnames=0 biosdevname=0"

GRUB_CMDLINE_LINUX="net.ifnames=0 biosdevname=0"

Step 2.) Update GRUB

This depends on your OS.

Debian based Ubuntu/Mint:

update-grub

Centos/RHEL

grub2-mkconfig -o /boot/grub2/grub.cfg

After that just reboot and from now on you will have predictable and normal/standard NIC devices!

Below is an example of editing the default grub file on Debian/Ubuntu

Here is what CentOS 8 looks like:

GRUB_TIMEOUT=5
GRUB_DISTRIBUTOR="$(sed 's, release .*$,,g' /etc/system-release)"
GRUB_DEFAULT=saved
GRUB_DISABLE_SUBMENU=true
GRUB_TERMINAL_OUTPUT="console"
GRUB_CMDLINE_LINUX="crashkernel=auto resume=UUID=bbed66de-8c71-44e3-aa82-da7830ccc98e net.ifnames=0 biosdevname=0"
GRUB_DISABLE_RECOVERY="true"
GRUB_ENABLE_BLSCFG=true

This is caused because the user is running as qemu for virt-resize and if qemu does not have privileges to read from the source and write to the destination, it will fail with the below.  So either change the uid of qemu or change the ownership of the source and target.

Solution:

export LIBGUESTFS_BACKEND=direct

virt-resize --expand /dev/sda2 /root/kvmtemplates/windows2019-eval-template.img /root/kvmguests/kvmkvmuser451511/kvmkvmuser451511.img
[   0.0] Examining /root/kvmtemplates/windows2019-eval-template.img
virt-resize: error: libguestfs error: could not create appliance through
libvirt.

Try running qemu directly without libvirt using this environment variable:
export LIBGUESTFS_BACKEND=direct

Original error from libvirt: Cannot access backing file
'/root/kvmtemplates/windows2019-eval-template.img' of storage file
'/tmp/libguestfsFNamzn/overlay1.qcow2' (as uid:107, gid:107): Permission
denied [code=38 int1=13]

If reporting bugs, run virt-resize with debugging enabled and include the
complete output:

  virt-resize -v -x [...]


When authentication times out that is one thing, but when it just fails like below Asterisk by default will not re-register until you the admin reload the sip or asterisk server:

voipserver*CLI> sip show registry
Host                           dnsmgr Username       Refresh State                Reg.Time                
remote.voipservice.com:5060          N      151113             105 No Authentication    Sat, 25 Apr 2020 11:20:08
1 SIP registrations.

Now reload and it will re-register

voipserver*CLI> sip reload
voipserver*CLI> sip show registry
Host                           dnsmgr Username       Refresh State                Reg.Time                
remote.voipservice.com:5060          N      151113             105 Registered           Sat, 25 Apr 2020 12:22:09
1 SIP registrations.
 

How do we fix this so it retries when authentication fails?

under /etc/asterisk/sip.conf where you have your trunk peer add this:

register_retry_403=yes
 

Then restart asterisk or reload it and the above setting should sort it out and make Asterisk keep retrying

Note that the setting registerattempts=0 (which is unlimited retries) does not fix the problem shown above, but only register_retry_403=yes fixes it.

Just run this apt install command

sudo apt install pepperflashplugin-nonfree browser-plugin-freshplayer-pepperflash
 

After this restart your browser and check Adobe's site to verify if your Pepper flash is working and showing at least version 32.

https://helpx.adobe.com/flash-player.html

As you'll see below it will download the latest version which is currently 32 and this was not possible with the old/crappy deprecated adobe-flash plugin.

sudo apt install pepperflashplugin-nonfree
Reading package lists... Done
Building dependency tree      
Reading state information... Done
Suggested packages:
  chromium-browser ttf-mscorefonts-installer ttf-dejavu ttf-xfree86-nonfree
The following NEW packages will be installed:
  pepperflashplugin-nonfree
0 upgraded, 1 newly installed, 0 to remove and 310 not upgraded.
Need to get 5,620 B of archives.
After this operation, 30.7 kB of additional disk space will be used.
Get:1 http://archive.ubuntu.com/ubuntu xenial-updates/multiverse amd64 pepperflashplugin-nonfree amd64 1.8.2ubuntu1.1 [5,620 B]
Fetched 5,620 B in 0s (15.1 kB/s)                   
Selecting previously unselected package pepperflashplugin-nonfree.
(Reading database ... 323899 files and directories currently installed.)
Preparing to unpack .../pepperflashplugin-nonfree_1.8.2ubuntu1.1_amd64.deb ...
Unpacking pepperflashplugin-nonfree (1.8.2ubuntu1.1) ...
Setting up pepperflashplugin-nonfree (1.8.2ubuntu1.1) ...
--2020-05-07 13:02:47--  https://fpdownload.adobe.com/pub/flashplayer/pdc/32.0.0.363/flash_player_ppapi_linux.x86_64.tar.gz
Resolving fpdownload.adobe.com (fpdownload.adobe.com)... 2.22.72.174, 2001:569:139:193::11e2, 2001:569:139:198::11e2
Connecting to fpdownload.adobe.com (fpdownload.adobe.com)|2.22.72.174|:443... connected.
 

I used to believe that for Desktops especially that the "ondemand" CPU frequency changing that kernels included with Ubuntu and Debian based distros have would be sufficient for snappy performance.

However, you can feel the lack of performance on the fastest computer if you have ondemand.  A lot of times even under high load 100% of your CPU frequency in MHz will not be used.

For example a 2.8Ghz CPU may only run at 1.8MHz or even .9GHz.  Now the frequency will scale up under high load but you can feel things in the OS aren't as snappy while you wait for the ondemand governor to increase the performance.  This can especially cause choppy sound and video if you are conferencing.

The solution is to change the governor to "performance" so the cores always run at the highest frequency.

How To Check Your CPU Performance Governor Settings

cat /sys/devices/system/cpu/cpu*/cpufreq/scaling_governor

ondemand

In this case it is already set to ondemand which is generally the default slow performance mode.

If you do this you will see your CPU is set lower in frequency:

cat /proc/cpuinfo |grep MHz
cpu MHz        : 900.000
cpu MHz        : 1200.000
cpu MHz        : 1400.000
cpu MHz        : 1100.000
cpu MHz        : 1000.000
cpu MHz        : 980.000
cpu MHz        : 1112.000
cpu MHz        : 1484.000
 

How Do We Fix CPU Performance

The below will set up to 100 CPU cores to performance mode.  Just change the 99 to higher number if you have more cores than 100.

for i in {0..99}; do echo performance > /sys/devices/system/cpu/cpu$i/cpufreq/scaling_governor; done

Conclusion

Setting CPU governor to performance makes a huge difference in the responsiveness of your computer.

A lot of times you may falsely believe your CPU is underutilized when checking the current CPU frequency or top but it is kind of like "auto" settings on your GPU.  By the time the frequencies are adapted you may have usage issues such as audio cutting out and lag in video conferencing due to CPU throttling

After doing this I observed apps that were using 150% CPU go down to 85% CPU

So a lot of times the lack of optimized governor that doesn't scale to the highest frequency will make it seem like your PC is not powerful enough when that's not the case.

base64 has legitimate uses too and can be an easy way to store a file or data within actual code for developers to keep things in a single file.

For example let's take an image we'll see for an application's background:

base64 -w 0 some.jpg > some.jpg-base64

-w 0 makes it output to a single line which makes it easy to store in a variable.  Without the -w 0 it will wrap over multiple lines.

radeon_dp_aux_transfer_native: 158 callbacks suppressed

The simple answer is that radeon driver sucks and is a remnant of typical AMD/ATI issues.

Use AMDGPU if you support it: 

mdadm --create /dev/md0 --level 1 --raid-devices 2 /dev/sdb1 missing --metadata=0.90
mdadm: super0.90 cannot open /dev/sdb1: Device or resource busy
mdadm: /dev/sdb1 is not suitable for this array.
mdadm: create aborted


Sometimes running "partprobe" can fix this.  Other times it requires a reboot.

One other manual thing that can be done is the following to fix it (if dm is using and blocking it):

dmsetup table

Then remove the entry that is using /dev/sdb1

dmsetup remove [the device id from above]

If the above doesn't work could it be that you used -f to fail a partition to test or by accident?

md3 : active raid10 sdb3[2](F) sda3[0]
      436343808 blocks 512K chunks 2 far-copies [2/1] [U_]
      bitmap: 4/4 pages [16KB], 65536KB chunk


mdadm: Cannot open /dev/sdb3: Device or resource busy
 

Fix it by removing the device from the mdadm array

mdadm --manage /dev/md3 -r /dev/sdb3
mdadm: hot removed /dev/sdb3 from /dev/md3

Now we can readd it without any error:

mdadm --manage /dev/md3 -a /dev/sdb3
mdadm: re-added /dev/sdb3

yum -y install wget unzip
wget https://download.nextcloud.com/server/releases/nextcloud-18.0.2.zip
unzip nextcloud-18.0.2.zip



yum -y install php php-mysqlnd php-json php-zip php-dom php-xml php-libxml php-mbstring php-gd mysql mysql-server

Last metadata expiration check: 0:58:02 ago on Fri 13 Mar 2020 02:12:49 PM EDT.
Dependencies resolved.
================================================================================================================================================
 Package                           Architecture          Version                                                 Repository                Size
================================================================================================================================================
Installing:
 php                               x86_64                7.2.11-2.module_el8.1.0+209+03b9a8ff                    AppStream                1.5 M
 php-mysqlnd                       x86_64                7.2.11-2.module_el8.1.0+209+03b9a8ff                    AppStream                190 k
Installing dependencies:
 apr                               x86_64                1.6.3-9.el8                                             AppStream                125 k
 apr-util                          x86_64                1.6.1-6.el8                                             AppStream                105 k
 centos-logos-httpd                noarch                80.5-2.el8                                              AppStream                 24 k
 httpd                             x86_64                2.4.37-16.module_el8.1.0+256+ae790463                   AppStream                1.7 M
 httpd-filesystem                  noarch                2.4.37-16.module_el8.1.0+256+ae790463                   AppStream                 35 k
 httpd-tools                       x86_64                2.4.37-16.module_el8.1.0+256+ae790463                   AppStream                103 k
 mod_http2                         x86_64                1.11.3-3.module_el8.1.0+213+acce2796                    AppStream                158 k
 nginx-filesystem                  noarch                1:1.14.1-9.module_el8.0.0+184+e34fea82                  AppStream                 24 k
 php-cli                           x86_64                7.2.11-2.module_el8.1.0+209+03b9a8ff                    AppStream                3.1 M
 php-common                        x86_64                7.2.11-2.module_el8.1.0+209+03b9a8ff                    AppStream                655 k
 php-pdo                           x86_64                7.2.11-2.module_el8.1.0+209+03b9a8ff                    AppStream                122 k
 mailcap                           noarch                2.1.48-3.el8                                            BaseOS                    39 k
Installing weak dependencies:
 apr-util-bdb                      x86_64                1.6.1-6.el8                                             AppStream                 25 k
 apr-util-openssl                  x86_64                1.6.1-6.el8                                             AppStream                 27 k
 php-fpm                           x86_64                7.2.11-2.module_el8.1.0+209+03b9a8ff                    AppStream                1.6 M
Enabling module streams:
 httpd                                                   2.4                                                                                  
 nginx                                                   1.14                                                                                 
 php                                                     7.2                                                                                  

Transaction Summary
================================================================================================================================================
Install  17 Packages

Total download size: 9.5 M
Installed size: 36 M
Is this ok [y/N]: y
Downloading Packages:
(1/17): apr-1.6.3-9.el8.x86_64.rpm                                                                              1.0 MB/s | 125 kB     00:00   
(2/17): apr-util-bdb-1.6.1-6.el8.x86_64.rpm                                                                     205 kB/s |  25 kB     00:00   
(3/17): apr-util-1.6.1-6.el8.x86_64.rpm                                                                         837 kB/s | 105 kB     00:00   
(4/17): apr-util-openssl-1.6.1-6.el8.x86_64.rpm                                                                 1.0 MB/s |  27 kB     00:00   
(5/17): centos-logos-httpd-80.5-2.el8.noarch.rpm                                                                638 kB/s |  24 kB     00:00   
(6/17): httpd-filesystem-2.4.37-16.module_el8.1.0+256+ae790463.noarch.rpm                                       635 kB/s |  35 kB     00:00   
(7/17): httpd-tools-2.4.37-16.module_el8.1.0+256+ae790463.x86_64.rpm                                            1.3 MB/s | 103 kB     00:00   
(8/17): mod_http2-1.11.3-3.module_el8.1.0+213+acce2796.x86_64.rpm                                               2.3 MB/s | 158 kB     00:00   
(9/17): nginx-filesystem-1.14.1-9.module_el8.0.0+184+e34fea82.noarch.rpm                                        538 kB/s |  24 kB     00:00   
(10/17): httpd-2.4.37-16.module_el8.1.0+256+ae790463.x86_64.rpm                                                 8.6 MB/s | 1.7 MB     00:00   
(11/17): php-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64.rpm                                                    8.7 MB/s | 1.5 MB     00:00   
(12/17): php-common-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64.rpm                                             4.0 MB/s | 655 kB     00:00   
(13/17): php-mysqlnd-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64.rpm                                            3.0 MB/s | 190 kB     00:00   
(14/17): php-fpm-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64.rpm                                                 11 MB/s | 1.6 MB     00:00   
(15/17): php-pdo-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64.rpm                                                2.2 MB/s | 122 kB     00:00   
(16/17): mailcap-2.1.48-3.el8.noarch.rpm                                                                        1.1 MB/s |  39 kB     00:00   
(17/17): php-cli-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64.rpm                                                5.4 MB/s | 3.1 MB     00:00   
------------------------------------------------------------------------------------------------------------------------------------------------
Total                                                                                                           4.9 MB/s | 9.5 MB     00:01    
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                                                                                        1/1
  Installing       : php-common-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64                                                                1/17
  Running scriptlet: httpd-filesystem-2.4.37-16.module_el8.1.0+256+ae790463.noarch                                                         2/17
  Installing       : httpd-filesystem-2.4.37-16.module_el8.1.0+256+ae790463.noarch                                                         2/17
  Installing       : apr-1.6.3-9.el8.x86_64                                                                                                3/17
  Running scriptlet: apr-1.6.3-9.el8.x86_64                                                                                                3/17
  Installing       : apr-util-bdb-1.6.1-6.el8.x86_64                                                                                       4/17
  Installing       : apr-util-openssl-1.6.1-6.el8.x86_64                                                                                   5/17
  Installing       : apr-util-1.6.1-6.el8.x86_64                                                                                           6/17
  Running scriptlet: apr-util-1.6.1-6.el8.x86_64                                                                                           6/17
  Installing       : httpd-tools-2.4.37-16.module_el8.1.0+256+ae790463.x86_64                                                              7/17
  Installing       : php-cli-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64                                                                   8/17
  Installing       : php-pdo-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64                                                                   9/17
  Installing       : mailcap-2.1.48-3.el8.noarch                                                                                          10/17
  Running scriptlet: nginx-filesystem-1:1.14.1-9.module_el8.0.0+184+e34fea82.noarch                                                       11/17
  Installing       : nginx-filesystem-1:1.14.1-9.module_el8.0.0+184+e34fea82.noarch                                                       11/17
  Installing       : php-fpm-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64                                                                  12/17
  Running scriptlet: php-fpm-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64                                                                  12/17
  Installing       : centos-logos-httpd-80.5-2.el8.noarch                                                                                 13/17
  Installing       : mod_http2-1.11.3-3.module_el8.1.0+213+acce2796.x86_64                                                                14/17
  Installing       : httpd-2.4.37-16.module_el8.1.0+256+ae790463.x86_64                                                                   15/17
  Running scriptlet: httpd-2.4.37-16.module_el8.1.0+256+ae790463.x86_64                                                                   15/17
  Installing       : php-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64                                                                      16/17
  Installing       : php-mysqlnd-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64                                                              17/17
  Running scriptlet: httpd-2.4.37-16.module_el8.1.0+256+ae790463.x86_64                                                                   17/17
  Running scriptlet: php-mysqlnd-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64                                                              17/17
  Running scriptlet: php-fpm-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64                                                                  17/17
  Verifying        : apr-1.6.3-9.el8.x86_64                                                                                                1/17
  Verifying        : apr-util-1.6.1-6.el8.x86_64                                                                                           2/17
  Verifying        : apr-util-bdb-1.6.1-6.el8.x86_64                                                                                       3/17
  Verifying        : apr-util-openssl-1.6.1-6.el8.x86_64                                                                                   4/17
  Verifying        : centos-logos-httpd-80.5-2.el8.noarch                                                                                  5/17
  Verifying        : httpd-2.4.37-16.module_el8.1.0+256+ae790463.x86_64                                                                    6/17
  Verifying        : httpd-filesystem-2.4.37-16.module_el8.1.0+256+ae790463.noarch                                                         7/17
  Verifying        : httpd-tools-2.4.37-16.module_el8.1.0+256+ae790463.x86_64                                                              8/17
  Verifying        : mod_http2-1.11.3-3.module_el8.1.0+213+acce2796.x86_64                                                                 9/17
  Verifying        : nginx-filesystem-1:1.14.1-9.module_el8.0.0+184+e34fea82.noarch                                                       10/17
  Verifying        : php-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64                                                                      11/17
  Verifying        : php-cli-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64                                                                  12/17
  Verifying        : php-common-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64                                                               13/17
  Verifying        : php-fpm-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64                                                                  14/17
  Verifying        : php-mysqlnd-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64                                                              15/17
  Verifying        : php-pdo-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64                                                                  16/17
  Verifying        : mailcap-2.1.48-3.el8.noarch                                                                                          17/17

Installed:
  php-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64                         php-mysqlnd-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64              
  apr-util-bdb-1.6.1-6.el8.x86_64                                         apr-util-openssl-1.6.1-6.el8.x86_64                                  
  php-fpm-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64                     apr-1.6.3-9.el8.x86_64                                               
  apr-util-1.6.1-6.el8.x86_64                                             centos-logos-httpd-80.5-2.el8.noarch                                 
  httpd-2.4.37-16.module_el8.1.0+256+ae790463.x86_64                      httpd-filesystem-2.4.37-16.module_el8.1.0+256+ae790463.noarch        
  httpd-tools-2.4.37-16.module_el8.1.0+256+ae790463.x86_64                mod_http2-1.11.3-3.module_el8.1.0+213+acce2796.x86_64                
  nginx-filesystem-1:1.14.1-9.module_el8.0.0+184+e34fea82.noarch          php-cli-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64                  
  php-common-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64                  php-pdo-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64                  
  mailcap-2.1.48-3.el8.noarch                                           

Complete!


systemctl start httpd;systemctl enable httpd
systemctl stop firewalld; systemctl disable firewalld

vi /etc/php.ini

short_open_tag = On

systemctl restart httpd

#whitescreen

php index.php
PHP Fatal error:  Interface 'JsonSerializable' not found in /var/www/html/nextcloud/lib/private/L10N/L10NString.php on line 33
<div class="error error-wide">

yum install php-json





Internal Server Error

The server was unable to complete your request.

If this happens again, please send the technical details below to the server administrator.

More details can be found in the server log.
Technical details

    Remote Address: 192.168.1.1
    Request ID: XmvgGqSGy9gldimeYXhtgAAAAAA



chown apache.apache -R nextcloud/





    PHP module zip not installed.

    Please ask your server administrator to install the module.

    PHP module dom not installed.

    Please ask your server administrator to install the module.

    PHP module XMLWriter not installed.

    Please ask your server administrator to install the module.

    PHP module XMLReader not installed.

    Please ask your server administrator to install the module.

    PHP module libxml not installed.

    Please ask your server administrator to install the module.

    PHP module mbstring not installed.

    Please ask your server administrator to install the module.

    PHP module GD not installed.

    Please ask your server administrator to install the module.

    PHP module SimpleXML not installed.

    Please ask your server administrator to install the module.

    PHP modules have been installed, but they are still listed as missing?

    Please ask your server administrator to restart the web server.


yum install php-zip php-dom php-XMLWriter php-XMLReader php-libxml php-mbstring php-gd php-SimpleXML
Last metadata expiration check: 0:02:48 ago on Fri 13 Mar 2020 03:33:26 PM EDT.
No match for argument: php-XMLWriter
No match for argument: php-XMLReader
Package php-common-7.2.11-2.module_el8.1.0+209+03b9a8ff.x86_64 is already installed.
No match for argument: php-SimpleXML
Error: Unable to find a match: php-XMLWriter php-XMLReader php-SimpleXML


yum install php-zip php-dom php-xml php-libxml php-mbstring php-gd


systemctl enable mysqld;systemctl start mysqld


mysql> create database nextclouddb;
Query OK, 1 row affected (0.22 sec


mysql> CREATE USER nextclouduser@localhost IDENTIFIED by "somepass";
Query OK, 0 rows affected (0.20 sec)


mysql> grant all privileges on nextclouddb.* to nextclouduser@localhost;
Query OK, 0 rows affected (0.18 sec)


Gateway Timeout

The gateway did not receive a timely response from the upstream server or application.


nextadmin/somepass

This happens when upgrading to Apache 2.4 from 2.2 or just because you don't have the right permissions set which we'll get into.

You need this in the <Directory part of your vhost or httpd.conf

<Directory "/your/vhost/path.com>
Options FollowSymLinks
AllowOverride All
Require all granted


</Directory>

pip install PIL
ERROR: Could not find a version that satisfies the requirement PIL (from versions: none)
ERROR: No matching distribution found for PIL


The import name is PIL but the actual pip package is called "Pillow"

pip install Pillow

unable to connect to camera.  Camera has been disabled becaue of security policies or is being used by other apps

They say to do a factory reset but in some cases it doesn't work and the camera mysteriously just won't work so it appears to be a hardware error if that happens.

It's as simple as below where you just specify the dev device of the CDROM which is usually /dev/sr0.  You can boot actual bootable discs like Windows, Linux, etc straight from a physical drive this way.

sudo qemu-system-x86_64 -cdrom /dev/sr0 -m 4096
 

There are a few caveats that may not be obvious to everyone so I am going to cover them here but keep this in mind before starting.
 

Before starting install epel or you will be missing tesseract:

yum -y install epel-release

#1) When you specify your SSL certificate with a full path, it really needs to exist where you tell it to (including the default location of /etc/ssl/certs and /etc/ssl/certs/private).

Also note to make a cert there is a quick shell script in /etc/ssl/certs called "make-dummy-cert" that you can run to make the cert.

#2) server/hostname where you enter the fqdn of www.yourdomain.com is an actual vhost that gets created.  This means if you want the public to easily access the domain that you must control it and point it to your OpenProject server.

Here is where the vhost conf is and what it looks like (in case you want to change the vhost domain)

vi /etc/httpd/conf.d/openproject.conf


Include /etc/openproject/addons/apache2/includes/server/*.conf


  ServerName areebopenproject.com
  RewriteEngine On
  RewriteRule ^/?(.*) https://%{SERVER_NAME}:443/$1 [R,L]



  ServerName areebopenproject.com
  DocumentRoot /opt/openproject/public

  ProxyRequests off

  Include /etc/openproject/addons/apache2/includes/vhost/*.conf

  # Can't use Location block since it would overshadow all the other proxypass directives on CentOS
  ProxyPass / http://127.0.0.1:6000/ retry=0
  ProxyPassReverse / http://127.0.0.1:6000/


If not you can use your hosts file in linux or Windows to hardcode the IP to the FQDN.

Step - 1 Add Repo and install openproject:

wget -O /etc/yum.repos.d/openproject.repo https://dl.packager.io/srv/opf/openproject/stable/11/installer/el/7.repo

yum -y install openproject
openproject configure

*Note if the wget fails you are probably using an old repo so you will need to find the latest by visiting here:

https://docs.openproject.org/installation-and-operations/installation/packaged/#el-7

Step - 2 Curses Config

Note below that you are saying the cert is located exactly where the installer has it by default.

You can change it or leave it as is if you plan to copy the exact same cert there.

 The same issue goes for below, take a note of where the prviate key should be located.

Also note to make a cert there is a quick shell script in /etc/ssl/certs called "make-dummy-cert" that you can run to make the cert.

After that visit your domain to access OpenProject:

*Note that for a few minutes you may get this "Service Unavailable" message as OpenProject starts (this happens each time you start it such as after reboots).

The default login is admin/admin

If you've ever gotten errors like this the solution is simple, you need i386 enabled on your 64-bit install because wine depends on some 32-bit x86 libraries:

dpkg --add-architecture i386
apt update
apt install wine

After that it will install just fine.

apt install wine
Reading package lists... Done
Building dependency tree      
Reading state information... Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
 wine : Depends: wine1.6 but it is not going to be installed
E: Unable to correct problems, you have held broken packages.


apt install wine1.6
Reading package lists... Done
Building dependency tree      
Reading state information... Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
 wine1.6 : Depends: wine1.6-i386 (= 1:1.6.2-0ubuntu14.2) but it is not installable
           Recommends: cups-bsd but it is not going to be installed
           Recommends: gnome-exe-thumbnailer but it is not going to be installed or
                       kde-runtime but it is not going to be installed
           Recommends: fonts-droid but it is not installable
           Recommends: fonts-liberation but it is not going to be installed
           Recommends: ttf-mscorefonts-installer but it is not installable
           Recommends: fonts-horai-umefont but it is not going to be installed
           Recommends: fonts-unfonts-core but it is not going to be installed
           Recommends: ttf-wqy-microhei
           Recommends: winetricks but it is not going to be installed
           Recommends: xdg-utils but it is not going to be installed
E: Unable to correct problems, you have held broken packages.


root@geekspython:~# apt install wine1.4
Reading package lists... Done
Building dependency tree      
Reading state information... Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
 wine1.4 : Depends: wine1.6 but it is not going to be installed
E: Unable to correct problems, you have held broken packages.

 

This is sure simple if you follow the guide but it took a lot of hacking around to make this work on Debian/Ubuntu!
Now before you ask why bother running wine and python, the reason is because Python executables are NOT cross-platform.  If you run pyinstaller in Linux, that binary will only run on Linux and the same if you do it in Windows.  So it is preferable if you have a single environment that you can create Linux and Windows binaries from rather than running 2 separate ones.  The best way to do that is wine if you have the patience to make it work!

python 3.5 and up doesn't install properly in wine 2.4.  It doesn't even show the install button
#but it seems OK if you installed vcrun2015 and just click in the middle of the installer it seems to complete (if it doesn't complete and gives an error this is because you didn't install vcrun2015 with winetricks).

#1 Use Wine 2.4
apt install add-apt-repository
add-apt-repository ppa:wine/wine-builds
apt install --install-recommends winehq-devel

#2 Use winetricks (a newer one that what is available in the repo)
wget  https://raw.githubusercontent.com/Winetricks/winetricks/master/src/winetricks
./winetricks -q win10
./winetricks vcrun2015

#how to install like pip

wine python -m pip install pyinstaller

Some of the hacking around I did to figure this out: :)

err:module:import_dll Library api-ms-win-crt-runtime-l1-1-0.dll (which is needed by L"Z:\root\VCRUNTIME140.dll") not found
apt install winetricks
winetricks vcrun2015

winetricks vcrun2015
------------------------------------------------------
You are using a 64-bit WINEPREFIX. If you encounter problems, please retest in a clean 32-bit WINEPREFIX before reporting a bug.
------------------------------------------------------
Unknown arg vcrun2015
Usage: /usr/bin/winetricks [options] [command|verb|path-to-verb] ...
Executes given verbs.  Each verb installs an application or changes a setting.

##############


wget  https://raw.githubusercontent.com/Winetricks/winetricks/master/src/winetricks

bash winetricks vcrun2015
------------------------------------------------------
Running Wine/winetricks as root is highly discouraged. See https://wiki.winehq.org/FAQ#Should_I_run_Wine_as_root.3F
------------------------------------------------------
------------------------------------------------------
Your version of wine 1.6.2 is no longer supported upstream. You should upgrade to 4.x
------------------------------------------------------
^C^C------------------------------------------------------
WINEPREFIX INFO:
Drive C: total 24
drwxr-xr-x  6 root root 4096 Mar 25 00:29 .
drwxr-xr-x  4 root root 4096 Mar 25 14:56 ..
drwxr-xr-x  4 root root 4096 Mar 25 00:28 Program Files
drwxr-xr-x  4 root root 4096 Mar 25 00:29 Program Files (x86)
drwxr-xr-x  4 root root 4096 Mar 25 00:28 users
drwxr-xr-x 13 root root 4096 Mar 25 14:54 windows

Registry info:
/root/.wine/system.reg:#arch=win64
/root/.wine/user.reg:#arch=win64
/root/.wine/userdef.reg:#arch=win64
------------------------------------------------------
cat: /tmp/winetricks.82XQNcAN/early_wine.err.txt: No such file or directory
------------------------------------------------------
wine cmd.exe /c echo '%ProgramFiles%' returned empty string, error message ""
------------------------------------------------------




root@geekspython:~# bash winetricks vcrun2015
------------------------------------------------------
Running Wine/winetricks as root is highly discouraged. See https://wiki.winehq.org/FAQ#Should_I_run_Wine_as_root.3F
------------------------------------------------------
------------------------------------------------------
Your version of wine 1.6.2 is no longer supported upstream. You should upgrade to 4.x
------------------------------------------------------
------------------------------------------------------
You are using a 64-bit WINEPREFIX. Note that many verbs only install 32-bit versions of packages. If you encounter problems, please retest in a clean 32-bit WINEPREFIX before reporting a bug.
------------------------------------------------------
Using winetricks 20191224-next - sha256sum: 3a11b9c07e2d7f5b6c21a5e7ef35c70cbc9344bd9a8e068d74b34793dfee6484 with wine-1.6.2 and WINEARCH=win64
Executing w_do_call vcrun2015
------------------------------------------------------
You are using a 64-bit WINEPREFIX. Note that many verbs only install 32-bit versions of packages. If you encounter problems, please retest in a clean 32-bit WINEPREFIX before reporting a bug.
------------------------------------------------------
Executing load_vcrun2015
Executing mkdir -p /root/.cache/winetricks/vcrun2015
Executing cd /root/.cache/winetricks/vcrun2015
Downloading https://download.microsoft.com/download/9/3/F/93FCF1E7-E6A4-478B-96E7-D4B285925B00/vc_redist.x86.exe to /root/.cache/winetricks/vcrun2015
--2020-03-25 14:57:45--  https://download.microsoft.com/download/9/3/F/93FCF1E7-E6A4-478B-96E7-D4B285925B00/vc_redist.x86.exe
Resolving download.microsoft.com (download.microsoft.com)... 104.88.156.140, 2001:4958:304:288::e59, 2001:4958:304:290::e59
Connecting to download.microsoft.com (download.microsoft.com)|104.88.156.140|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 13767776 (13M) [application/octet-stream]
Saving to: 'vc_redist.x86.exe'

vc_redist.x86.exe                                           100%[=========================================================================================================================================>]  13.13M  11.2MB/s    in 1.2s   

2020-03-25 14:57:46 (11.2 MB/s) - 'vc_redist.x86.exe' saved [13767776/13767776]

Executing cd /root
------------------------------------------------------
Working around wine bug 37781
------------------------------------------------------
------------------------------------------------------
This may fail in non-XP mode, see https://bugs.winehq.org/show_bug.cgi?id=37781
------------------------------------------------------
Using native,builtin override for following DLLs: api-ms-win-crt-private-l1-1-0 api-ms-win-crt-conio-l1-1-0 api-ms-win-crt-heap-l1-1-0 api-ms-win-crt-locale-l1-1-0 api-ms-win-crt-math-l1-1-0 api-ms-win-crt-runtime-l1-1-0 api-ms-win-crt-stdio-l1-1-0 api-ms-win-crt-time-l1-1-0 atl140 concrt140 msvcp140 msvcr140 ucrtbase vcomp140 vcruntime140
Executing wine regedit C:windowsTempoverride-dll.reg
Executing wine64 regedit C:windowsTempoverride-dll.reg
ADD - HKLMSystemCurrentControlSetControlProductOptions ProductType 0 (null) WinNT 1
The operation completed successfully
Setting Windows version to winxp
Executing wine regedit C:windowsTempset-winver.reg
Executing wine64 regedit C:windowsTempset-winver.reg
------------------------------------------------------
Running /usr/bin/wineserver -w. This will hang until all wine processes in prefix=/root/.wine terminate
------------------------------------------------------
Executing cd /root/.cache/winetricks/vcrun2015
Executing wine vc_redist.x86.exe
fixme:heap:HeapSetInformation (nil) 1 (nil) 0
fixme:heap:HeapSetInformation (nil) 1 (nil) 0
fixme:ntdll:NtQueryInformationToken QueryInformationToken( ..., TokenElevation, ...) semi-stub
err:ole:CoInitializeEx Attempt to change threading model of this apartment from multi-threaded to apartment threaded
fixme:heap:HeapSetInformation (nil) 1 (nil) 0
fixme:heap:HeapSetInformation (nil) 1 (nil) 0
fixme:ntdll:NtQueryInformationToken QueryInformationToken( ..., TokenElevation, ...) semi-stub
err:ole:CoInitializeEx Attempt to change threading model of this apartment from multi-threaded to apartment threaded
fixme:advapi:DecryptFileW (L"C:\users\root\Temp\{74d0e5db-b326-4dae-a6b2-445b9de1836e}\", 00000000): stub


#

./winetricks vcrun2015
------------------------------------------------------
Running Wine/winetricks as root is highly discouraged. See https://wiki.winehq.org/FAQ#Should_I_run_Wine_as_root.3F
------------------------------------------------------
------------------------------------------------------
Your version of wine 1.6.2 is no longer supported upstream. You should upgrade to 4.x
------------------------------------------------------
------------------------------------------------------
You are using a 64-bit WINEPREFIX. Note that many verbs only install 32-bit versions of packages. If you encounter problems, please retest in a clean 32-bit WINEPREFIX before reporting a bug.
------------------------------------------------------
Using winetricks 20191224-next - sha256sum: 3a11b9c07e2d7f5b6c21a5e7ef35c70cbc9344bd9a8e068d74b34793dfee6484 with wine-1.6.2 and WINEARCH=win64
Executing w_do_call vcrun2015
------------------------------------------------------
You are using a 64-bit WINEPREFIX. Note that many verbs only install 32-bit versions of packages. If you encounter problems, please retest in a clean 32-bit WINEPREFIX before reporting a bug.
------------------------------------------------------
Executing load_vcrun2015
------------------------------------------------------
Working around wine bug 37781
------------------------------------------------------
------------------------------------------------------
This may fail in non-XP mode, see https://bugs.winehq.org/show_bug.cgi?id=37781
------------------------------------------------------
Using native,builtin override for following DLLs: api-ms-win-crt-private-l1-1-0 api-ms-win-crt-conio-l1-1-0 api-ms-win-crt-heap-l1-1-0 api-ms-win-crt-locale-l1-1-0 api-ms-win-crt-math-l1-1-0 api-ms-win-crt-runtime-l1-1-0 api-ms-win-crt-stdio-l1-1-0 api-ms-win-crt-time-l1-1-0 atl140 concrt140 msvcp140 msvcr140 ucrtbase vcomp140 vcruntime140
Executing wine regedit C:windowsTempoverride-dll.reg
Executing wine64 regedit C:windowsTempoverride-dll.reg
ADD - HKLMSystemCurrentControlSetControlProductOptions ProductType 0 (null) WinNT 1
The operation completed successfully
Setting Windows version to winxp
Executing wine regedit C:windowsTempset-winver.reg
Executing wine64 regedit C:windowsTempset-winver.reg
------------------------------------------------------
Running /usr/bin/wineserver -w. This will hang until all wine processes in prefix=/root/.wine terminate
------------------------------------------------------
Executing cd /root/.cache/winetricks/vcrun2015
Executing wine vc_redist.x86.exe
fixme:heap:HeapSetInformation (nil) 1 (nil) 0
fixme:heap:HeapSetInformation (nil) 1 (nil) 0
fixme:ntdll:NtQueryInformationToken QueryInformationToken( ..., TokenElevation, ...) semi-stub
err:ole:CoInitializeEx Attempt to change threading model of this apartment from multi-threaded to apartment threaded
fixme:heap:HeapSetInformation (nil) 1 (nil) 0
fixme:heap:HeapSetInformation (nil) 1 (nil) 0
fixme:ntdll:NtQueryInformationToken QueryInformationToken( ..., TokenElevation, ...) semi-stub
err:ole:CoInitializeEx Attempt to change threading model of this apartment from multi-threaded to apartment threaded
fixme:advapi:DecryptFileW (L"C:\users\root\Temp\{74d0e5db-b326-4dae-a6b2-445b9de1836e}\", 00000000): stub
------------------------------------------------------
Note: command wine vc_redist.x86.exe returned status 109. Aborting.
------------------------------------------------------


WINEPREFIX=$HOME/.wine-msxml-test WINEARCH=win32 ./winetricks -q vcrun2015


apt install software-properties-common
add-apt-repository ppa:wine/wine-builds
apt update
apt install --install-recommends winehq-devel

WINEPREFIX=$HOME/.wine-msxml-test WINEARCH=win32 ./winetricks -q vcrun2015
------------------------------------------------------
Running Wine/winetricks as root is highly discouraged. See https://wiki.winehq.org/FAQ#Should_I_run_Wine_as_root.3F
------------------------------------------------------
------------------------------------------------------
Your version of wine 2.4 is no longer supported upstream. You should upgrade to 4.x
------------------------------------------------------
Using winetricks 20191224-next - sha256sum: 3a11b9c07e2d7f5b6c21a5e7ef35c70cbc9344bd9a8e068d74b34793dfee6484 with wine-2.4 and WINEARCH=win32
Executing w_do_call vcrun2015
Executing load_vcrun2015
------------------------------------------------------
Working around wine bug 37781
------------------------------------------------------
------------------------------------------------------
This may fail in non-XP mode, see https://bugs.winehq.org/show_bug.cgi?id=37781
------------------------------------------------------
Using native,builtin override for following DLLs: api-ms-win-crt-private-l1-1-0 api-ms-win-crt-conio-l1-1-0 api-ms-win-crt-heap-l1-1-0 api-ms-win-crt-locale-l1-1-0 api-ms-win-crt-math-l1-1-0 api-ms-win-crt-runtime-l1-1-0 api-ms-win-crt-stdio-l1-1-0 api-ms-win-crt-time-l1-1-0 atl140 concrt140 msvcp140 msvcr140 ucrtbase vcomp140 vcruntime140
Executing wine regedit /S C:windowsTempoverride-dll.reg
Setting Windows version to winxp
Executing wine regedit /S C:windowsTempset-winver.reg
------------------------------------------------------
Running /usr/bin/wineserver -w. This will hang until all wine processes in prefix=/root/.wine-msxml-test terminate
------------------------------------------------------
Executing cd /root/.cache/winetricks/vcrun2015
Executing wine vc_redist.x86.exe /q
fixme:heap:RtlSetHeapInformation (nil) 1 (nil) 0 stub
fixme:heap:RtlSetHeapInformation (nil) 1 (nil) 0 stub
fixme:ntdll:NtQueryInformationToken QueryInformationToken( ..., TokenElevation, ...) semi-stub
err:ole:CoInitializeEx Attempt to change threading model of this apartment from multi-threaded to apartment threaded
fixme:heap:RtlSetHeapInformation (nil) 1 (nil) 0 stub
fixme:heap:RtlSetHeapInformation (nil) 1 (nil) 0 stub
fixme:ntdll:NtQueryInformationToken QueryInformationToken( ..., TokenElevation, ...) semi-stub
err:ole:CoInitializeEx Attempt to change threading model of this apartment from multi-threaded to apartment threaded
fixme:advapi:DecryptFileW (L"C:\users\root\Temp\{74d0e5db-b326-4dae-a6b2-445b9de1836e}\", 00000000): stub
fixme:shell:SHAutoComplete stub
fixme:advapi:DecryptFileW (L"C:\users\root\Temp\{74d0e5db-b326-4dae-a6b2-445b9de1836e}\", 00000000): stub
fixme:wuapi:automatic_updates_Pause
fixme:ntdll:NtLockFile I/O completion on lock not implemented yet
fixme:wuapi:automatic_updates_Resume


wine python.exe -m pip install pyinstaller
fixme:module:load_library unsupported flag(s) used (flags: 0x00000800)
fixme:module:load_library unsupported flag(s) used (flags: 0x00000800)
fixme:module:load_library unsupported flag(s) used (flags: 0x00000800)
fixme:ntdll:EtwEventRegister ({5eec90ab-c022-44b2-a5dd-fd716a222a15}, 0x100027f0, 0x10010030, 0x10010048) stub.
fixme:ntdll:EtwEventSetInformation (deadbeef, 2, 0x10002560, 43) stub
fixme:msvcrt:_configure_wide_argv (1) stub
fixme:msvcrt:_initialize_wide_environment stub
Z:rootpython.exe: No module named pip
fixme:ntdll:EtwEventUnregister (deadbeef) stub.


wget https://www.python.org/ftp/python/3.5.1/python-3.5.1.exe


apt-add-repository 'deb https://dl.winehq.org/wine-builds/ubuntu/ xenial main'
apt install winehq-devel






actually python3.4.4. works

wine pyinstaller
fixme:heap:RtlSetHeapInformation (nil) 1 (nil) 0 stub
PyInstaller requires at least Python 2.7 or 3.5+.
 

Install xvfb

apt install xvfb
Reading package lists... Done
Building dependency tree      
Reading state information... Done
The following additional packages will be installed:
  libxfont1 libxkbfile1 x11-xkb-utils xauth xfonts-base xfonts-encodings xfonts-utils xserver-common
The following NEW packages will be installed:
  libxfont1 libxkbfile1 x11-xkb-utils xauth xfonts-base xfonts-encodings xfonts-utils xserver-common
  xvfb
0 upgraded, 9 newly installed, 0 to remove and 0 not upgraded.
Need to get 7703 kB of archives.
After this operation, 13.6 MB of additional disk space will be used.
Do you want to continue? [Y/n] y
Get:1 http://archive.ubuntu.com/ubuntu xenial/main amd64 xauth amd64 1:1.0.9-1ubuntu2 [22.7 kB]
Get:2 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libxfont1 amd64 1:1.5.1-1ubuntu0.16.04.4 [95.0 kB]
Get:3 http://archive.ubuntu.com/ubuntu xenial/main amd64 libxkbfile1 amd64 1:1.0.9-0ubuntu1 [65.1 kB]
Get:4 http://archive.ubuntu.com/ubuntu xenial/main amd64 x11-xkb-utils amd64 7.7+2 [153 kB]
Get:5 http://archive.ubuntu.com/ubuntu xenial/main amd64 xfonts-encodings all 1:1.0.4-2 [573 kB]
Get:6 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 xfonts-utils amd64 1:7.7+3ubuntu0.16.04.2 [74.6 kB]
Get:7 http://archive.ubuntu.com/ubuntu xenial/main amd64 xfonts-base all 1:1.0.4+nmu1 [5914 kB]
Get:8 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 xserver-common all 2:1.18.4-0ubuntu0.8 [27.7 kB]
Get:9 http://archive.ubuntu.com/ubuntu xenial-updates/universe amd64 xvfb amd64 2:1.18.4-0ubuntu0.8 [777 kB]
Fetched 7703 kB in 1s (4446 kB/s)
Selecting previously unselected package xauth.
(Reading database ... 51038 files and directories currently installed.)
Preparing to unpack .../xauth_1%3a1.0.9-1ubuntu2_amd64.deb ...
Unpacking xauth (1:1.0.9-1ubuntu2) ...
Selecting previously unselected package libxfont1:amd64.
Preparing to unpack .../libxfont1_1%3a1.5.1-1ubuntu0.16.04.4_amd64.deb ...
Unpacking libxfont1:amd64 (1:1.5.1-1ubuntu0.16.04.4) ...
Selecting previously unselected package libxkbfile1:amd64.
Preparing to unpack .../libxkbfile1_1%3a1.0.9-0ubuntu1_amd64.deb ...
Unpacking libxkbfile1:amd64 (1:1.0.9-0ubuntu1) ...
Selecting previously unselected package x11-xkb-utils.
Preparing to unpack .../x11-xkb-utils_7.7+2_amd64.deb ...
Unpacking x11-xkb-utils (7.7+2) ...
Selecting previously unselected package xfonts-encodings.
Preparing to unpack .../xfonts-encodings_1%3a1.0.4-2_all.deb ...
Unpacking xfonts-encodings (1:1.0.4-2) ...
Selecting previously unselected package xfonts-utils.
Preparing to unpack .../xfonts-utils_1%3a7.7+3ubuntu0.16.04.2_amd64.deb ...
Unpacking xfonts-utils (1:7.7+3ubuntu0.16.04.2) ...
Selecting previously unselected package xfonts-base.
Preparing to unpack .../xfonts-base_1%3a1.0.4+nmu1_all.deb ...
Unpacking xfonts-base (1:1.0.4+nmu1) ...
Selecting previously unselected package xserver-common.
Preparing to unpack .../xserver-common_2%3a1.18.4-0ubuntu0.8_all.deb ...
Unpacking xserver-common (2:1.18.4-0ubuntu0.8) ...
Selecting previously unselected package xvfb.
Preparing to unpack .../xvfb_2%3a1.18.4-0ubuntu0.8_amd64.deb ...
Unpacking xvfb (2:1.18.4-0ubuntu0.8) ...
Processing triggers for man-db (2.7.5-1) ...
Processing triggers for libc-bin (2.23-0ubuntu11) ...
Processing triggers for fontconfig (2.11.94-0ubuntu1.1) ...
Setting up xauth (1:1.0.9-1ubuntu2) ...
Setting up libxfont1:amd64 (1:1.5.1-1ubuntu0.16.04.4) ...
Setting up libxkbfile1:amd64 (1:1.0.9-0ubuntu1) ...
Setting up x11-xkb-utils (7.7+2) ...
Setting up xfonts-encodings (1:1.0.4-2) ...
Setting up xfonts-utils (1:7.7+3ubuntu0.16.04.2) ...
Setting up xfonts-base (1:1.0.4+nmu1) ...
Setting up xserver-common (2:1.18.4-0ubuntu0.8) ...
Setting up xvfb (2:1.18.4-0ubuntu0.8) ...
Processing triggers for libc-bin (2.23-0ubuntu11) ...



Configure and run xvfb

First start the Xvfb server:

Xvfb&

Then use the xvfb-run command to start any program that needs graphical capabilities

xvfb-run someprogram