How to kill a docker swarm

Assign way more replicas than you have of memory on all nodes and watch the Swarm crash which can easily reproduce in a small VMfor testing. root@Deb11Docker01:~# docker ps CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAM........

nvidia cannot resume from sleep Comm: nvidia-sleep.sh Tainted: Linux Ubuntu Mint Debian

This seems to happen in many different drivers but it happened more often in newer versions such as 530 vs 525. Then nvidia-modeset goes to 100% There are many reports of this appearing since driver 4.70 and I can confirm I've seen this in various machines. https://forums.de........

How To Upgrade Debian 8,9,10 to Debian 12 Bookworm

Step 1.) Upgrade to Debian 11 first The process to go to Debian 12 is not as smooth as 11, when trying to upgrade from Debian 10. In fact, it doesn't work directly, so you'll first need to follow this guide to update to Debian 11, reboot and come back here if successful. Step 2.) Update sources.list Update your /etc/apt/sources.list like this: deb http://........

How To Setup Python3 in Ubuntu Docker Image for AI Deep Learning

The issue is that Docker images are stripped down, so many tools and even python3 is missing, so you'll have to build or update the actual image yourself. I assume you have started an image with something like this and that you have the Nvidia Toolkit installed (assuming you are using GPUs). If you're not using nvidia just remove --runtime=nvidia --gpus all. docker run -it --runtime=nvidia --gpus all ubuntu bash These works for most images li........

Linux How To Upgrade To The Latest Kernel Debian Mint Ubuntu

How to check what kernel version you have/currently running? uname -rm 5.4.0-91-generic x86_64 The above shows us that we are running 5.4.0-91-generic on the x86_64 architecture. The safest way is to stick with the same flavor eg if you're on generic, and say on kernel 5.4.0 then it makes sense to follow what is below. However, if you are migrating or dual booting between newer hardware (eg. you got a........

How to install and configure haproxy on Linux Ubuntu Debian

haproxy is one of the best known and widely used Open Source load balancers out there and a strong competitor to nginx. haproxy is used by many large sites per Wikipedia: HAProxy is used by a number of high-profile websites including GoDaddy, GitHub,........

debootstrap how to install Ubuntu, Mint, Debian install

In this example we install debian 10 with --variant=minbase which gives us a minimal/tiny install. Don't use variant if you want the full size install. mkdir /tmp/deb10files debootstrap --variant=minbase buster /tmp/deb10files/ Did you get an error? debootstrap --variant=minbase buster /home/theuser/VMs/deb10files/ You'll get this error if you make a directory in your home........

How To Restore Partition Table on Running Linux Mint Ubuntu Debian Machine

Here is an easy way to restore things if you have the starting point and size of each partition using fdisk: In this example we pretend that /dev/sda was wiped out, but the running system still has the info in /sys/class/block/sda Go into each partition and record the "start" and "size" hostdev@box /sys/class/block/sda/sda1 $ cat start 2048 hostdev@box /sys/class/block/sda/sd........

i915 nouveau Nvidia GPU not starting lightdm Xorg failing solution for Could not determine valid watermarks for inherited state

It may appear to be an Xorg or lightdm/gdm/mdm error but in reality for many users with this issue, it's a driver conflict and issue. I had a system that had two GPUs, an Intel and Nvidia GPU. The only thing that got it working was to remove the nouveau driver and blacklist it so it never came back, then the Intel GPU works fine without these issues. Solution sudo rmmod nouveau add nouveau/other driver to blacklist edit th........

br0: received packet on bond0 with own address as source address Linux Solution Mint Debian Redhat CentOS bridge bridging

A quick fix is to run this command: sudo brctl setageing br0 0 This causes the aging of the MAC address to time out immediately or in 0 seconds, which delete the entry frmo the FDB (Forwarding Database) and causes the error to go away. The default time is 300 seconds or 5 minutes. You can also add it under your br0 definition like this in /etc/network/interfaces to make it permanent and automatic: auto br........

How To Do Linux Network Bonding Teaming in Mint Debian Ubuntu

Bonding is an excellent way to get both increased redundancy and throughput. It is similar to the "Network Teaming" feature in Windows. There are a few different modes but we will use mode 6, I think it's the best of both worlds, as it is not just a failover, but it provides round robin, so you will get redundancy and load balancing. So if you have a 1G single port, you will have a combined throughput of 4G at this point. Just bear in mind that the true thr........

GlusterFS HowTo Tutorial For Distributed Storage in Docker, Kubernetes, LXC, KVM, Proxmox

This can be used on almost anything, since Gluster is a userspace tool, based on FUSE. This means that all Gluster appears as to any application is just a directory. Applications don't need specific support for Gluster, so long as you can tell the application to use a certain directory for storage. One application can be for redundant and scaled storage, including for within Docker and Kubernetes, LXC, Proxmox, OpenStack, etc or just your image/web/video files or even da........

How To Enable Linux Swapfile Instead of Partition Ubuntu Mint Debian Centos

This may be necessary if you have a VM or if for some reason you just want to be more efficient with your space and have the flexibility of changing your swap space at will. What we mean is the ability to use a "swap file" or similar to the Windows "pagefile" that normally resides on the root or c: partition of Windows. Here's all you have to do and then you to can have a single partiton with everything, including the swap file on the root partition if you........

Docker Tutorial HowTo Install Docker, Use and Create Docker Container Images Clustering Swarm Mode Monitoring Service Hosting Provider

The Best Docker Tutorial for Beginners We quickly explain the basic Docker concepts and show you how to do the most common tasks from starting your first container, to making custom images, a Docker Swarm Cluster Tutorial, docker compose and Docker buildfiles.........

Cisco Switch Howto Reset Password

This was done on a 2900 but applies to all the switches of the same era. Step 1 - Power Cycle and enter recovery mode If you have physical access you can power cycle and hold the mode button down for 15 seconds. After that the SYS light will flash on the switch and you will see the following screenshot. If you don't have physical access (eg. it is a datacenter swich over console only) then power cycle and hit "Ctrl+Pause/B........

apcupsd how to setup and monitor APC UPS units

It really seems limited in that it can mainly give you the things you would see on the physical unit such as load etc.. wget https://downloads.sourceforge.net/project/apcupsd/apcupsd%20-%20Stable/3.14.14/apcupsd-3.14.14.tar.gz?r=https%3A%2F%2Fsourceforge.net%2Fprojects%2Fapcupsd%2Ffiles%2Flatest%2Fdownload&ts=1598115866 tar -zxvf apcupsd-3.14.14.tar.gz cd apcupsd-3.14.14 [root@somebox apcupsd-3.14.14]# ./conf........

How To Get Started on Ubuntu with gpt-2 OpenAI Text Prediction

apt install software-properties-common add-apt-repository ppa:deadsnakes/ppa apt update apt install python3-pip apt install python3.7 curl gnupg python3.7-dev git ln -s /usr/bin/python3.7 /usr/bin/python3 pip3 install numpy keras_preprocessing curl https://bazel.build/bazel-release.pub.gpg | sudo apt-key add - echo "deb [arch=amd64] http://storage.googleapis.com/bazel-apt stable jdk1.8" | sudo tee /etc/apt/sources.list.d/bazel........

How To Install python 3.4 3.5 and up on Linux with wine - Working Solution

This is sure simple if you follow the guide but it took a lot of hacking around to make this work on Debian/Ubuntu! Now before you ask why bother running wine and python, the reason is because Python executables are NOT cross-platform. If you run pyinstaller in Linux, that binary will only run on Linux and the same if you do it in Windows. So it is preferable if you have a single environment that you can create Linux and Windows binaries from rather than running 2 separate........

Radeon R3 GPU on Debian Crashing

Occasionally my whole screen locks up and I cannot even swith to the console and I find this in my syslog: *-display description: VGA compatible controller product: Mullins [Radeon R3 Graphics] vendor: Advanced Micro Devices, Inc. [AMD/ATI] ........

Convert and install to LUKS Encrypted Drive Ubuntu 18.04 19.10 Linux Mint and Debian Based Linux

The reason for doing this is that the installer doesn't seem to work properly for LUKS and the server installer doesn't even support LUKS anymore. When you use the GUI install on Desktop for LUKS it won't boot and will just hang after you enter your password. So the only reliable way is to do it ourselves. 1.) Make a default minimal install of Ubuntu 2.) Have a secondary disk on the server or VM. 3.)........

CentOS 8 RHEL 8 Alma Linux Rocky Linux how to restart the network!

Yes you have that right, the network service in RHEL8 / CentOS 8 / Rocky Linux / Alma Linux no longer exists. So there is no more systemctl restart network You can restart NetworkManager but it doesn't have the same effect or ifup/ifdown on all interfaces. Generally if NetworkManager is installed you will want to restart it or it won't apply the settings from ifcfg. systemctl restart NetworkManager To repl........

CentOS 8 how to convert to a bootable mdadm RAID software array

The cool thing here is that we only need 1 drive to make a RAID 10 or RAID 1 array, we just tell the Linux mdadm utility that the other drive is "missing" and we can then add our original drive to the array after booting into our new RAID array. Step#1 Install tools we need yum -y install mdadm rsync Step #2 Create your partitions on the drive that will be our RAID array Here I assume it is /dev........

how to use ifplugd in Linux to execute a command or script when a NIC cable is unplugged or plugged in

It is fairly simple to use once you know how to use it. However, the tricky thing is that by default it doesn't seem to be active or listen on any interface on manually specified. How To Install ifplugd First we install ifplugd sudo apt install ifplugd Let's enable it on our desired device(s) vi /etc/default/ifplugd set this line as so:........

Linux Ubuntu Debian Centos How To Make a Bootable Windows 7, 8, 10, 2016, 2019 Server USB from ISO

Use fdisk on your USB drive to create a bootable NTFS partition (in my case /dev/sdb): sudo fdisk /dev/sdb Welcome to fdisk (util-linux 2.27.1). Changes will remain in memory only, until you decide to write them. Be careful before using the write command. Command (m for help): n Partition type p primary (0 primary, 0 extended, 4 free)........

python import docx error

sudo pip3 install python-docx [sudo] password for : Downloading/unpacking python-docx Downloading python-docx-0.8.10.tar.gz (5.5MB): 5.5MB downloaded Running setup.py (path:/tmp/pip_build_root/python-docx/setup.py) egg_info for package python-docx no previously-included directories found matching 'docs/.build' warning: no previously-included files matching '.DS_Store' foun........

Debian Ubuntu Mint Howto Create Bridge (br0)

Having a network bridge allows you to bridge traffic under multiple devices so they can talk natively without using any special routing, iptables/firewall or other trickery. To create your bridge you need the bridge-utils package for brctl and if you want to do things like bridge VMs that run on a tap device you will need the uml-utilities which provides "tunctl". 1.) Install the utilities to make our bridge sudo apt-get i........

ssh how to verify your host key / avoid MIM attacks

SSH helps keep us secure in many ways, one of those is the host-key fingerprint which is unique. If you have been connecting to an SSH server that you've made no changes to and suddenly ssh warns that the key doesn't match then you have a problem. But how about connecting to an existing server for the first time on a new machine or client? A lot of new clients calculate it using an SHA256 hash but it is not as easy on your host machine to produce the sam........

Cisco Unified Communications Manager 12 Install Errors on Proxmox/KVM

The strange thing is that usually the first install or two will work on any new machine but then it suddenly won't. I had this experience on QEMU 2.13 on a different machine. There is something finicky or buggy about the CUCM installer even when choosing the same virtual hardware specs. qemu-kvm command: /usr/libexec/qemu-kvm -version QEMU PC emulator version 0.12.1 (qemu-kvm-0.12.1.2-2.506.el6_10.1), Copyright (c) 2003-2008 Fabrice Bellard ........

How To Use Letsencrypt SSL/TLS Encryption to Create Certificates without installing on the target machine

For some reason, perhaps you don't want to run a daemon or let Letsencrypt have access to your production server. There is a way to use it like a normal CSR/CA setup in manual mode. ./letsencrypt-auto certonly --manual -d realtechtalk.com - www.realtechtalk.com Eventually you will get prompted to create a certain path and file with certain data: Create a file containing just this data: Casdfasfadsfsad........

Cisco Switch Setup Guide Command List

Enter configuration console: enable configure terminal This is important because if your console doesn't look like below none of the commands will work! Switch(config)# Save and Apply Settings wr Show Switch Configuration: show run Show Port List/Sta........

How To Boot Cisco CUCM UCSInstall 8.6, 10, 11 and 12 on KVM/Proxmox

The key thing is that you must use a "machine"id of "pc-1.3" or it will say your hardware is not supported. Additionally you MUST use a virtio disk or you will get a ks_pre.sh error as soon as the install starts (a look at logs will show it can't find a disk). This is funny because even though the OS finds the disk and an fdisk -l shows it, it looks like the script looks for a /dev/vda device (virtio) and nothing else, so if you didn't use Virtio as you........

VBOX VirtualBox How To Import Raw .img Disk File

What you need to do if you have taken a dd or real raw image dump of a hard disk: VBoxManage convertdd windows2019-eval-template.img windows2019.vdi --format VDI The .img is the raw dd dump and the .vdi is the output file. --format VDIspecifies to output to .vdi format If you are in a pinch you can always use qemu-kvm binary and manually specify the .img as your disk and i........

Proxmox Breaks Storage/LVM Backing If Killing QEMU-IMG

I tried to stop a qemu-img copy or clone and it broke everything. It was fine to "stop" it from the GUI but a process still persisted so I killed the relevant qemu-img and the kernel went crazy. It also may not have helped that I tried to lvremove a different volume (an unused disk). But either way it breaks LVM (you cannot even run lvdisplay) so a reboot is necessary. Jan 17 06:45:21 testserver kernel: [ 5680.439337] systemd-udevd D 0&nbs........

Linux partprobe/partx cannot access last and 4th partition

On a test machine Iwas never able to access to a newly created 4th partiton. As we can see there are dev devices for everything but the 4th partition. The normal "partprobe" or "kpartx" or kernel being told to rescan the block device didn't help (only a reboot did). fdisk -l /dev/sda Disk /dev/sda: 750.2 GB, 750156374016 bytes 255 heads, 63 sectors/track, 91201 cylinders Units........

hwloc-nox set CPU affinity in Linux

sudo apt-get install hwloc-nox Reading package lists... Done Building dependency tree Reading state information... Done The following NEW packages will be installed: hwloc-nox 0 upgraded, 1 newly installed, 0 to remove and 530 not upgraded. Need to get 151 kB of archives. After this operation, 453 kB of additional disk space will be used. Get:1 http://archive.ubuntu.com/ubunt........

gvfs mount in /run/user cannot be accessed or displayed wrong permissions Error: Location is already mounted

You get errors like below and see you have all question marks for the permissions if you go to /run/user/1000/gvfs If you try to access the mounted share such as anything mounted as gvfs like an SSH share in your file manager you may get an error like this. It generally means an interruption in communication or a fault with gvfsd has caused it. Solutio........

VMWare vSphere 6.7 Errors Solution 503 Service Unavailable (Failed to connect to endpoint:

503 Service Unavailable (Failed to connect to endpoint: [N7Vmacore4Http20NamedPipeServiceSpecE:0x00005556ba09c070] _serverNamespace = / action = Allow _pipeName =/var/run/vmware/vpxd-webserver-pipe) 503 Service Unavailable (Failed to connect to endpoint: [N7Vmacore4Http16LocalServiceSpecE:0x00007fd26000b240] _serverNamespace = /ui action = Allow _port = 5090) Errors like the above are usually because there is an issue with your vSphere or more commonly it i........

Debian/Ubuntu/Mint Linux How To Set VLAN in /etc/network/interfaces

You can find many ways to specify the VLANin your network configuration but Ifind this is the simplest and quickest. In this case we are talking about a bridged adapter "vmbr0" but it works even if you just had a normal non-bridged interface. The key here is that in vmbr0 you'll notice there is no IP address. We just specify "manual". Below it is a similar stanza for "vmbr0.58" in this case 58 represents the VLAN (change........

VMWare ESXi 6.7 SSH/PowerShell CLI Commands

[root@localhost:~] BootModuleConfig.sh echo host-ind nfcd........

VMWare Vsphere VCSA Graphical Install Creates json

yes it does create its own json ============================================ cat /tmp/vcsaUiInstaller/ovftool-20180809-175238948-20180809-175603497.log |grep -i json 2018-08-09T17:56:04.238-07:00 verbose OVFTool[30966] [Originator@6876 sub=Default] Manifest file entry: SHA1(VMware-vCenter-Server-Appliance-6.7.0.12000-8832884_OVF10-file1.json) = 1deb658c724767697587d5909c4051c01813e6a1 --> ........

Debian Mint Ubuntu compiling xmr-stak

sudo apt-get install libcurl4-openssl-dev git build-essential autotools-dev autoconf libcurl3 sudo apt-get install libcurl4-gnutls-dev git clone https://github.com/wolf9466/cpuminer-multi sudo apt-get install cmake libpthread-* libmicrohttpd-dev libssl-dev libhwloc-dev git clone https://github.com/fireice-uk/xmr-stak-cpu.git make install cd bin chmod +x xmr-stak-cpu ./xmr-stak -O xmr........

Linux Mint 18 Screen Goes Dark or Black After Screensaver or even when using the Desktop Solution

You can search for this bug and it seems like it may be related to ecryptfs and is many years old. The symptoms are that you return to the computer and the screensaver was active or the screen was asleep/black and it doesn't seem to come back. But you check by SSH the computer is running fine and are frustrated you'll lose your running programs and have to reboot. There is a simple solution: Ctrl + Alt + F1 Ctrl +Alt + F8 Ba........

How to qemu-kvm enable bridged networking in Debian Ubuntu Linux Mint on KVM containers

I've read a few guides about this but they didn't work for me. sudo apt-get install bridge-utils #don't think the above is enough it won't work still even though you have by default an /etc/qemu-ifup that handles it if you have the right tools and setup sudo qemu-system-x86_64 -net tap -net nic -enable-kvm -cpu host,vmx=on ~/VirtualBox VMs/vsphere-vcenter/vsphere-vcenter.vdi W: /etc/qemu-ifup: no bridge for guest interface foun........

Linux Mint Black Screen after boot no graphics solution

This is not the normal "black screen"issue and I was shocked to eventually find out why. The normal advice of reconfiguring Xorg didn't work. Even booting into "Recovery Mode" did not help. Here is the short end of the stick that fixed it: sudo apt-get install mdm mate-desktop-environment Yes you got it right, mdm and the mate-desktop-environment / gnome were somehow uninstalled. This must be whe........

ffmpeg trouble concatenating similar but different files

When things go wrong your video is basically unplayable or the first video plays fine and then freezes when moving on to the next. Generally if both videos weren't produced with the exact 100% same settings you will have issues. You can try the basic concat but it often won't work right. Solution for me: My example uses 3 videos in total so "n=3" and a=1 to include audio. ffmpeg -threads 12 -i file1.mp4 -........

ffmpeg Unable to Use Hardware Encoding with Nvidia 3.40 Driver and GT210 card

I believe from what I've read that this card's driver doesn't support the features after trying all known troubleshooting methods. ffmpeg -i uservideoRendered.mp4 -filter:v hwupload_cuda,scale_npp=w=1920:h=1080:format=nv12:interp_algo=lanczos,hwdownload -c:v hevc_nvenc -profile main -preset slow -rc vbr_hq -c:a copy uservideoRendered.mp4-test ffmpeg -i uservideoRendered.mp4 -filter:v hwupload_cuda,scale_npp=w=1920:h=1080:format=nv12:interp_algo=lanczos,hwdownload........

ffmpeg Linux Mint download, compile and install howto

#if you have nvidia make sure you install the nvidia-cuda-toolkit so hardware acceleration can be used wget http://ffmpeg.org/releases/ffmpeg-3.3.2.tar.bz2 tar -jxvf ffmpeg-3.3.2.tar.bz2 cd ffmpeg-3.3.2/ ./configure --disable-yasm install prefix /usr/local source path ........

Migrate Centos 7 from Single HDD to mdadm RAID 10 array:

Done on Centos 7.3 very important as clearly based on older guides it was a lot easier and more simpler! Hint do not use grub2-install! If you have trouble booting after this check this CentOS mdadm RAID booting/fixing guide. One huge caveat if you are an oldschool user or sysadmin who has avoided UEFIbooting The nor........

cudaminer freezes Linux Mint taints kernel

When running cudaminer once it tries to initialize the card the entire screen freezes. The computer itself is still running but the Xorg is done for, you cannot even switch to another console window and must reboot (even an mdm or Xorg restart does not help). At first cudaminer will give you these errors: stratrum_recv_line failed ...retry after 15 seconds GPU #0: Geforce 210 with compute ca........

Openshot 2.2 is very unstable always crashing in Linux Mint 18.1!

Jun 1 15:45:42 videoeditor-desktop org.mate.panel.applet.MintMenuAppletFactory[1882]: project_data:INFO Missing folder chosen by user: Jun 1 15:45:42 videoeditor-desktop org.mate.panel.applet.MintMenuAppletFactory[1882]: project_data:INFO Removed missing file: MAH02949.MP4 Jun 1 15:45:57 videoeditor-desktop org.mate.panel.applet.MintMenuAppletFactory[1882]: ui_util:WARNING Icon theme media-playback-start not found. Will use backup........

phpBB3 slow and internal dummy connection

Using Apache 2.2 and PHP5.6 PHPBB3 is very slow to respond. Actually for some reason it takes so long to even register a log entry in access_log as in several seconds or a few minutes later it shows up in Apache. All other vhosts and Apache access stops working and freezes until the request to access PHPBB3 slowly completes. It seems to randomly be slow if you stop using it whether for posting or reading the forums. I've migrated to different machines including........

Migrating from Linux Mint 17.2 mdadm RAID array to a new one (because I upgraded to larger drives).

1.) Replicate the number of partitions in your new drives. gdisk /dev/sda gdisk /dev/sdb I created 3 partitions of the same same size. partition #1: +1G (/boot) partition #2: +60G (swap) partition #3: rest of it (/) #note if you are using GPT/gdisk you need to create separate a partition at least 1MB in size (in my case I would a 4th partition and mark it type ef02).........

mdadm frozen and doesn't realize array is dead/missing failed due to unplugged drives

This was a surprising bug but I unplugged all drives for an array md127. At first it was just 1 drive and mdadm seemed to notice this. I unplugged the second drive taking the array offline but mdadm did not realize it was offline and still showed a non-existent disk as being part of it. This created problems trying to unmount it or even to stop this array with mdadm freezing. As for how to fix it I can only think of making sure you are not in a mounted path of........

PYCURL ERROR 22 - The requested URL returned error: 404 Not Found Solution

# yum -y install qemu-kvm Loaded plugins: fastestmirror Setting up Install Process Loading mirror speeds from cached hostfile * base: mirror.lzu.edu.cn * elrepo: ftp.utexas.edu * epel: ftp.jaist.ac.jp * extras: mirrors.aliyun.com * openvz-kernel-rhel6: mirror.fdcservers.net * openvz-utils: mirror.fdcservers.net * updates: mirrors.nwsuaf.edu.cn Resolving Dependencies........

fdisk wq causes hung process

I created a new partition table on a newly plugged in device and it caused fdisk to hang (even force kill does not work). It also may be a bad drive or some other issue because fdisk -l hangs after the first 2 HDDs (totaly of 8 HDDs on this system): [1232879.903596] INFO: task fdisk:27176 blocked for more than 120 seconds. [1232879.903607] Tainted: P&nbs........

remove gpt partition linux

sudo fdisk /dev/sdh WARNING: GPT (GUID Partition Table) detected on '/dev/sdh'! The util fdisk doesn't support GPT. Use GNU Parted. WARNING: The size of this disk is 8.0 TB (8001563221504 bytes). DOS partition table format can not be used on drives for volumes larger than (2199023255040 bytes) for 512-byte sectors. Use parted(1) and GUID partition table format (GPT). The device presents a l........

OpenVZ Solution CPT ERR: c02fa000,73 :CPT: lock fd is closed incorrectly: 1 and vps-net_add ERROR: Unable to add route ip route add 192.168.5.2 dev venet0

The only solution after trying many suggestions was to simply restart the "vz" service (definitely not preferable). Even doing an ifdown and ifup for venet0 did not help. ifup venet0 Bringing up interface venet0: Configuring interface venet0: net.ipv4.conf.venet0.send_redirects = 0 RTNETLINK answers: Network is down Some errors from log: CPT ERR: d2dc60........

Linux How To Recover Partition Table from Kernel and Restore Centos/Debian etc..

We've all done this at some point, you work on the wrong shell window and this was my first time making this mistake but I deleted a partition table in fdisk, recreated it and saved it with "wq" and even ran partprobe! If you haven't rebooted yet then you can still recover your partition table, otherwise you're in big trouble. Fortunately since it was a live system and in use the kernel still had to use the old table like below:........

blocked for more than 120 seconds issues with iowait and timeout on Live Linux distribution while writing to physical disk

This happened while an mdadm array was syncing, all access from writing a new blank file to opening a small .txt file was very slow: [222117.312078] kjournald starting. Commit interval 5 seconds [222117.685060] EXT3-fs (md0): using internal journal [222117.685096] EXT3-fs (md0): mounted filesystem with ordered data mode [222122.376847] kjournald starting. Commit interval 5 seconds [222122.602825] EXT3-fs (md2): using internal jour........

Is this partition table correct starting and ending partition on same cylinder?

Device Boot Start End Blocks Id System /dev/sdc1 1 132 1060256+ fd Linux raid autodetect Partition 1 does not end on cylinder boundary. Partition 1 does not start........

Centos installing grub problems suspect gpt problem

grub> root (hd0,0) root (hd0,0) Filesystem type is ext2fs, partition type 0xfd grub> setup (hd0) setup (hd0) But if you do: root (hd1,0) setup (hd1) it does work, I think hd0/sda had a GPT partition that was not removed properly (what I did was just dd bs=512 count=1 the partition table from another drive since the partition table should be identical). Checking if "/boot/grub/........

How to manually mount Linux disk image partition without using losetup

In this case we want to mount partition #2 fdisk -lu Centos-6.6-x86_64.img You must set cylinders. You can do this from the extra functions menu. Disk Centos-6.6-x86_64.img: 0 MB, 0 bytes 255 heads, 63 sectors/track, 0 cylinders, total 0 sectors Units = sectors of 1 * 512 = 512 bytes Device Boot&nbs........

bash script Get Model and Serial Number of All Hard Disks in Server on Linux

for disk in `fdisk -l|grep "Disk /dev"|awk '{print $2}'|sed s/://g`; do echo "$disk" && smartctl -d ata -a "$disk" -T permissive|grep -iE 'Device Model:|Serial Number:' echo "---------------" done *Make sure you have smartctl from smartmon tools installed Sample output: /dev/sdc Device Model: ........

Centos 6 how to guide convert LVM non-RAID into mdadm 1/10 RAID array live without reinstalling

Here is the scenario you or a client have a remote machine that was installed as a standard/default minimal Centos 6.x machine on a single disk with LVM for whatever reason. Often many people do not know how to install it to a RAID array so it is common to have this problem and why reinstall if you don't need to? In some cases on a remote system you can't easily reinstall without physical or KVM access. So in this case you add a second physical or disk or already ha........

openvz yum problem Centos 6.5 cannot find file on mirror:

#solution Edit /etc/yum.repos.d/openvz.repo For the first two entries comment out #mirrorlist and uncomment #baseurl and then it worked openvz yum problem Centos 6.5 cannot find file on mirror: yum update Loaded plugins: fastestmirror Determining fastest mirrors * openvz-kernel-rhel6: mirrors.ustc.edu.cn * openvz-utils: mirrors.ustc.edu.cn base ........

HP Procurve Switch 2824 CLI Telnet Experience , Guide and Tutorial

------------------------------------- ProCurve J4903A Switch 2824 Software revision I.10.77 Copyright (C) 1991-2009 Hewlett-Packard Co. All Rights Reserved. RESTRICTED RIGHTS LEGEND Use, duplication, or disclosure by the Government is subject to restrictions........

KVM: unknown exit, hardware reason 0x80000021 kvm_run returned -22 solution

If the below is happening on KVM (a very weird and scary looking error) it's probably because of Windows. This has happened countless times to me where the bootsector on Windows 7/2008 becomes corrupted easily (even by a crash or shutdown). KVM: unknown exit, hardware reason 0x80000021 kvm_run returned -22 rax 0000000000000010 rbx 0000000000000080 rcx 0000000000000000 rdx 0000000000000080 rsi 000000000025db2a rdi 000000000007db2a rsp 0000000000000200 rbp........

Vbox/Virtualbox devices grayed out for non-root user solution

It is a permissions issue that is hard to fix. All but one USB device is greyed out. I am already a member of "vboxusers" I have already enabled and disabled USB support for the guest. I have already reinstalled the latest VBOx guest editions If running as root it all works fine Changing........

How to script fdisk in Linux bash

(echo n; echo p; echo 1; echo 1; echo; echo wq) | fdisk /dev/sdb The above would make a new partition 1 on /dev/sdb and save the changes to disk, you can of course make changes to do almost anything in fdisk.........

Howto Convert Xen Image to KVM

#count=10000 makes an image of 10000MB make sure your image is at least the same as your existing dd if=/dev/zero of=yourimage.img bs=1M count=10000 # losetup -fv newimage.raw # fdisk -cu /dev/loop0 # kpartx -a /dev/loop0 # dd if= of=/dev/mapper/loop0p1 # e2fsck -f /dev/mapper/loop0p1 # resize2fs /dev/mapper/loop0p1 # a lot of guides tell you to edit /etc/fst........

How to view GPT/EFI Windows Partition Table

fdisk unfortunately can't do this and I'm not sure if there's any updated version that handles it but parted can do it. Here's an example of how to do it: parted /dev/sda print 1 17.4kB 1024MB 1024MB ntfs primary 2 1024MB 16144MB 15120MB ntfs primary /dev/sda1 would be the first partiton /dev/sda2 would be the second partition You can then just access them like any other normal partition.........

Migrate Linux Mint OS from one drive to another

mount -o bind /proc /sda2/proc mount -o bind /dev/ /sda2/dev mount -o bind /sys /sda2/sys chroot /sda2 mint / # mount -o bind /proc /sda2/proc mint / # mount -o bind /dev/ /sda2/dev mint / # mount -o bind /sys /sda2/sys mint / # chroot /sda2 mint / # cd ~ mint ~ # ls Desktop mint ~ # cd / mint / # ls bin Desktop dev-temp home&nb........

Dell FS12-NV7 2U Server Information and Guide

I've got one of these for testing projects from work at home and got more than I bargained for with the time I've spent on it due to the storage handing/Perc 6/i cards. My particular model came with the following: 2U Rack Mount Server with Rails 2xOpteron 2373 EE (Quad Core, there is a 6-core version that can be found at times) 16GB RAM 2 x 250GB Seagate SATA 2 x Dell Perc 6/i (horrible and a nightmare to work........

Dell Perc 6/i SATA benchmarks without battery

The results are not bad, the Hitachi performs the same as it does in a SATA2 motherboard. However, the 2TB is much different, on a similar 2TB Toshiba I get about 198MB/s on a different motherboard vs the 2TB Hitachi which should produce similar results. This Dell Perc 6/i is on a PCI x8 riser card and is connected to a 12-port backplane. Adapter #0 Enclosure Device ID: 32 Slot Number: 0 Enclosure position: N/A De........

LSI MegaRAID Adventures, Guide and HowTo

LSi Megaraid At first it was configured as a RAID 0, then I deleted the Virtual Disk Group. I thought both drives would be shown and detected in Linux as sda and sdb but it actually shows nothing. To make them work you have to hit Ctrl+R before the system boots (when prompted) and create a Virtual Disk Group. In my case I created each one as RAID 0 (with a single drive only) as I just wanted JBOD but there is no such option or default in these Dell Pe........

pxe-32 tftp open timeout

pxe-32 tftp open timeout The solution was to enable tftp in xinetd with "chkconfig tftp on". See the troubleshooting below: chkconfig --list NetworkManager 0:off 1:off 2:off 3:off 4:off 5:off 6:off acpid 0:off&n........

stat=Deferred: 451-Non-existent domain mailserver.com

Jul 11 15:20:58 tor sendmail[9617]: r6AKjOD07: to= mailserver.com was the hostname of the server, sendmail sends this by default and many mailservers will reject mail to a hostname that does not resolve or exist. The easiest way is just to change the hostname and make sure it does resolve to something. I read there is a way in sendmail.mc to manually set a hostname but I never got it working: vi /etc/mail/sendmail.mc define(`confDOMAIN........

Bad Hard Drive Slows Down Computer

Here's a proven example of what a bad hard drive can do, it was technically functioning OKin a RAID array but the system became extremely low and the load become high and IOWAIT was even higher and I always thought it was a bad application. The truth is that this failing 1TBHitachi has slowly gotten worse and caused huge slowdowns, (eg. 100% load on Thunderbird waiting for e-mails to load etc..). After swapping it out, tabs change instantly, emails are not lagged, and........

kvm cannot boot xen guest using lvm

This booting error is because the Xen PV guest image uses the Xen kernel, this is not compatible with anything but a host running a Xen kernel. I did a kpartx -av virtual.img and then it created some partitions that showed up in fdisk. I mounted it and did a chroot into it and removed the xen kernel and installed a normal kernel but Xen still shows the same kernel in Grub (only the Xen one). This is strange but it seems like this Xen PV guest has some sort of hidden or........

mdadm: /dev/sdb1 not large enough to join array solution

mdadm --manage /dev/md1 --add /dev/sdb1 mdadm: metadata format 00.90 unknown, ignored. mdadm: metadata format 00.90 unknown, ignored. mdadm: metadata format 00.90 unknown, ignored. mdadm: /dev/sdb1 not large enough to join array md1's first primary member /dev/sda3 has 57394 cylinders while the /dev/sdb1 has 57393 (1 less cylinder) which is why it won't work. fdisk -l /dev/sda3 Disk /dev/sda3: 47........

Samsung Galaxy Note Upgrade to ICS 4.0 microSDHC card not detected/dataloss after upgrading - possible solutions

I backed up everything in the /mnt/sd_card directory thinking that some dataloss could occur for some reason but purposely left my microSDHC unbacked up thinking that "it won't touch that since it's external" and Samsung's and other manufacturers website even say this (that it won't be affected and not to worry etc). Apparently I was wrong, my microSD was "undetected" and asked to be formatted after the upgrade (there goes 3-months worth of family photos). No........

MySQL Authentication fails after Upgrade to Version 5.5

ERROR 1045 (28000): Access denied for user 'contentmanager'@'localhost' (using password: YES) For fun I thought I'd reset the password: GRANT ALL ON thecontent.* TO contentmanager IDENTIFIED by 'dfdfsdfdsfsdfsd'; ERROR 1470 (HY000): String 'contentmanager' is too long for user name (should be no longer than 16) This is ridiculous that this new version has some bizarre 16 character username limit and not only that but i........

KVM QEMU and Xen how to mount disk images off-line and access data

fdisk -lu VPS.img last_lba(): I don't know how to handle files with mode 81ed You must set cylinders. You can do this from the extra functions menu. Disk VPS.img: 0 MB, 0 bytes 255 heads, 63 sectors/track, 0 cylinders, total 0 sectors Units = sectors of 1 * 512 = 512 bytes Device Boot Start End ........

Linux Out of Memory OOM Object Killer Solution "Out of memory: kill process 1955 (sshd) score 81 or a child"

I had a system running a 128MB live CD image with 2.8 gigs of available RAM and the OOM kernel killer went crazy when using dd for more than 8 minutes and kept killing everything. I've read that this is due to a low-memory issue and paging in the kernel and 32-bit systems with lots of RAM. I even enabled swapspace on my LiveCD and the issue happened 25 minutes into dd rather than 8 minutes, so what gives? Also no swap space was ever used! cat /proc/s........

How To Test If Your Hard Drive Is Good/Signs of dying hard drive

I like dd, although it only reads it, usually a read test of the entire disk will uncover if your hard drive is bad in some parts. This is a good thing to do at least once a month, a lot of times bizarre program behavior, laginess and crashing/unnmounting problems etc.. are due to a failing disc and SMART won't know it or indicate a problem: We must also remember there's never a guarantee, I've found that ever since we moved to larger and more platters per drive with 1TB drives........

Centos Solution to "Warning: Unable to open /dev/fd0 read-write (Read-only file system). /dev/fd0 has been opened read-only."

Warning: Unable to open /dev/fd0 read-write (Read-only file system). /dev/fd0 has been opened read-only. That's a very annoying error, it's simply because Centos for some reason thinks it's wise to load the "floppy" kernel module, who has a floppy drive? I haven't seen or used a floppy for over 12 years! It's more than just annoying, if you probe the drives attached to your system, eg. with grub or partprobe, it keeps trying to locate a flopp........

GRUB Solution to error "Error 6: Mismatched or corrupt version of stage1/stage2"

GNU GRUB version 0.97 (640K lower / 3072K upper memory) [ Minimal BASH-like line editing is supported. For the first word, TAB lists possible command completions. Anywhere else TAB lists the possible completions of a device/filename.] grub> root (hd1,0) Filesystem type is ext2fs, partition type 0xfd grub> setup........

CPU #1 not responding - cannot use it.

I think this will be useful to others because I have a server that kept crashing mysteriously during intense disk usage/RAID checks. It would only crash during the weekly RAID integrity check. ThenI noticed during a reboot that not all CPUs were being brought up, as a result this actually creates much higher temperatures with the output I got from sensors, just booting the system produced higher than normal temperatures. You can imagine that a full blown RAID check........

updatedb/mdadm caused a kernel panic?

Jan 16 04:02:03 centosbox syslogd 1.4.1: restart. Jan 16 04:07:34 centosbox kernel: INFO: task updatedb:20771 blocked for more than 300 seconds. Jan 16 04:07:34 centosbox kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Jan 16 04:07:34 centosbox kernel: updatedb D F78BE050 6476 20771 20766&n........

Ubuntu 9.04 Crash

CPU/Kernel/MB/RAID problem? Jan 5 12:45:05 testbox kernel: [653298.890004] BUG: soft lockup - CPU#0 stuck for 61s! [hal-acl-tool:4168] Jan 5 12:45:05 testbox kernel: [653298.890005] Modules linked in: vmnet vmci vmmon binfmt_misc drbd video output input_polldev ocfs2_stackglue ocfs2_dlmfs ocfs2_dlm ocfs2_nodemanager configfs k8temp hwmon_vid lp snd_hda_intel snd_pcm_oss snd_mixer_oss snd_pcm snd_seq_dummy snd_seq_oss snd_seq_midi snd_rawmidi........

Ubuntu/Debian DRBD 8.0 Setup Guide

I've only used it on Centos, soI thought I'd make a quick Debian guide: Install the DRBD Package apt-get install drbd8-utils Reading package lists... Done Building dependency tree Reading state information... Done The following packages were automatically installed and are no longer required: libswfdec-0.8-0 Use 'apt-get autoremove' to remove them. The following........

mdadm RAID 1 adventures

I separated the 2 drives in the RAID 1 array. 1 is the old one /dev/sda and is out of date, while the separated other one /dev/sdc was in another drive and mounted and used with more data (updated). I wonder how mdadm will handle this: usb-storage: device scan complete md: md127 stopped. md: bind md: md127: raid array is not clean -- starting background reconstruction raid1: raid set md127 active with 1 out of 2 m........

Wine stopped working/won't work Solution

After an upgrade wine wouldn't open anything, not even the pre-installed notepad. There are no wine logs and nothing is mentioned in any standard log file about why. I finally decided to run wine from the shell and see what's going on: wine client error:0: version mismatch 398/402. Your wineserver binary was not upgraded correctly, or you have an older one somewhere in your PATH. Or maybe the wrong wineserver is still running?........

Buffer I/O error on device fd0, logical block 0

Virtually no system has a floppy disk drive anymore but you will often find your Linux distribution insists that you do or should have one :) The solution is to remove the floppy module and prevent it from loading on the next reboot. rmmod floppy Centos/RHEL echo "blacklist floppy">> /etc/modprobe.d/blacklist #update initramfs so it takes effect dracut........

Openvz Error Starting OpenVZ: failed to load module vzmon [FAILED]

service vz start Starting OpenVZ: failed to load module vzmon [FAILED] vzmon: Unknown symbol ve_snmp_proc_init vzmon: Unknown symbol addrconf_sysctl_free vzmon: Unknown symbol ve_ndisc_init vzmon: Unknown symbol addrconf_ifdown vzmon: Unknown symbol ip6_frag_cleanup vzmon: Unknown symbol fini_ve_route6........

OpenVZ: failed to load module vzmon [FAILED] vzmon: Unknown symbol ve_snmp_proc_init vzmon: Unknown symbol addrconf_sysctl_free vzmon: Unknown symbol ve_ndisc_init vzmon: Unknown symbol addrconf_ifdown vzmon: Unknown symbol ip6_frag_cleanup vzm

DRBD WFConnection Problem/Solution

This has stumped me a few times because I keep forgetting that Centos 5.5 comes with a default iptables configuration that ends up blocking DRBD traffic,I tried all the normal things and couldn't understand why I couldn't make my normal DRBD config work. So if you have WFConnection problems and have tried the normal "mailing list" fixes, check your firewall status first! Both Nodes Say the Following: version: 8.3.8 (api:88/prot........

Realtek r8169 1gbit/1000mbit NIC/Ethernet Goes Down/Halts on Large File Transfer/Heavy Network Usage

This is obviously a bug in the r8169 kernel module and it seems to affect a lot of people. I upgraded to the latest kernel and hope this won't happen anymore, as it is a very serious error. This is especially serious for those who are running servers with this chipset, who can afford for the NIC to randomly go off-line for no apparent reason? [655548.189113] type=1505 audit(1277067560.902:5): operation="profile_load" name="/usr/bin/freshclam&q........

Install Mac OS X 10.4.6 Tiger on AMD32 VMWare

*Note OS X is strange to install, I thought my HDD was not being detected by you just have to go to Diskutil and create a partition for the root filesystem and then close/move the Window and proceed with the install. After install Mac OS X 10.4.6 Tiger I get a black screen that says: b0 error Most people say the partition has to be marked as "active", actually that just means marked as "bootable". Instead of t........

Unixbench Score on Core i5 750 with OpenVZ Kernel vs Xen/Openvz

This was unbelievable how much the Xen kernel slows things down, keep in mind both tests were done on the hostnode, one was with the Openvz-Xen hybrid kernel and the other was just OpenVZ. You can see the performance difference is nearly 300% better when not using the Xen kernel. OpenVZ-Xen Kernel Test Results (I was wondering what was wrong/so slow with my Core i5!) # # # # # #&n........

Convert HDD/Hard Drive Partition(s) into non-RAID into RAID 1 using existing data without data loss and without reformatting.

Before we start I take no responsibility for this, you should have a backup and if you make a mistake during this process you could wipe out all of your data. So backup somewhere else before starting this as a precaution, or make sure it's data you could afford to lose. The RAID 1 Setup (Hardware Wise) I've already setup my 2 x 1TB (Seagate) drives with identical partitions, make sure your new hard drive (the empty one) is setup like your curr........

Picking an FTPD (vsftpd) Server in Linux Centos/Debian

I decided on using yum to help me decide even though I normaly use proftpd I decided to see what else I could find. yum search ftp Loaded plugins: fastestmirror Loading mirror speeds from cached hostfile * rpmforge: ftp-stud.fht-esslingen.de * base: mirrors.netdna.com * updates: updates.interworx.info * addons: yum.singlehop.com * extras: mirrors.netdna.com rpmforge........

ntfs-3g Error/Fix/Solution - Unexpected sectors per cluster value (127). Failed to mount '/dev/sda1': Invalid argument The device '/dev/sda1' doesn't seem to have a valid NTFS. Maybe the wrong device is used? Or the whole disk instead of a

./ntfs-3g /dev/sda1 /mnt -o force Unexpected sectors per cluster value (127). Failed to mount '/dev/sda1': Invalid argument The device '/dev/sda1' doesn't seem to have a valid NTFS. Maybe the wrong device is used? Or the whole disk instead of a partition (e.g. /dev/sda, not /dev/sda1)? Or the other way around? This is happening on a system I've come across an HP 6930P running Windows XP Professional. The partition appears to be very norm........

Compaq V2405CA Laptop - Unixbench Performance Test

Here are the results, it is Sempron 3000+ AMD Mobile, 500Gig HDD, 512MB RAM with shared ATI Radeon graphics. # # # # # # # ##### ###### # # #### # # # # ## # # # #&nb........

PHP cannot access /usr/bin/openssl

PHP cannot access /usr/bin/opensslI have verified the username that runs the process is able to access /usr/bin/openssl and it does exist but the PHP script is saying it doesn't exist: [code:1:1fd0f3abbe] if (!file_exists($OPENSSL)) { //echo "ERROR: OPENSSL $OPENSSL not foundn"; }[/code:1:1fd0f3abbe] I don't get itI can clearly see the contents of /usr/bin by using the PHP system fu........

Asterisk FreeBSD compile problems

Asterisk FreeBSD compile problemsI couldn't get it to compile without using the following options at compile time: [b:b7d672ee28] make install WITHOUT_ZAPTEL=YES WITHOUT_MYSQL=YES WITHOUT_FAX=YES WITHOUT_ODBC=YES WITHOUT_H323=YES[/b:b7d672ee28]Some problems you might have with copying over your Linux config files to FreeBSD is different paths. [b:f044931f41]For example the etc path for Asterisk on BSD will now be:[/b:f044931f41] [qu........

REMOVE a field

REMOVE a field[quote:effdb203d8]ALTER TABLE table_name DROP field_name[/quote:effdb203d8]........

Clustering Links

Clustering LinksI thought this might be interesting for people with spare time. [b:6423c19973]Great clustering article from Linux Mag[/b:6423c19973] http://www.linux-mag.com/2003-11/clusters_01.html [b:6423c19973]General Linux cluster information[/b:6423c19973] http://www.gdargaud.net/Hack/ClusterNotes.html#HighA http://www.faqs.org/docs/Linux-HOWTO/Cluster-HOWTO.html#s3 http://www.yolinux.com/TUTORIALS/LinuxClustersAndFileSys........

Tyan S2735-8M Maximum Hard Drive Limit/Not Working/Doesn't work with 1TB 1000GB hard drives

Inever saved any of the logs, but basically no matter what OS (Linux)I used, I could not get my 1000GB hard drive to work (Seagate SATA). The BIOS recognizes the drive and fdisk -l shows the hard drive as it should. The tricky thing is that different OS's will give you different results, but don't be fooled. You can't use these larger drives for long. Iwas getting all kinds of seek/IOerrors and also messages that the port could not be read.........

SSH Server Slow/Lagged/Delayed Login Response

This is really something the SSHServer developers should consider. The cause of this annoyance is because of failed DNS lookups on your IPaddress, which is especially common for many dedicated/col-located servers and also computers on internal NAT/private networks. The chances are this is the cause of your SSHSlow/Delayed Login problems. The easy solution to SSH Login Problems Edit /etc/ssh/sshd_config Add this line to disable r........

Viewing and Connecting to an SMB Samba Share on Windows/Linux/Unix

This will give you the basic info needed to browse and connect to Samba shares from the command line. From the GUI of Gnome or KDE etc, it is pretty standard and straight forward. However, I've found very little guides on how to do it from the command line and if you're like me, a nerd who prefers command line for its simplicity and for remote use, this is the way to go. First get a list of all the Samba/SMB shares on the target. smbclient -L hostname........