How to combine .txt ACLs without breaking things

I've come across a lot of RBLs and blocklists that sometimes have an instance of weird formatting whether that is missing a newline character or having an extra "space" at the end of the IP.  This can break a lot of daemons and firewalls.

Here is my safe way of trying to concatenate lists:

cat somelist.txt sed s/" "//g|sed -e '$a\' >> updatedlist.txt

The first sed removes any spaces which is more common than you think since they are invisible in the Linux terminal with default settings.  The second sed adds a newline character when adding if the end of the file didn't have one.  If the end of the existing file due to the previous ACL/txt formatting then you would combine your last line of updatedlist.txt with the first line of somelist.txt which obviously will either not do what you want for that entry or at worst, will break your firewall/ACL/daemon which won't be able to parse two IP blocks on one line.

 


Tags:

combine, txt, acls, thingsi, ve, rbls, blocklists, formatting, newline, quot, ip, daemons, firewalls, concatenate, lists, somelist, sed, updatedlist, removes, spaces, linux, terminal, default, settings, adds, adding, didn, existing, previous, acl, entry, firewall, daemon, parse,

Latest Articles

  • How to combine .txt ACLs without breaking things
  • How to ping all of Googlebot's IPs script
  • 'virtio0' uses a qcow2 feature which is not supported by this qemu version: QCOW version 3
  • Linux bash script to get the IP of a list of hostnames
  • How To Use Camera Webcam in Docker for OBS Studio etc...
  • Computer Server Won't Post Boot Or Enter BIOS Setup After Installing RAID SAS or GPU Card etc..
  • How To Test PHP Scripts from CLI with GET variables/query string
  • apt-cache how to see all available versions of a package in Debian Ubuntu Mint
  • Virtualbox VBox Guest-utils drag and drop files stops working with Windows VMs
  • How To Remove Ubuntu Netplan and Go Back to /etc/network/interfaces
  • How To Force Flash an AMD Instinct GPU To Another Model Using Debian Ubuntu Mint Linux
  • How To compile ollama from source to use unsupported AMD GPU with rocm in Ubuntu Debian
  • QEMU KVM Virtio GPU Windows Cannot Select 1080P
  • Linux Gnome Desktop Ubuntu Mint Debian Gets Slower After Weeks
  • Firefox How to Save Full Page As Screenshot/PDF
  • Nvidia Datacenter Driver Tesla Slow nvidia-smi response and high utilization with 0 usage
  • ffmpeg how to normalize / increase the volume of your audio
  • kdenlive audio blips pops cracks artifacts solution fix
  • haproxy / nginx certbot SSL issues
  • nginx how to see the real IP when behind a CDN