How To Get Started on Ubuntu with gpt-2 OpenAI Text Prediction

apt install software-properties-common
add-apt-repository ppa:deadsnakes/ppa
apt update
apt install python3-pip
apt install python3.7 curl gnupg python3.7-dev git
ln -s /usr/bin/python3.7 /usr/bin/python3
pip3 install numpy keras_preprocessing
curl https://bazel.build/bazel-release.pub.gpg | sudo apt-key add -
echo "deb [arch=amd64] http://storage.googleapis.com/bazel-apt stable jdk1.8" | sudo tee /etc/apt/sources.list.d/bazel.list
apt update
apt install bazel-3.1.0
wget https://github.com/tensorflow/tensorflow/archive/master.zip
unzip master.zip
cd tensorflow-master

#be warned it takes forever and a lot of HDD space to compile tensorflow!
bazel build //tensorflow/tools/pip_package:build_pip_package
pip3 install --upgrade pip
pip3 install gpt-2-simple

/usr/env/python: 'python': No such file or directory
ln -s /usr/bin/python3.7 /usr/bin/python

Here is a lot of the hacking and slashing that I did to get it going to make the above:

root@gpt2:/# sudo add-apt-repository ppa:deadsnakes/ppa
sudo: add-apt-repository: command not found
root@gpt2:/# ^Cadd-apt-repository ppa:deadsnakes/ppa
root@gpt2:/# apt-cache search apt-add-repository
root@gpt2:/# ^Ct-cache search apt-add-repository
root@gpt2:/# ^C
root@gpt2:/# apta install^C
root@gpt2:/# apt install software-properties-common
Reading package lists... Done
Building dependency tree... Done
E: Unable to locate package software-properties-common
root@gpt2:/# apt update
Get:1 http://archive.canonical.com/ubuntu xenial InRelease [11.5 kB]
Get:2 http://archive.canonical.com/ubuntu xenial/partner amd64 Packages [3120 B]
Get:3 http://archive.ubuntu.com/ubuntu xenial InRelease [247 kB]
Get:4 http://security.ubuntu.com/ubuntu xenial-security InRelease [109 kB]
Get:5 http://archive.canonical.com/ubuntu xenial/partner Translation-en [1672 B]
Get:6 http://security.ubuntu.com/ubuntu xenial-security/main amd64 Packages [894 kB]
Get:7 http://archive.ubuntu.com/ubuntu xenial-updates InRelease [109 kB]
Get:8 http://archive.ubuntu.com/ubuntu xenial/main amd64 Packages [1201 kB]
Get:9 http://security.ubuntu.com/ubuntu xenial-security/main Translation-en [333 kB]
Get:10 http://archive.ubuntu.com/ubuntu xenial/main Translation-en [568 kB]
Get:11 http://security.ubuntu.com/ubuntu xenial-security/restricted amd64 Packages [7204 B]
Get:12 http://security.ubuntu.com/ubuntu xenial-security/restricted Translation-en [2152 B]
Get:13 http://security.ubuntu.com/ubuntu xenial-security/universe amd64 Packages [495 kB]
Get:14 http://archive.ubuntu.com/ubuntu xenial/restricted amd64 Packages [8344 B]
Get:15 http://archive.ubuntu.com/ubuntu xenial/restricted Translation-en [2908 B]
Get:16 http://archive.ubuntu.com/ubuntu xenial/universe amd64 Packages [7532 kB]
Get:17 http://security.ubuntu.com/ubuntu xenial-security/universe Translation-en [203 kB]
Get:18 http://security.ubuntu.com/ubuntu xenial-security/multiverse amd64 Packages [6088 B]
Get:19 http://security.ubuntu.com/ubuntu xenial-security/multiverse Translation-en [2888 B]
Get:20 http://archive.ubuntu.com/ubuntu xenial/universe Translation-en [4354 kB]
Get:21 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 Packages [1170 kB]
Get:22 http://archive.ubuntu.com/ubuntu xenial-updates/main Translation-en [440 kB]
Get:23 http://archive.ubuntu.com/ubuntu xenial-updates/restricted amd64 Packages [7576 B]
Get:24 http://archive.ubuntu.com/ubuntu xenial-updates/restricted Translation-en [2272 B]
Get:25 http://archive.ubuntu.com/ubuntu xenial-updates/universe amd64 Packages [799 kB]
Get:26 http://archive.ubuntu.com/ubuntu xenial-updates/universe Translation-en [335 kB]
Fetched 18.8 MB in 6s (2766 kB/s)
Reading package lists... Done
Building dependency tree... Done
205 packages can be upgraded. Run 'apt list --upgradable' to see them.
root@gpt2:/# apt install software-properties-common
Reading package lists... Done
Building dependency tree... Done
The following additional packages will be installed:
apt apt-utils gir1.2-glib-2.0 iso-codes libapt-inst2.0 libapt-pkg5.0 libcurl3-gnutls libdbus-glib-1-2 libgirepository-1.0-1 librtmp1 powermgmt-base
python-apt-common python3-apt python3-dbus python3-gi python3-pycurl python3-software-properties unattended-upgrades
Suggested packages:
aptitude | synaptic | wajig dpkg-dev apt-doc python-apt isoquery python3-apt-dbg python-apt-doc python-dbus-doc python3-dbus-dbg libcurl4-gnutls-dev
python-pycurl-doc python3-pycurl-dbg needrestart
The following NEW packages will be installed:
gir1.2-glib-2.0 iso-codes libcurl3-gnutls libdbus-glib-1-2 libgirepository-1.0-1 librtmp1 powermgmt-base python-apt-common python3-apt python3-dbus python3-gi
python3-pycurl python3-software-properties software-properties-common unattended-upgrades
The following packages will be upgraded:
apt apt-utils libapt-inst2.0 libapt-pkg5.0
4 upgraded, 15 newly installed, 0 to remove and 201 not upgraded.
Need to get 5358 kB of archives.
After this operation, 21.3 MB of additional disk space will be used.
Do you want to continue? [Y/n] y
Get:1 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libapt-pkg5.0 amd64 1.2.32ubuntu0.1 [713 kB]
Get:2 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libapt-inst2.0 amd64 1.2.32ubuntu0.1 [54.5 kB]
Get:3 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 apt amd64 1.2.32ubuntu0.1 [1087 kB]
Get:4 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 apt-utils amd64 1.2.32ubuntu0.1 [197 kB]
Get:5 http://archive.ubuntu.com/ubuntu xenial/main amd64 libgirepository-1.0-1 amd64 1.46.0-3ubuntu1 [88.3 kB]
Get:6 http://archive.ubuntu.com/ubuntu xenial/main amd64 gir1.2-glib-2.0 amd64 1.46.0-3ubuntu1 [127 kB]
Get:7 http://archive.ubuntu.com/ubuntu xenial/main amd64 iso-codes all 3.65-1 [2268 kB]
Get:8 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 librtmp1 amd64 2.4+20151223.gitfa8646d-1ubuntu0.1 [54.4 kB]
Get:9 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libcurl3-gnutls amd64 7.47.0-1ubuntu2.15 [184 kB]
Get:10 http://archive.ubuntu.com/ubuntu xenial/main amd64 libdbus-glib-1-2 amd64 0.106-1 [67.1 kB]
Get:11 http://archive.ubuntu.com/ubuntu xenial/main amd64 powermgmt-base all 1.31+nmu1 [7178 B]
Get:12 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 python-apt-common all 1.1.0~beta1ubuntu0.16.04.9 [16.8 kB]
Get:13 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 python3-apt amd64 1.1.0~beta1ubuntu0.16.04.9 [145 kB]
Get:14 http://archive.ubuntu.com/ubuntu xenial/main amd64 python3-dbus amd64 1.2.0-3 [83.1 kB]
Get:15 http://archive.ubuntu.com/ubuntu xenial/main amd64 python3-gi amd64 3.20.0-0ubuntu1 [153 kB]
Get:16 http://archive.ubuntu.com/ubuntu xenial/main amd64 python3-pycurl amd64 7.43.0-1ubuntu1 [42.3 kB]
Get:17 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 python3-software-properties all 0.96.20.9 [20.1 kB]
Get:18 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 software-properties-common all 0.96.20.9 [9452 B]
Get:19 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 unattended-upgrades all 1.1ubuntu1.18.04.7~16.04.6 [42.1 kB]
Fetched 5358 kB in 1s (3726 kB/s)
Preconfiguring packages ...
(Reading database ... 26041 files and directories currently installed.)
Preparing to unpack .../libapt-pkg5.0_1.2.32ubuntu0.1_amd64.deb ...
Unpacking libapt-pkg5.0:amd64 (1.2.32ubuntu0.1) over (1.2.15) ...
Processing triggers for libc-bin (2.23-0ubuntu4) ...
Setting up libapt-pkg5.0:amd64 (1.2.32ubuntu0.1) ...
Processing triggers for libc-bin (2.23-0ubuntu4) ...
(Reading database ... 26041 files and directories currently installed.)
Preparing to unpack .../libapt-inst2.0_1.2.32ubuntu0.1_amd64.deb ...
Unpacking libapt-inst2.0:amd64 (1.2.32ubuntu0.1) over (1.2.15) ...
Preparing to unpack .../apt_1.2.32ubuntu0.1_amd64.deb ...
Unpacking apt (1.2.32ubuntu0.1) over (1.2.15) ...
Processing triggers for libc-bin (2.23-0ubuntu4) ...
Processing triggers for man-db (2.7.5-1) ...
Setting up apt (1.2.32ubuntu0.1) ...
Installing new version of config file /etc/apt/apt.conf.d/01autoremove ...
apt-daily.timer is a disabled or a static unit, not starting it.
Processing triggers for libc-bin (2.23-0ubuntu4) ...
(Reading database ... 26052 files and directories currently installed.)
Preparing to unpack .../apt-utils_1.2.32ubuntu0.1_amd64.deb ...
Unpacking apt-utils (1.2.32ubuntu0.1) over (1.2.15) ...
Selecting previously unselected package libgirepository-1.0-1:amd64.
Preparing to unpack .../libgirepository-1.0-1_1.46.0-3ubuntu1_amd64.deb ...
Unpacking libgirepository-1.0-1:amd64 (1.46.0-3ubuntu1) ...
Selecting previously unselected package gir1.2-glib-2.0:amd64.
Preparing to unpack .../gir1.2-glib-2.0_1.46.0-3ubuntu1_amd64.deb ...
Unpacking gir1.2-glib-2.0:amd64 (1.46.0-3ubuntu1) ...
Selecting previously unselected package iso-codes.
Preparing to unpack .../iso-codes_3.65-1_all.deb ...
Unpacking iso-codes (3.65-1) ...
Selecting previously unselected package librtmp1:amd64.
Preparing to unpack .../librtmp1_2.4+20151223.gitfa8646d-1ubuntu0.1_amd64.deb ...
Unpacking librtmp1:amd64 (2.4+20151223.gitfa8646d-1ubuntu0.1) ...
Selecting previously unselected package libcurl3-gnutls:amd64.
Preparing to unpack .../libcurl3-gnutls_7.47.0-1ubuntu2.15_amd64.deb ...
Unpacking libcurl3-gnutls:amd64 (7.47.0-1ubuntu2.15) ...
Selecting previously unselected package libdbus-glib-1-2:amd64.
Preparing to unpack .../libdbus-glib-1-2_0.106-1_amd64.deb ...
Unpacking libdbus-glib-1-2:amd64 (0.106-1) ...
Selecting previously unselected package powermgmt-base.
Preparing to unpack .../powermgmt-base_1.31+nmu1_all.deb ...
Unpacking powermgmt-base (1.31+nmu1) ...
Selecting previously unselected package python-apt-common.
Preparing to unpack .../python-apt-common_1.1.0~beta1ubuntu0.16.04.9_all.deb ...
Unpacking python-apt-common (1.1.0~beta1ubuntu0.16.04.9) ...
Selecting previously unselected package python3-apt.
Preparing to unpack .../python3-apt_1.1.0~beta1ubuntu0.16.04.9_amd64.deb ...
Unpacking python3-apt (1.1.0~beta1ubuntu0.16.04.9) ...
Selecting previously unselected package python3-dbus.
Preparing to unpack .../python3-dbus_1.2.0-3_amd64.deb ...
Unpacking python3-dbus (1.2.0-3) ...
Selecting previously unselected package python3-gi.
Preparing to unpack .../python3-gi_3.20.0-0ubuntu1_amd64.deb ...
Unpacking python3-gi (3.20.0-0ubuntu1) ...
Selecting previously unselected package python3-pycurl.
Preparing to unpack .../python3-pycurl_7.43.0-1ubuntu1_amd64.deb ...
Unpacking python3-pycurl (7.43.0-1ubuntu1) ...
Selecting previously unselected package python3-software-properties.
Preparing to unpack .../python3-software-properties_0.96.20.9_all.deb ...
Unpacking python3-software-properties (0.96.20.9) ...
Selecting previously unselected package software-properties-common.
Preparing to unpack .../software-properties-common_0.96.20.9_all.deb ...
Unpacking software-properties-common (0.96.20.9) ...
Selecting previously unselected package unattended-upgrades.
Preparing to unpack .../unattended-upgrades_1.1ubuntu1.18.04.7~16.04.6_all.deb ...
Unpacking unattended-upgrades (1.1ubuntu1.18.04.7~16.04.6) ...
Processing triggers for man-db (2.7.5-1) ...
Processing triggers for libc-bin (2.23-0ubuntu4) ...
Processing triggers for systemd (229-4ubuntu12) ...
Setting up libapt-inst2.0:amd64 (1.2.32ubuntu0.1) ...
Setting up apt-utils (1.2.32ubuntu0.1) ...
Setting up libgirepository-1.0-1:amd64 (1.46.0-3ubuntu1) ...
Setting up gir1.2-glib-2.0:amd64 (1.46.0-3ubuntu1) ...
Setting up iso-codes (3.65-1) ...
Setting up librtmp1:amd64 (2.4+20151223.gitfa8646d-1ubuntu0.1) ...
Setting up libcurl3-gnutls:amd64 (7.47.0-1ubuntu2.15) ...
Setting up libdbus-glib-1-2:amd64 (0.106-1) ...
Setting up powermgmt-base (1.31+nmu1) ...
Setting up python-apt-common (1.1.0~beta1ubuntu0.16.04.9) ...
Setting up python3-apt (1.1.0~beta1ubuntu0.16.04.9) ...
Setting up python3-dbus (1.2.0-3) ...
Setting up python3-gi (3.20.0-0ubuntu1) ...
Setting up python3-pycurl (7.43.0-1ubuntu1) ...
Setting up python3-software-properties (0.96.20.9) ...
Setting up software-properties-common (0.96.20.9) ...
Setting up unattended-upgrades (1.1ubuntu1.18.04.7~16.04.6) ...

Creating config file /etc/apt/apt.conf.d/20auto-upgrades with new version

Creating config file /etc/apt/apt.conf.d/50unattended-upgrades with new version
Synchronizing state of unattended-upgrades.service with SysV init with /lib/systemd/systemd-sysv-install...
Executing /lib/systemd/systemd-sysv-install enable unattended-upgrades
Processing triggers for libc-bin (2.23-0ubuntu4) ...
Processing triggers for systemd (229-4ubuntu12) ...
root@gpt2:/# add-apt-repository ppa:deadsnakes/ppa
This PPA contains more recent Python versions packaged for Ubuntu.

Disclaimer: there's no guarantee of timely updates in case of security problems or other issues. If you want to use them in a security-or-otherwise-critical environment (say, on a production server), you do so at your own risk.

Update Note
===========
Please use this repository instead of ppa:fkrull/deadsnakes.

Reporting Issues
================

Issues can be reported in the master issue tracker at:
https://github.com/deadsnakes/issues/issues

Supported Ubuntu and Python Versions
====================================

- Ubuntu 16.04 (xenial) Python 2.3 - Python 2.6, Python 3.1 - Python3.4, Python 3.6 - Python3.9
- Ubuntu 18.04 (bionic) Python2.3 - Python 2.6, Python 3.1 - Python 3.5, Python3.7 - Python3.9
- Ubuntu 20.04 (focal) Python3.5 - Python3.7, Python3.9
- Note: Python2.7 (all), Python 3.5 (xenial), Python 3.6 (bionic), Python 3.8 (focal) are not provided by deadsnakes as upstream ubuntu provides those packages.
- Note: for focal, older python versions require libssl1.0.x so they are not currently built

The packages may also work on other versions of Ubuntu or Debian, but that is not tested or supported.

Packages
========

The packages provided here are loosely based on the debian upstream packages with some modifications to make them more usable as non-default pythons and on ubuntu. As such, the packages follow debian's patterns and often do not include a full python distribution with just `apt install python#.#`. Here is a list of packages that may be useful along with the default install:

- `python#.#-dev`: includes development headers for building C extensions
- `python#.#-venv`: provides the standard library `venv` module
- `python#.#-distutils`: provides the standard library `distutils` module
- `python#.#-lib2to3`: provides the `2to3-#.#` utility as well as the standard library `lib2to3` module
- `python#.#-gdbm`: provides the standard library `dbm.gnu` module
- `python#.#-tk`: provides the standard library `tkinter` module

Third-Party Python Modules
==========================

Python modules in the official Ubuntu repositories are packaged to work with the Python interpreters from the official repositories. Accordingly, they generally won't work with the Python interpreters from this PPA. As an exception, pure-Python modules for Python 3 will work, but any compiled extension modules won't.

To install 3rd-party Python modules, you should use the common Python packaging tools. For an introduction into the Python packaging ecosystem and its tools, refer to the Python Packaging User Guide:
https://packaging.python.org/installing/

Sources
=======
The package sources are available at:
https://github.com/deadsnakes/

Nightly Builds
==============

For nightly builds, see ppa:deadsnakes/nightly https://launchpad.net/~deadsnakes/+archive/ubuntu/nightly
More info: https://launchpad.net/~deadsnakes/+archive/ubuntu/ppa
Press [ENTER] to continue or ctrl-c to cancel adding it

gpg: keyring `/tmp/tmp9xripwnf/secring.gpg' created
gpg: keyring `/tmp/tmp9xripwnf/pubring.gpg' created
gpg: requesting key 6A755776 from hkp server keyserver.ubuntu.com
gpg: /tmp/tmp9xripwnf/trustdb.gpg: trustdb created
gpg: key 6A755776: public key "Launchpad PPA for deadsnakes" imported
gpg: Total number processed: 1
gpg:               imported: 1 (RSA: 1)
OK
root@gpt2:/# sudo apt update
Hit:1 http://archive.canonical.com/ubuntu xenial InRelease
0% [1 InRelease gpgv 11.5 kB] [Connecting to archive.ubuntu.com (91.189.88.152)] [Connecting to security.ubuntu.com (91.189.88.142)] [Connecting to ppa.launchpad.net
Hit:2 http://security.ubuntu.com/ubuntu xenial-security InRelease
Hit:3 http://archive.ubuntu.com/ubuntu xenial InRelease
Get:4 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu xenial InRelease [18.0 kB]
Hit:5 http://archive.ubuntu.com/ubuntu xenial-updates InRelease
Get:6 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu xenial/main amd64 Packages [31.3 kB]
Get:7 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu xenial/main Translation-en [7088 B]
Fetched 56.4 kB in 1s (49.8 kB/s)
Reading package lists... Done
Building dependency tree
Reading state information... Done
201 packages can be upgraded. Run 'apt list --upgradable' to see them.
root@gpt2:/# sudo apt install python3.7
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following additional packages will be installed:
libpython3.7-minimal libpython3.7-stdlib python3.7-distutils python3.7-lib2to3 python3.7-minimal
Suggested packages:
python3.7-venv python3.7-doc binfmt-support
The following NEW packages will be installed:
libpython3.7-minimal libpython3.7-stdlib python3.7 python3.7-distutils python3.7-lib2to3 python3.7-minimal
0 upgraded, 6 newly installed, 0 to remove and 201 not upgraded.
Need to get 4856 kB of archives.
After this operation, 24.3 MB of additional disk space will be used.
Do you want to continue? [Y/n]

apt install python3-pip
ln --force -s /usr/bin/python3.7 /usr/bin/python3

pip3 install gpt-2-simple
Collecting gpt-2-simple
Using cached https://files.pythonhosted.org/packages/6f/e4/a90add0c3328eed38a46c3ed137f2363b5d6a07bf13ee5d5d4d1e480b8c3/gpt_2_simple-0.7.1.tar.gz
Collecting regex (from gpt-2-simple)
Downloading https://files.pythonhosted.org/packages/b6/0b/571619431d3ab416b9ffeca1fdf6cc1b388581b087250fb56e7227d16088/regex-2020.7.14-cp37-cp37m-manylinux1_x86_64.whl (660kB)
    100% |████████████████████████████████| 665kB 1.1MB/s
Collecting requests (from gpt-2-simple)
Using cached https://files.pythonhosted.org/packages/45/1e/0c169c6a5381e241ba7404532c16a21d86ab872c9bed8bdcd4c423954103/requests-2.24.0-py2.py3-none-any.whl
Collecting tqdm (from gpt-2-simple)
Using cached https://files.pythonhosted.org/packages/af/88/7b0ea5fa8192d1733dea459a9e3059afc87819cb4072c43263f2ec7ab768/tqdm-4.48.0-py2.py3-none-any.whl
Collecting numpy (from gpt-2-simple)
Downloading https://files.pythonhosted.org/packages/b4/93/76311932b0c7efd3111f6604609f36d568b912e16bebd86d99f0612d3930/numpy-1.19.0-cp37-cp37m-manylinux1_x86_64.whl (13.5MB)
    100% |████████████████████████████████| 13.5MB 65kB/s
Collecting toposort (from gpt-2-simple)
Downloading https://files.pythonhosted.org/packages/e9/8a/321cd8ea5f4a22a06e3ba30ef31ec33bea11a3443eeb1d89807640ee6ed4/toposort-1.5-py2.py3-none-any.whl
Collecting chardet<4,>=3.0.2 (from requests->gpt-2-simple)
Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB)
    100% |████████████████████████████████| 143kB 4.6MB/s
Collecting idna<3,>=2.5 (from requests->gpt-2-simple)
Downloading https://files.pythonhosted.org/packages/a2/38/928ddce2273eaa564f6f50de919327bf3a00f091b5baba8dfa9460f3a8a8/idna-2.10-py2.py3-none-any.whl (58kB)
    100% |████████████████████████████████| 61kB 5.5MB/s
Collecting certifi>=2017.4.17 (from requests->gpt-2-simple)
Downloading https://files.pythonhosted.org/packages/5e/c4/6c4fe722df5343c33226f0b4e0bb042e4dc13483228b4718baf286f86d87/certifi-2020.6.20-py2.py3-none-any.whl (156kB)
    100% |████████████████████████████████| 163kB 4.1MB/s
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 (from requests->gpt-2-simple)
Downloading https://files.pythonhosted.org/packages/e1/e5/df302e8017440f111c11cc41a6b432838672f5a70aa29227bf58149dc72f/urllib3-1.25.9-py2.py3-none-any.whl (126kB)
    100% |████████████████████████████████| 133kB 4.7MB/s
Building wheels for collected packages: gpt-2-simple
Running setup.py bdist_wheel for gpt-2-simple ... done
Stored in directory: /root/.cache/pip/wheels/0c/f8/23/b53ce437504597edff76bf9c3b8de08ad716f74f6c6baaa91a
Successfully built gpt-2-simple
Installing collected packages: regex, chardet, idna, certifi, urllib3, requests, tqdm, numpy, toposort, gpt-2-simple
Successfully installed certifi-2020.6.20 chardet-3.0.4 gpt-2-simple-0.7.1 idna-2.10 numpy-1.19.0 regex-2020.7.14 requests-2.24.0 toposort-1.5 tqdm-4.48.0 urllib3-1.25.9

import gpt_2_simple as gpt2
from datetime import datetime
from google.colab import files

sess=gpt2.start_tf_sess()
gpt2.finetune(sess,
dataset=file_name,
model_name='124M',
steps=1000,
restore_from='fresh',
run_name='run1',
print_every=10,
sample_every=200,
save_every=500
)

vi gpt2.py
root@gpt2:~# pyhon3 gpt2.py
-bash: pyhon3: command not found
root@gpt2:~# python3 gpt2.py
Traceback (most recent call last):
File "gpt2.py", line 1, in <module>
    import gpt_2_simple as gpt2
File "/usr/local/lib/python3.7/dist-packages/gpt_2_simple/__init__.py", line 1, in <module>
    from .gpt_2 import *
File "/usr/local/lib/python3.7/dist-packages/gpt_2_simple/gpt_2.py", line 10, in <module>
    import tensorflow as tf
ModuleNotFoundError: No module named 'tensorflow'

pip3 install tensorflow

pip3 install tensorflow
Collecting tensorflow
Downloading https://files.pythonhosted.org/packages/f4/28/96efba1a516cdacc2e2d6d081f699c001d414cc8ca3250e6d59ae657eb2b/tensorflow-1.14.0-cp37-cp37m-manylinux1_x86_64.whl (109.3MB)
    100% |████████████████████████████████| 109.3MB 7.9kB/s
Collecting wrapt>=1.11.1 (from tensorflow)
Downloading https://files.pythonhosted.org/packages/82/f7/e43cefbe88c5fd371f4cf0cf5eb3feccd07515af9fd6cf7dbf1d1793a797/wrapt-1.12.1.tar.gz
Requirement already satisfied (use --upgrade to upgrade): wheel>=0.26 in /usr/lib/python3/dist-packages (from tensorflow)
Collecting keras-applications>=1.0.6 (from tensorflow)
Downloading https://files.pythonhosted.org/packages/71/e3/19762fdfc62877ae9102edf6342d71b28fbfd9dea3d2f96a882ce099b03f/Keras_Applications-1.0.8-py3-none-any.whl (50kB)
    100% |████████████████████████████████| 51kB 4.5MB/s
Collecting gast>=0.2.0 (from tensorflow)
Downloading https://files.pythonhosted.org/packages/d6/84/759f5dd23fec8ba71952d97bcc7e2c9d7d63bdc582421f3cd4be845f0c98/gast-0.3.3-py2.py3-none-any.whl
Collecting termcolor>=1.1.0 (from tensorflow)
Downloading https://files.pythonhosted.org/packages/8a/48/a76be51647d0eb9f10e2a4511bf3ffb8cc1e6b14e9e4fab46173aa79f981/termcolor-1.1.0.tar.gz
Collecting six>=1.10.0 (from tensorflow)
Downloading https://files.pythonhosted.org/packages/ee/ff/48bde5c0f013094d729fe4b0316ba2a24774b3ff1c52d924a8a4cb04078a/six-1.15.0-py2.py3-none-any.whl
Collecting protobuf>=3.6.1 (from tensorflow)
Downloading https://files.pythonhosted.org/packages/07/63/2c505711827446bfdb544e7bcc0d7694b115d22d56175902a2581fe1172a/protobuf-3.12.2-cp37-cp37m-manylinux1_x86_64.whl (1.3MB)
    100% |████████████████████████████████| 1.3MB 373kB/s
Collecting absl-py>=0.7.0 (from tensorflow)
Downloading https://files.pythonhosted.org/packages/1a/53/9243c600e047bd4c3df9e69cfabc1e8004a82cac2e0c484580a78a94ba2a/absl-py-0.9.0.tar.gz (104kB)
    100% |████████████████████████████████| 112kB 3.4MB/s
Collecting astor>=0.6.0 (from tensorflow)
Downloading https://files.pythonhosted.org/packages/c3/88/97eef84f48fa04fbd6750e62dcceafba6c63c81b7ac1420856c8dcc0a3f9/astor-0.8.1-py2.py3-none-any.whl
Collecting tensorflow-estimator<1.15.0rc0,>=1.14.0rc0 (from tensorflow)
Downloading https://files.pythonhosted.org/packages/3c/d5/21860a5b11caf0678fbc8319341b0ae21a07156911132e0e71bffed0510d/tensorflow_estimator-1.14.0-py2.py3-none-any.whl (488kB)
    100% |████████████████████████████████| 491kB 1.7MB/s
Collecting tensorboard<1.15.0,>=1.14.0 (from tensorflow)
Downloading https://files.pythonhosted.org/packages/91/2d/2ed263449a078cd9c8a9ba50ebd50123adf1f8cfbea1492f9084169b89d9/tensorboard-1.14.0-py3-none-any.whl (3.1MB)
    100% |████████████████████████████████| 3.2MB 268kB/s
Collecting keras-preprocessing>=1.0.5 (from tensorflow)
Downloading https://files.pythonhosted.org/packages/79/4c/7c3275a01e12ef9368a892926ab932b33bb13d55794881e3573482b378a7/Keras_Preprocessing-1.1.2-py2.py3-none-any.whl (42kB)
    100% |████████████████████████████████| 51kB 6.5MB/s
Collecting google-pasta>=0.1.6 (from tensorflow)
Downloading https://files.pythonhosted.org/packages/a3/de/c648ef6835192e6e2cc03f40b19eeda4382c49b5bafb43d88b931c4c74ac/google_pasta-0.2.0-py3-none-any.whl (57kB)
    100% |████████████████████████████████| 61kB 5.7MB/s
Requirement already satisfied (use --upgrade to upgrade): numpy<2.0,>=1.14.5 in /usr/local/lib/python3.7/dist-packages (from tensorflow)
Collecting grpcio>=1.8.6 (from tensorflow)
Downloading https://files.pythonhosted.org/packages/5e/29/1bd649737e427a6bb850174293b4f2b72ab80dd49462142db9b81e1e5c7b/grpcio-1.30.0.tar.gz (19.7MB)
    100% |████████████████████████████████| 19.7MB 43kB/s
Collecting h5py (from keras-applications>=1.0.6->tensorflow)
Downloading https://files.pythonhosted.org/packages/3f/c0/abde58b837e066bca19a3f7332d9d0493521d7dd6b48248451a9e3fe2214/h5py-2.10.0-cp37-cp37m-manylinux1_x86_64.whl (2.9MB)
    100% |████████████████████████████████| 2.9MB 304kB/s
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python3/dist-packages (from protobuf>=3.6.1->tensorflow)
Collecting werkzeug>=0.11.15 (from tensorboard<1.15.0,>=1.14.0->tensorflow)
Downloading https://files.pythonhosted.org/packages/cc/94/5f7079a0e00bd6863ef8f1da638721e9da21e5bacee597595b318f71d62e/Werkzeug-1.0.1-py2.py3-none-any.whl (298kB)
    100% |████████████████████████████████| 307kB 2.6MB/s
Collecting markdown>=2.6.8 (from tensorboard<1.15.0,>=1.14.0->tensorflow)
Downloading https://files.pythonhosted.org/packages/a4/63/eaec2bd025ab48c754b55e8819af0f6a69e2b1e187611dd40cbbe101ee7f/Markdown-3.2.2-py3-none-any.whl (88kB)
    100% |████████████████████████████████| 92kB 3.4MB/s
Collecting futures>=2.2.0; python_version < "3.2" (from grpcio>=1.8.6->tensorflow)
Downloading https://files.pythonhosted.org/packages/47/04/5fc6c74ad114032cd2c544c575bffc17582295e9cd6a851d6026ab4b2c00/futures-3.3.0.tar.gz
    Complete output from command python setup.py egg_info:
    This backport is meant only for Python 2.
    It does not work on Python 3, and Python 3 users do not need it as the concurrent.futures package is available in the standard library.
    For projects that work on both Python 2 and 3, the dependency needs to be conditional on the Python version, like so:
    extras_require={':python_version == "2.7"': ['futures']}

    ----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-build-tiqpio20/futures/
You are using pip version 8.1.1, however version 20.1.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.

pip3 install --upgrade pip
Collecting pip
Downloading https://files.pythonhosted.org/packages/43/84/23ed6a1796480a6f1a2d38f2802901d078266bda38388954d01d3f2e821d/pip-20.1.1-py2.py3-none-any.whl (1.5MB)
    100% |████████████████████████████████| 1.5MB 575kB/s
Installing collected packages: pip
Found existing installation: pip 8.1.1
    Not uninstalling pip at /usr/lib/python3/dist-packages, outside environment /usr
Successfully installed pip-20.1.1

pip3 install --upgrade pip
Collecting pip
Downloading https://files.pythonhosted.org/packages/43/84/23ed6a1796480a6f1a2d38f2802901d078266bda38388954d01d3f2e821d/pip-20.1.1-py2.py3-none-any.whl (1.5MB)
    100% |████████████████████████████████| 1.5MB 575kB/s
Installing collected packages: pip
Found existing installation: pip 8.1.1
    Not uninstalling pip at /usr/lib/python3/dist-packages, outside environment /usr
Successfully installed pip-20.1.1
root@gpt2:~# pip3 install tensorflow
WARNING: pip is being invoked by an old script wrapper. This will fail in a future version of pip.
Please see https://github.com/pypa/pip/issues/5599 for advice on fixing the underlying issue.
To avoid this problem you can invoke Python with '-m pip' instead of running pip directly.
Collecting tensorflow
Downloading tensorflow-2.2.0-cp37-cp37m-manylinux2010_x86_64.whl (516.2 MB)
     |████████████████████████████████| 516.2 MB 1.9 kB/s
Collecting tensorboard<2.3.0,>=2.2.0
Downloading tensorboard-2.2.2-py3-none-any.whl (3.0 MB)
     |████████████████████████████████| 3.0 MB 12.8 MB/s
Collecting h5py<2.11.0,>=2.10.0
Using cached h5py-2.10.0-cp37-cp37m-manylinux1_x86_64.whl (2.9 MB)
Collecting keras-preprocessing>=1.1.0
Using cached Keras_Preprocessing-1.1.2-py2.py3-none-any.whl (42 kB)
Collecting tensorflow-estimator<2.3.0,>=2.2.0
Downloading tensorflow_estimator-2.2.0-py2.py3-none-any.whl (454 kB)
     |████████████████████████████████| 454 kB 11.2 MB/s
Collecting six>=1.12.0
Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting gast==0.3.3
Using cached gast-0.3.3-py2.py3-none-any.whl (9.7 kB)
Collecting termcolor>=1.1.0
Using cached termcolor-1.1.0.tar.gz (3.9 kB)
Requirement already satisfied: wheel>=0.26; python_version >= "3" in /usr/lib/python3/dist-packages (from tensorflow) (0.29.0)
Collecting protobuf>=3.8.0
Using cached protobuf-3.12.2-cp37-cp37m-manylinux1_x86_64.whl (1.3 MB)
Collecting absl-py>=0.7.0
Using cached absl-py-0.9.0.tar.gz (104 kB)
Collecting opt-einsum>=2.3.2
Downloading opt_einsum-3.3.0-py3-none-any.whl (65 kB)
     |████████████████████████████████| 65 kB 4.7 MB/s
Collecting scipy==1.4.1; python_version >= "3"
Downloading scipy-1.4.1-cp37-cp37m-manylinux1_x86_64.whl (26.1 MB)
     |████████████████████████████████| 26.1 MB 11.8 MB/s
Requirement already satisfied: numpy<2.0,>=1.16.0 in /usr/local/lib/python3.7/dist-packages (from tensorflow) (1.19.0)
Collecting astunparse==1.6.3
Downloading astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Collecting google-pasta>=0.1.8
Using cached google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting grpcio>=1.8.6
Downloading grpcio-1.30.0-cp37-cp37m-manylinux2010_x86_64.whl (3.0 MB)
     |████████████████████████████████| 3.0 MB 12.1 MB/s
Collecting wrapt>=1.11.1
Using cached wrapt-1.12.1.tar.gz (27 kB)
Collecting google-auth<2,>=1.6.3
Downloading google_auth-1.19.2-py2.py3-none-any.whl (91 kB)
     |████████████████████████████████| 91 kB 5.5 MB/s
Collecting setuptools>=41.0.0
Downloading setuptools-49.2.0-py3-none-any.whl (789 kB)
     |████████████████████████████████| 789 kB 12.1 MB/s
Collecting google-auth-oauthlib<0.5,>=0.4.1
Downloading google_auth_oauthlib-0.4.1-py2.py3-none-any.whl (18 kB)
Collecting markdown>=2.6.8
Using cached Markdown-3.2.2-py3-none-any.whl (88 kB)
Collecting tensorboard-plugin-wit>=1.6.0
Downloading tensorboard_plugin_wit-1.7.0-py3-none-any.whl (779 kB)
     |████████████████████████████████| 779 kB 11.9 MB/s
Collecting werkzeug>=0.11.15
Using cached Werkzeug-1.0.1-py2.py3-none-any.whl (298 kB)
Requirement already satisfied: requests<3,>=2.21.0 in /usr/local/lib/python3.7/dist-packages (from tensorboard<2.3.0,>=2.2.0->tensorflow) (2.24.0)
Collecting pyasn1-modules>=0.2.1
Downloading pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
     |████████████████████████████████| 155 kB 12.1 MB/s
Collecting rsa<5,>=3.1.4; python_version >= "3"
Downloading rsa-4.6-py3-none-any.whl (47 kB)
     |████████████████████████████████| 47 kB 5.4 MB/s
Collecting cachetools<5.0,>=2.0.0
Downloading cachetools-4.1.1-py3-none-any.whl (10 kB)
Collecting requests-oauthlib>=0.7.0
Downloading requests_oauthlib-1.3.0-py2.py3-none-any.whl (23 kB)
Collecting importlib-metadata; python_version < "3.8"
Downloading importlib_metadata-1.7.0-py2.py3-none-any.whl (31 kB)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.7/dist-packages (from requests<3,>=2.21.0->tensorboard<2.3.0,>=2.2.0->tensorflow) (2020.6.20)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /usr/local/lib/python3.7/dist-packages (from requests<3,>=2.21.0->tensorboard<2.3.0,>=2.2.0->tensorflow) (1.25.9)
Requirement already satisfied: chardet<4,>=3.0.2 in /usr/local/lib/python3.7/dist-packages (from requests<3,>=2.21.0->tensorboard<2.3.0,>=2.2.0->tensorflow) (3.0.4)
Requirement already satisfied: idna<3,>=2.5 in /usr/local/lib/python3.7/dist-packages (from requests<3,>=2.21.0->tensorboard<2.3.0,>=2.2.0->tensorflow) (2.10)
Collecting pyasn1<0.5.0,>=0.4.6
Downloading pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
     |████████████████████████████████| 77 kB 3.3 MB/s
Collecting oauthlib>=3.0.0
Downloading oauthlib-3.1.0-py2.py3-none-any.whl (147 kB)
     |████████████████████████████████| 147 kB 11.7 MB/s
Collecting zipp>=0.5
Downloading zipp-3.1.0-py3-none-any.whl (4.9 kB)
Building wheels for collected packages: termcolor, absl-py, wrapt
Building wheel for termcolor (setup.py) ... done
Created wheel for termcolor: filename=termcolor-1.1.0-py3-none-any.whl size=5680 sha256=7a9fdcd26195168e8f383405a3f72398f4f2f759fa4b1bc878462624c1c5a4ce
Stored in directory: /root/.cache/pip/wheels/3f/e3/ec/8a8336ff196023622fbcb36de0c5a5c218cbb24111d1d4c7f2
Building wheel for absl-py (setup.py) ... done
Created wheel for absl-py: filename=absl_py-0.9.0-py3-none-any.whl size=119295 sha256=b6a1c511cd115ac53f2ed6c5c5729e9afe7692ddbf12e30e65fe084475237a4c
Stored in directory: /root/.cache/pip/wheels/cc/af/1a/498a24d0730ef484019e007bb9e8cef3ac00311a672c049a3e
Building wheel for wrapt (setup.py) ... done
Created wheel for wrapt: filename=wrapt-1.12.1-py3-none-any.whl size=21397 sha256=f6d324127c72a2549afe8c669e053ede41c4254291f8bf2190eb0ac54ff98c5c
Stored in directory: /root/.cache/pip/wheels/62/76/4c/aa25851149f3f6d9785f6c869387ad82b3fd37582fa8147ac6
Successfully built termcolor absl-py wrapt
Installing collected packages: pyasn1, pyasn1-modules, rsa, cachetools, setuptools, six, google-auth, absl-py, grpcio, oauthlib, requests-oauthlib, google-auth-oauthlib, zipp, importlib-metadata, markdown, protobuf, tensorboard-plugin-wit, werkzeug, tensorboard, h5py, keras-preprocessing, tensorflow-estimator, gast, termcolor, opt-einsum, scipy, astunparse, google-pasta, wrapt, tensorflow
Attempting uninstall: setuptools
    Found existing installation: setuptools 20.7.0
    Uninstalling setuptools-20.7.0:
      Successfully uninstalled setuptools-20.7.0

Successfully installed absl-py-0.9.0 astunparse-1.6.3 cachetools-4.1.1 gast-0.3.3 google-auth-1.19.2 google-auth-oauthlib-0.4.1 google-pasta-0.2.0 grpcio-1.30.0 h5py-2.10.0 importlib-metadata-1.7.0 keras-preprocessing-1.1.2 markdown-3.2.2 oauthlib-3.1.0 opt-einsum-3.3.0 protobuf-3.12.2 pyasn1-0.4.8 pyasn1-modules-0.2.8 requests-oauthlib-1.3.0 rsa-4.6 scipy-1.4.1 setuptools-49.2.0 six-1.15.0 tensorboard-2.2.2 tensorboard-plugin-wit-1.7.0 tensorflow-2.2.0 tensorflow-estimator-2.2.0 termcolor-1.1.0 werkzeug-1.0.1 wrapt-1.12.1 zipp-3.1.0

python3 gpt2.py
Illegal instruction

#it is something weird with tensorflow 2.2.0
#downgrade!
pip3 install tensorflow==1.13.1

#nope
pip3 install tensorflow==1.15.3
#nope same error

#apparently any Tensorflow newer than 1.5 won't work if your computer does not have AVX CPU extensions

#compile from source
wget https://github.com/tensorflow/tensorflow/archive/master.zip
cd tensorflow-master

./configure
Cannot find bazel. Please install bazel.

apt install curl gnupg
curl https://bazel.build/bazel-release.pub.gpg | sudo apt-key add -
echo "deb [arch=amd64] https://storage.googleapis.com/bazel-apt stable jdk1.8" | sudo tee /etc/apt/sources.list.d/bazel.list

apt update
apt install bazel

Reading package lists... Done
E: The method driver /usr/lib/apt/methods/https could not be found.
N: Is the package apt-transport-https installed?
E: Failed to fetch https://storage.googleapis.com/bazel-apt/dists/stable/InRelease
E: Some index files failed to download. They have been ignored, or old ones used instead.

#edit and change https to http
/etc/apt/sources.list.d/bazel.list
deb [arch=amd64] https://storage.googleapis.com/bazel-apt stable jdk1.8

apt install bazel

#back to tensorflow
./configure

./configure
WARNING: current bazel installation is not a release version.
Make sure you are running at least bazel 3.1.0
Please specify the location of python. [Default is /usr/bin/python3]:

Found possible Python library paths:
/usr/lib/python3/dist-packages
/usr/local/lib/python3.7/dist-packages
Please input the desired Python library path to use. Default is [/usr/lib/python3/dist-packages]

Do you wish to build TensorFlow with OpenCL SYCL support? [y/N]: n
No OpenCL SYCL support will be enabled for TensorFlow.

Do you wish to build TensorFlow with ROCm support? [y/N]: n
No ROCm support will be enabled for TensorFlow.

Do you wish to build TensorFlow with CUDA support? [y/N]: n
No CUDA support will be enabled for TensorFlow.

Do you wish to download a fresh release of clang? (Experimental) [y/N]: n
Clang will not be downloaded.

Please specify optimization flags to use during compilation when bazel option "--config=opt" is specified [Default is -march=native -Wno-sign-compare]:

Would you like to interactively configure ./WORKSPACE for Android builds? [y/N]: n
Not configuring the WORKSPACE for Android builds.

Preconfigured Bazel build configs. You can use any of the below by adding "--config=<>" to your build command. See .bazelrc for more details.
    --config=mkl             # Build with MKL support.
    --config=monolithic     # Config for mostly static monolithic build.
    --config=ngraph          # Build with Intel nGraph support.
    --config=numa            # Build with NUMA support.
    --config=dynamic_kernels    # (Experimental) Build kernels into separate shared objects.
    --config=v2              # Build TensorFlow 2.x instead of 1.x.
Preconfigured Bazel build configs to DISABLE default on features:
    --config=noaws           # Disable AWS S3 filesystem support.
    --config=nogcp           # Disable GCP support.
    --config=nohdfs          # Disable HDFS support.
    --config=nonccl          # Disable NVIDIA NCCL support.
Configuration finished

#ok weird I have bazel 3.4 what is the issue?

bazel build //tensorflow/tools/pip_package:build_pip_package
ERROR: The project you're trying to build requires Bazel 3.1.0 (specified in /root/tensorflow/tensorflow-master/.bazelversion), but it wasn't found in /usr/bin.

You can install the required Bazel version via apt:
sudo apt update && sudo apt install bazel-3.1.0

If this doesn't work, check Bazel's installation instructions for help:
https://docs.bazel.build/versions/master/install-ubuntu.html
root@gpt2:~/tensorflow/tensorflow-master# dpkg -l|grep bazel
ii bazel                         3.4.1                              amd64        Bazel is a tool that automates software builds and tests.

apt install bazel-3.1.0

bazel build //tensorflow/tools/pip_package:build_pip_package

apt install bazel-3.1.0
Reading package lists... Done
Building dependency tree
Reading state information... Done
Suggested packages:
google-jdk | java8-sdk-headless | java8-jdk | java8-sdk | oracle-java8-installer bash-completion
The following NEW packages will be installed:
bazel-3.1.0
0 upgraded, 1 newly installed, 0 to remove and 180 not upgraded.
Need to get 42.8 MB of archives.
After this operation, 0 B of additional disk space will be used.
Get:1 http://storage.googleapis.com/bazel-apt stable/jdk1.8 amd64 bazel-3.1.0 amd64 3.1.0 [42.8 MB]
Fetched 42.8 MB in 8s (5200 kB/s)
Selecting previously unselected package bazel-3.1.0.
(Reading database ... 33246 files and directories currently installed.)
Preparing to unpack .../bazel-3.1.0_3.1.0_amd64.deb ...
Unpacking bazel-3.1.0 (3.1.0) ...
Setting up bazel-3.1.0 (3.1.0) ...
root@gpt2:~/tensorflow/tensorflow-master# bazel build //tensorflow/tools/pip_package:build_pip_package
Extracting Bazel installation...
Starting local Bazel server and connecting to it...
INFO: Options provided by the client:
Inherited 'common' options: --isatty=1 --terminal_columns=166
INFO: Reading rc options for 'build' from /root/tensorflow/tensorflow-master/.bazelrc:
Inherited 'common' options: --experimental_repo_remote_exec
INFO: Reading rc options for 'build' from /root/tensorflow/tensorflow-master/.bazelrc:
'build' options: --apple_platform_type=macos --define framework_shared_object=true --define open_source_build=true --java_toolchain=//third_party/toolchains/java:tf_java_toolchain --host_java_toolchain=//third_party/toolchains/java:tf_java_toolchain --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --noincompatible_prohibit_aapt1 --enable_platform_specific_config --config=v2
INFO: Reading rc options for 'build' from /root/tensorflow/tensorflow-master/.tf_configure.bazelrc:
'build' options: --action_env PYTHON_BIN_PATH=/usr/bin/python3 --action_env PYTHON_LIB_PATH=/usr/lib/python3/dist-packages --python_path=/usr/bin/python3 --config=xla --action_env TF_CONFIGURE_IOS=0
INFO: Found applicable config definition build:v2 in file /root/tensorflow/tensorflow-master/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
INFO: Found applicable config definition build:xla in file /root/tensorflow/tensorflow-master/.bazelrc: --action_env=TF_ENABLE_XLA=1 --define=with_xla_support=true
INFO: Found applicable config definition build:linux in file /root/tensorflow/tensorflow-master/.bazelrc: --copt=-w --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --cxxopt=-std=c++14 --host_cxxopt=-std=c++14 --config=dynamic_kernels
INFO: Found applicable config definition build:dynamic_kernels in file /root/tensorflow/tensorflow-master/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS
INFO: Repository local_execution_config_python instantiated at:
no stack (--record_rule_instantiation_callstack not enabled)
Repository rule local_python_configure defined at:
/root/tensorflow/tensorflow-master/third_party/py/python_configure.bzl:275:26: in <toplevel>
ERROR: An error occurred during the fetch of repository 'local_execution_config_python':
   Traceback (most recent call last):
    File "/root/tensorflow/tensorflow-master/third_party/py/python_configure.bzl", line 214
        _symlink_genrule_for_dir(<4 more arguments>)
    File "/root/tensorflow/tensorflow-master/third_party/py/python_configure.bzl", line 66, in _symlink_genrule_for_dir
        "\n".join(<1 more arguments>)
    File "/root/tensorflow/tensorflow-master/third_party/py/python_configure.bzl", line 66, in "\n".join
        read_dir(repository_ctx, <1 more arguments>)
    File "/root/tensorflow/tensorflow-master/third_party/remote_config/common.bzl", line 101, in read_dir
        execute(repository_ctx, <2 more arguments>)
    File "/root/tensorflow/tensorflow-master/third_party/remote_config/common.bzl", line 208, in execute
        fail(<1 more arguments>)
Repository command failed
find: '/usr/include/python3.7m': No such file or directory
INFO: Repository sobol_data instantiated at:
no stack (--record_rule_instantiation_callstack not enabled)
Repository rule third_party_http_archive defined at:
/root/tensorflow/tensorflow-master/third_party/repo.bzl:216:28: in <toplevel>
INFO: Repository absl_py instantiated at:
no stack (--record_rule_instantiation_callstack not enabled)
Repository rule tf_http_archive defined at:
/root/tensorflow/tensorflow-master/third_party/repo.bzl:131:19: in <toplevel>
INFO: Repository rules_proto instantiated at:
no stack (--record_rule_instantiation_callstack not enabled)
Repository rule http_archive defined at:
/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/http.bzl:336:16: in <toplevel>
INFO: Repository rules_java instantiated at:
no stack (--record_rule_instantiation_callstack not enabled)
Repository rule http_archive defined at:
/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/http.bzl:336:16: in <toplevel>
ERROR: Analysis of target '//tensorflow/tools/pip_package:build_pip_package' failed; build aborted: Traceback (most recent call last):
    File "/root/tensorflow/tensorflow-master/third_party/py/python_configure.bzl", line 214
        _symlink_genrule_for_dir(<4 more arguments>)
    File "/root/tensorflow/tensorflow-master/third_party/py/python_configure.bzl", line 66, in _symlink_genrule_for_dir
        "\n".join(<1 more arguments>)
    File "/root/tensorflow/tensorflow-master/third_party/py/python_configure.bzl", line 66, in "\n".join
        read_dir(repository_ctx, <1 more arguments>)
    File "/root/tensorflow/tensorflow-master/third_party/remote_config/common.bzl", line 101, in read_dir
        execute(repository_ctx, <2 more arguments>)
    File "/root/tensorflow/tensorflow-master/third_party/remote_config/common.bzl", line 208, in execute
        fail(<1 more arguments>)
Repository command failed
find: '/usr/include/python3.7m': No such file or directory
INFO: Elapsed time: 37.338s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (150 packages loaded, 3343 targets configured)
    currently loading: @bazel_tools//tools/jdk ... (2 packages)

#find: '/usr/include/python3.7m': No such file or directory

apt install python3.7-dev

#ok new error

bazel build //tensorflow/tools/pip_package:build_pip_package
INFO: Options provided by the client:
Inherited 'common' options: --isatty=1 --terminal_columns=166
INFO: Reading rc options for 'build' from /root/tensorflow/tensorflow-master/.bazelrc:
Inherited 'common' options: --experimental_repo_remote_exec
INFO: Reading rc options for 'build' from /root/tensorflow/tensorflow-master/.bazelrc:
'build' options: --apple_platform_type=macos --define framework_shared_object=true --define open_source_build=true --java_toolchain=//third_party/toolchains/java:tf_java_toolchain --host_java_toolchain=//third_party/toolchains/java:tf_java_toolchain --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --noincompatible_prohibit_aapt1 --enable_platform_specific_config --config=v2
INFO: Reading rc options for 'build' from /root/tensorflow/tensorflow-master/.tf_configure.bazelrc:
'build' options: --action_env PYTHON_BIN_PATH=/usr/bin/python3 --action_env PYTHON_LIB_PATH=/usr/lib/python3/dist-packages --python_path=/usr/bin/python3 --config=xla --action_env TF_CONFIGURE_IOS=0
INFO: Found applicable config definition build:v2 in file /root/tensorflow/tensorflow-master/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
INFO: Found applicable config definition build:xla in file /root/tensorflow/tensorflow-master/.bazelrc: --action_env=TF_ENABLE_XLA=1 --define=with_xla_support=true
INFO: Found applicable config definition build:linux in file /root/tensorflow/tensorflow-master/.bazelrc: --copt=-w --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --cxxopt=-std=c++14 --host_cxxopt=-std=c++14 --config=dynamic_kernels
INFO: Found applicable config definition build:dynamic_kernels in file /root/tensorflow/tensorflow-master/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS
INFO: Repository io_bazel_rules_docker instantiated at:
no stack (--record_rule_instantiation_callstack not enabled)
Repository rule git_repository defined at:
/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git.bzl:195:18: in <toplevel>
ERROR: An error occurred during the fetch of repository 'io_bazel_rules_docker':
   Traceback (most recent call last):
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git.bzl", line 177
        _clone_or_update(ctx)
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git.bzl", line 36, in _clone_or_update
        git_repo(ctx, directory)
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 91, in git_repo
        _update(ctx, git_repo)
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 101, in _update
        init(ctx, git_repo)
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 115, in init
        _error(ctx.name, cl, st.stderr)
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 181, in _error
        fail(<1 more arguments>)
error running 'git init /root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/io_bazel_rules_docker' while working with @io_bazel_rules_docker:
src/main/tools/process-wrapper-legacy.cc:58: "execvp(git, ...)": No such file or directory
INFO: Repository absl_py instantiated at:
no stack (--record_rule_instantiation_callstack not enabled)
Repository rule tf_http_archive defined at:
/root/tensorflow/tensorflow-master/third_party/repo.bzl:131:19: in <toplevel>
INFO: Repository wrapt instantiated at:
no stack (--record_rule_instantiation_callstack not enabled)
Repository rule tf_http_archive defined at:
/root/tensorflow/tensorflow-master/third_party/repo.bzl:131:19: in <toplevel>
INFO: Repository rules_python instantiated at:
no stack (--record_rule_instantiation_callstack not enabled)
Repository rule tf_http_archive defined at:
/root/tensorflow/tensorflow-master/third_party/repo.bzl:131:19: in <toplevel>
ERROR: Analysis of target '//tensorflow/tools/pip_package:build_pip_package' failed; build aborted: Traceback (most recent call last):
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git.bzl", line 177
        _clone_or_update(ctx)
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git.bzl", line 36, in _clone_or_update
        git_repo(ctx, directory)
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 91, in git_repo
        _update(ctx, git_repo)
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 101, in _update
        init(ctx, git_repo)
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 115, in init
        _error(ctx.name, cl, st.stderr)
    File "/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git_worker.bzl", line 181, in _error
        fail(<1 more arguments>)
error running 'git init /root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/io_bazel_rules_docker' while working with @io_bazel_rules_docker:
src/main/tools/process-wrapper-legacy.cc:58: "execvp(git, ...)": No such file or directory
INFO: Elapsed time: 1.038s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (7 packages loaded, 108 targets configured)
    Fetching @local_config_python; fetching

#oh it needs git!
apt install git

#another compile error ! :(

bazel build //tensorflow/tools/pip_package:build_pip_package
INFO: Options provided by the client:
Inherited 'common' options: --isatty=1 --terminal_columns=166
INFO: Reading rc options for 'build' from /root/tensorflow/tensorflow-master/.bazelrc:
Inherited 'common' options: --experimental_repo_remote_exec
INFO: Reading rc options for 'build' from /root/tensorflow/tensorflow-master/.bazelrc:
'build' options: --apple_platform_type=macos --define framework_shared_object=true --define open_source_build=true --java_toolchain=//third_party/toolchains/java:tf_java_toolchain --host_java_toolchain=//third_party/toolchains/java:tf_java_toolchain --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --noincompatible_prohibit_aapt1 --enable_platform_specific_config --config=v2
INFO: Reading rc options for 'build' from /root/tensorflow/tensorflow-master/.tf_configure.bazelrc:
'build' options: --action_env PYTHON_BIN_PATH=/usr/bin/python3 --action_env PYTHON_LIB_PATH=/usr/lib/python3/dist-packages --python_path=/usr/bin/python3 --config=xla --action_env TF_CONFIGURE_IOS=0
INFO: Found applicable config definition build:v2 in file /root/tensorflow/tensorflow-master/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
INFO: Found applicable config definition build:xla in file /root/tensorflow/tensorflow-master/.bazelrc: --action_env=TF_ENABLE_XLA=1 --define=with_xla_support=true
INFO: Found applicable config definition build:linux in file /root/tensorflow/tensorflow-master/.bazelrc: --copt=-w --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --cxxopt=-std=c++14 --host_cxxopt=-std=c++14 --config=dynamic_kernels
INFO: Found applicable config definition build:dynamic_kernels in file /root/tensorflow/tensorflow-master/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS
DEBUG: Rule 'io_bazel_rules_docker' indicated that a canonical reproducible form can be obtained by modifying arguments shallow_since = "1556410077 -0400"
DEBUG: Repository io_bazel_rules_docker instantiated at:
no stack (--record_rule_instantiation_callstack not enabled)
Repository rule git_repository defined at:
/root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/bazel_tools/tools/build_defs/repo/git.bzl:195:18: in <toplevel>
WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/google/ruy/archive/d492ac890d982d7a153a326922f362b10de8d2ad.zip failed: class com.google.devtools.build.lib.bazel.repository.downloader.UnrecoverableHttpException GET returned 404 Not Found
WARNING: Download from https://mirror.bazel.build/github.com/aws/aws-sdk-cpp/archive/1.7.336.tar.gz failed: class com.google.devtools.build.lib.bazel.repository.downloader.UnrecoverableHttpException GET returned 404 Not Found
WARNING: /root/tensorflow/tensorflow-master/tensorflow/core/BUILD:1720:1: in linkstatic attribute of cc_library rule //tensorflow/core:lib_internal: setting 'linkstatic=1' is recommended if there are no object files. Since this rule was created by the macro 'cc_library', the error might have been caused by the macro implementation
WARNING: /root/tensorflow/tensorflow-master/tensorflow/core/BUILD:2132:1: in linkstatic attribute of cc_library rule //tensorflow/core:framework_internal: setting 'linkstatic=1' is recommended if there are no object files. Since this rule was created by the macro 'tf_cuda_library', the error might have been caused by the macro implementation
WARNING: /root/tensorflow/tensorflow-master/tensorflow/core/BUILD:1745:1: in linkstatic attribute of cc_library rule //tensorflow/core:lib_headers_for_pybind: setting 'linkstatic=1' is recommended if there are no object files. Since this rule was created by the macro 'cc_library', the error might have been caused by the macro implementation
WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/llvm/llvm-project/archive/cf5df40c4cf1a53a02ab1d56a488642e3dda8f6d.tar.gz failed: class com.google.devtools.build.lib.bazel.repository.downloader.UnrecoverableHttpException GET returned 404 Not Found
WARNING: /root/tensorflow/tensorflow-master/tensorflow/python/BUILD:4666:1: in py_library rule //tensorflow/python:standard_ops: target '//tensorflow/python:standard_ops' depends on deprecated target '//tensorflow/python/ops/distributions:distributions': TensorFlow Distributions has migrated to TensorFlow Probability (https://github.com/tensorflow/probability). Deprecated copies remaining in tf.distributions will not receive new features, and will be removed by early 2019. You should update all usage of `tf.distributions` to `tfp.distributions`.
WARNING: /root/tensorflow/tensorflow-master/tensorflow/python/BUILD:115:1: in py_library rule //tensorflow/python:no_contrib: target '//tensorflow/python:no_contrib' depends on deprecated target '//tensorflow/python/ops/distributions:distributions': TensorFlow Distributions has migrated to TensorFlow Probability (https://github.com/tensorflow/probability). Deprecated copies remaining in tf.distributions will not receive new features, and will be removed by early 2019. You should update all usage of `tf.distributions` to `tfp.distributions`.
INFO: Analyzed target //tensorflow/tools/pip_package:build_pip_package (230 packages loaded, 27544 targets configured).
INFO: Found 1 target...
ERROR: /root/.cache/bazel/_bazel_root/7ec620ba27478531320be669b1ca3db4/external/com_google_absl/absl/time/BUILD.bazel:29:1: C++ compilation of rule '@com_google_absl//absl/time:time' failed (Exit 1)

cc1plus: out of memory allocating 236976 bytes after a total of 77238272 bytes
Target //tensorflow/tools/pip_package:build_pip_package failed to build
Use --verbose_failures to see the command lines of failed build steps.
INFO: Elapsed time: 62.789s, Critical Path: 3.15s
INFO: 103 processes: 103 local.
FAILED: Build did NOT complete successfully

#cc1plus: out of memory allocating 236976 bytes after a total of 77238272 bytes

ModuleNotFoundError: No module named 'tensorflow.core'