presto-amin installtion failures

Presto
Teradata Employee

presto-amin installtion failures

Hi All,

 

My OS:

dbs179:~ # uname -a
Linux dbs179 3.0.101-0.101.TDC.1.R.0-default #1 SMP Wed Oct 19 00:35:50 PDT 2016 (d85af46) x86_64 x86_64 x86_64 GNU/Linux

 

Trying to install "prestoadmin-2.2-offline.el6.tar.gz"

 

We are getting Below Failure on multiple systems.

 

dbs179:/tmp/presto-sw/prestoadmin # ./install-prestoadmin.sh
virtualenv-12.0.7/
virtualenv-12.0.7/AUTHORS.txt
virtualenv-12.0.7/bin/
virtualenv-12.0.7/bin/rebuild-script.py
virtualenv-12.0.7/docs/
virtualenv-12.0.7/docs/changes.rst
virtualenv-12.0.7/docs/conf.py
virtualenv-12.0.7/docs/development.rst
virtualenv-12.0.7/docs/index.rst
virtualenv-12.0.7/docs/installation.rst
virtualenv-12.0.7/docs/make.bat
virtualenv-12.0.7/docs/Makefile
virtualenv-12.0.7/docs/reference.rst
virtualenv-12.0.7/docs/userguide.rst
virtualenv-12.0.7/LICENSE.txt
virtualenv-12.0.7/MANIFEST.in
virtualenv-12.0.7/PKG-INFO
virtualenv-12.0.7/README.rst
virtualenv-12.0.7/scripts/
virtualenv-12.0.7/scripts/virtualenv
virtualenv-12.0.7/setup.cfg
virtualenv-12.0.7/setup.py
virtualenv-12.0.7/virtualenv.egg-info/
virtualenv-12.0.7/virtualenv.egg-info/dependency_links.txt
virtualenv-12.0.7/virtualenv.egg-info/entry_points.txt
virtualenv-12.0.7/virtualenv.egg-info/not-zip-safe
virtualenv-12.0.7/virtualenv.egg-info/pbr.json
virtualenv-12.0.7/virtualenv.egg-info/PKG-INFO
virtualenv-12.0.7/virtualenv.egg-info/SOURCES.txt
virtualenv-12.0.7/virtualenv.egg-info/top_level.txt
virtualenv-12.0.7/virtualenv.py
virtualenv-12.0.7/virtualenv_embedded/
virtualenv-12.0.7/virtualenv_embedded/activate.bat
virtualenv-12.0.7/virtualenv_embedded/activate.csh
virtualenv-12.0.7/virtualenv_embedded/activate.fish
virtualenv-12.0.7/virtualenv_embedded/activate.ps1
virtualenv-12.0.7/virtualenv_embedded/activate.sh
virtualenv-12.0.7/virtualenv_embedded/activate_this.py
virtualenv-12.0.7/virtualenv_embedded/deactivate.bat
virtualenv-12.0.7/virtualenv_embedded/distutils-init.py
virtualenv-12.0.7/virtualenv_embedded/distutils.cfg
virtualenv-12.0.7/virtualenv_embedded/site.py
virtualenv-12.0.7/virtualenv_support/
virtualenv-12.0.7/virtualenv_support/__init__.py
virtualenv-12.0.7/virtualenv_support/pip-6.0.8-py2.py3-none-any.whl
virtualenv-12.0.7/virtualenv_support/setuptools-12.0.5-py2.py3-none-any.whl
New python executable in presto-admin-install/bin/python
Installing setuptools, pip...
  Complete output from command /tmp/presto-sw/prest...n-install/bin/python -c "import sys, pip; sys...d\"] + sys.argv[1:]))" setuptools pip:
  Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/tmp/presto-sw/prestoadmin/third-party/virtualenv-12.0.7/virtualenv_support/pip-6.0.8-py2.py3-none-any.whl/pip/__init__.py", line 15, in <module>
  File "/tmp/presto-sw/prestoadmin/third-party/virtualenv-12.0.7/virtualenv_support/pip-6.0.8-py2.py3-none-any.whl/pip/vcs/subversion.py", line 9, in <module>
  File "/tmp/presto-sw/prestoadmin/third-party/virtualenv-12.0.7/virtualenv_support/pip-6.0.8-py2.py3-none-any.whl/pip/index.py", line 29, in <module>
  File "/tmp/presto-sw/prestoadmin/third-party/virtualenv-12.0.7/virtualenv_support/pip-6.0.8-py2.py3-none-any.whl/pip/_vendor/__init__.py", line 81, in load_module
ImportError: No module named 'pip._vendor.html5lib'
----------------------------------------
...Installing setuptools, pip...done.
Traceback (most recent call last):
  File "third-party/virtualenv-12.0.7/virtualenv.py", line 2352, in <module>
    main()
  File "third-party/virtualenv-12.0.7/virtualenv.py", line 825, in main
    symlink=options.symlink)
  File "third-party/virtualenv-12.0.7/virtualenv.py", line 993, in create_environment
    install_wheel(to_install, py_executable, search_dirs)
  File "third-party/virtualenv-12.0.7/virtualenv.py", line 961, in install_wheel
    'PIP_NO_INDEX': '1'
  File "third-party/virtualenv-12.0.7/virtualenv.py", line 903, in call_subprocess
    % (cmd_desc, proc.returncode))
OSError: Command /tmp/presto-sw/prest...n-install/bin/python -c "import sys, pip; sys...d\"] + sys.argv[1:]))" setuptools pip failed with error code 1

 

7 REPLIES
Teradata Employee

Re: presto-amin installtion failures

What version of Python do you have? Is there any reason you're using the offline installer? We recommend using the online installer unless your machine doesn't have access to the Internet.

 

It seems that the installation is failing at setting up a virtua env so it's not a problem with presto-admin but rather your python setup.

Download this version of virtualenv: https://pypi.python.org/packages/14/a4/3145f84afd46a3a74717d97f0c58a7a6442876e7712b209c5070cf34a3be/... and follow the installation from source instructions here: https://virtualenv.pypa.io/en/stable/installation/.

Once you figure out why a virtualenv can't be created on your machine you should be able to re-run the presto-admin installation script to success.

 

Hope this helps!

Teradata Employee

Re: presto-amin installtion failures

I installed it from Path you mentioned. I am still getting same Failre.

 

 

dbs179:/tmp/presto-sw/virtualenv-12.0.7 # python setup.py install
running install
running build
running build_py
creating build
creating build/lib
copying virtualenv.py -> build/lib
creating build/lib/virtualenv_support
copying virtualenv_support/__init__.py -> build/lib/virtualenv_support
copying virtualenv_support/setuptools-12.0.5-py2.py3-none-any.whl -> build/lib/virtualenv_support
copying virtualenv_support/pip-6.0.8-py2.py3-none-any.whl -> build/lib/virtualenv_support
running build_scripts
creating build/scripts-2.6
copying and adjusting scripts/virtualenv -> build/scripts-2.6
copying and adjusting scripts/virtualenv-2.6 -> build/scripts-2.6
changing mode of build/scripts-2.6/virtualenv from 640 to 755
changing mode of build/scripts-2.6/virtualenv-2.6 from 640 to 755
running install_lib
creating /usr/local/lib64/python2.6
creating /usr/local/lib64/python2.6/site-packages
creating /usr/local/lib64/python2.6/site-packages/virtualenv_support
copying build/lib/virtualenv_support/__init__.py -> /usr/local/lib64/python2.6/site-packages/virtualenv_support
copying build/lib/virtualenv_support/setuptools-12.0.5-py2.py3-none-any.whl -> /usr/local/lib64/python2.6/site-packages/virtualenv_support
copying build/lib/virtualenv_support/pip-6.0.8-py2.py3-none-any.whl -> /usr/local/lib64/python2.6/site-packages/virtualenv_support
copying build/lib/virtualenv.py -> /usr/local/lib64/python2.6/site-packages
byte-compiling /usr/local/lib64/python2.6/site-packages/virtualenv_support/__init__.py to __init__.pyc
byte-compiling /usr/local/lib64/python2.6/site-packages/virtualenv.py to virtualenv.pyc
running install_scripts
copying build/scripts-2.6/virtualenv -> /usr/local/bin
copying build/scripts-2.6/virtualenv-2.6 -> /usr/local/bin
changing mode of /usr/local/bin/virtualenv to 755
changing mode of /usr/local/bin/virtualenv-2.6 to 755
running install_egg_info
Writing /usr/local/lib64/python2.6/site-packages/virtualenv-12.0.7-py2.6.egg-info

 

## Getting Below Failure Again.

virtualenv-12.0.7/virtualenv_support/pip-6.0.8-py2.py3-none-any.whl
virtualenv-12.0.7/virtualenv_support/setuptools-12.0.5-py2.py3-none-any.whl
New python executable in presto-admin-install/bin/python
Installing setuptools, pip...
  Complete output from command /tmp/presto-sw/prest...n-install/bin/python -c "import sys, pip; sys...d\"] + sys.argv[1:]))" setuptools pip:
  Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/tmp/presto-sw/prestoadmin/third-party/virtualenv-12.0.7/virtualenv_support/pip-6.0.8-py2.py3-none-any.whl/pip/__init__.py", line 15, in <module>
  File "/tmp/presto-sw/prestoadmin/third-party/virtualenv-12.0.7/virtualenv_support/pip-6.0.8-py2.py3-none-any.whl/pip/vcs/subversion.py", line 9, in <module>
  File "/tmp/presto-sw/prestoadmin/third-party/virtualenv-12.0.7/virtualenv_support/pip-6.0.8-py2.py3-none-any.whl/pip/index.py", line 29, in <module>
  File "/tmp/presto-sw/prestoadmin/third-party/virtualenv-12.0.7/virtualenv_support/pip-6.0.8-py2.py3-none-any.whl/pip/_vendor/__init__.py", line 81, in load_module
ImportError: No module named 'pip._vendor.html5lib'
----------------------------------------
...Installing setuptools, pip...done.
Traceback (most recent call last):
  File "third-party/virtualenv-12.0.7/virtualenv.py", line 2352, in <module>
    main()
  File "third-party/virtualenv-12.0.7/virtualenv.py", line 825, in main
    symlink=options.symlink)
  File "third-party/virtualenv-12.0.7/virtualenv.py", line 993, in create_environment
    install_wheel(to_install, py_executable, search_dirs)
  File "third-party/virtualenv-12.0.7/virtualenv.py", line 961, in install_wheel
    'PIP_NO_INDEX': '1'
  File "third-party/virtualenv-12.0.7/virtualenv.py", line 903, in call_subprocess
    % (cmd_desc, proc.returncode))
OSError: Command /tmp/presto-sw/prest...n-install/bin/python -c "import sys, pip; sys...d\"] + sys.argv[1:]))" setuptools pip failed with error code 1

 

Teradata Employee

Re: presto-amin installtion failures

You did not answer the two questions I asked at the beginning of my reply.

 

Yes I expected you to run into the same problem by installing virtualenv manually. That demonstrates this is a problem with your Python installation and not with presto-admin.

This discussion may be relevant: https://github.com/pypa/pip/issues/2345.

Teradata Employee

Re: presto-amin installtion failures

I do not have my system connected to Internet.

 

My Pyhons is:

dbs179:~ # python
Python 2.6.9 (unknown, Aug  5 2016, 11:15:31)
[GCC 4.3.4 [gcc-4_3-branch revision 152973]] on linux2
Type "help", "copyright", "credits" or "license" for more information.

 

Whats best way I can fix this?

Teradata Employee

Re: presto-amin installtion failures

Did you get a chance to read the Github discussion I posted? The last reply seems to suggest that the problem is with SSL. Try installing the open SSL devel files 'yum install openssl-devel'. Another package worth installing is python-devel. I tried installing the same virtualenv on Centos 6.8 with Python 2.6.6 and didn't run into your problem.

I don't know how you can fix this, you'll have to debug the issue yourself. I suggest trying to install pip manually and Googling any errors your run into.

Enthusiast

Re: presto-amin installtion failures

Hello, sorry for taking back to life and old thread, but I am having the same issue. 

 

I created 3 VMs (KVM) for a Presto cluster, since we are integrating Teradata QueryGrid with some non-Teradata databases and Presto will serve as a gateway.

 

I had the same message "ImportError: No module named 'pip._vendor.html5lib'" when running install-prestoadmin.sh, extracted from the prestoadmin-2.2-offline* packages.

 

Each VM runs a SUSE Linux Enterprise Server 11 (x86_64) VERSION = 11 PATCHLEVEL = 3, or for short, SLES11SP3, under a repurposed TMS server.

 

I got access to a SLES11P3 SDK repository and did install zlib-devel, libopenssl-devel and python-devel packages.

 

I cannot use the online prestoadmin packages, since this is a sever under strict firewall rules.

https://teradata.github.io/presto/docs/current/presto-admin/installation/presto-admin-installation.h...

 

Any ideas of what can be done?

 

Enthusiast

Re: presto-amin installtion failures

Solved the issue here.

 

Actually to work with SLES 11 SP3, it is needed to user only the online distribuition package of prestoadmin. the offline package works only within RedHat or CentOS.

 

Some commands I used to solve all the dependencies (note - needs the SLES 11 SP3 SDK files):

zypper in gcc
--> Solution 1: ... downgrade of libgcc_s1-4.7.2_20130108-0.19.3.x86_64 to libgcc_s1-4.7.2_20130108-0.15.45.x86_64 ...

zypper install python-xml
--> Solution 1: ... downgrade of python-2.6.9-0.35.1.x86_64 to python-2.6.8-0.15.1.x86_64 ...

zypper in python-devel-2.6.8-0.15.1.x86_64.rpm
--> Ignore the message "The following package is not supported by its vendor: ... python-devel"

zypper in python-setuptools-0.6c8-10.19.2.1.x86_64.rpm
--> Ignore the message "The following package is not supported by its vendor: ... python-setuptools"

zypper in zlib-devel-1.2.7-0.10.128.x86_64.rpm
--> Ignore the message "The following package is not supported by its vendor: ... zlib-devel ..."

zypper in libopenssl-devel-0.9.8j-0.50.1.x86_64.rpm
--> Ignore the message "The following package is not supported by its vendor: ... libopenssl-devel ..."

 

*****If the server is in a protected LAN****

export http_proxy="http://yourproxy:port"
export ftp_proxy="http://yourproxy:port"
export https_proxy="http://yourproxy:port"

 

After that I did run ./install-prestoadmin.sh without problems.