阿里云服务器安装Python3.7.0 + Selenium + ChromDriver

前言

阿里云服务器一般都自带了Python2.7.5版本,由于写的程序是在Python3.7.0api之上完成的,这里记录下阿里云服务器安装Python3.7.0安装过程

检查安装环境

  • gcc 检查安装

    1
    2
    3
    4
    5
    6
    7
    # 首先安装gcc编译器,gcc有些系统版本已经默认安装
    gcc --version
    gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-28)
    Copyright (C) 2015 Free Software Foundation, Inc.
    This is free software; see the source for copying conditions. There is NO
    warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
    # 以上命令检查,没安装的先安装gcc,yum -y install gcc
  • libffi-devel安装

    1
    2
    # 安装其它依赖包,(注:不要缺少,否则有可能安装python出错,python3.7.0以下的版本可不装 libffi-devel )
    yum -y install zlib-devel bzip2-devel openssl-devel ncurses-devel sqlite-devel readline-devel tk-devel gdbm-devel db4-devel libpcap-devel xz-devel libffi-devel

Python3.7.0安装

python源码包下载地址:https://www.python.org/ftp/python/

  • 下载(个人网盘下载地址,我这里安装的是3.7.0)

    1
    wget https://www.python.org/ftp/python/3.7.0/Python-3.7.0.tgz
  • 解压

    1
    tar -zxvf Python-3.7.0.tgz
  • 创建一个安装目录

    1
    mkdir /usr/local/python3
  • 执行配置文件、编译、安装

    1
    2
    3
    cd Python-3.7.0
    ./configure --prefix=/usr/local/python3
    make && make install
  • 建立连接

    1
    2
    ln -s /usr/local/python3/bin/python3.7 /usr/bin/python3
    ln -s /usr/local/python3/bin/pip3.7 /usr/bin/pip3
  • 验证测试

    1
    2
    3
    4
    5
    6
    7
    [root@izwz94664y88uf68wjzri0z Python-3.7.0]# python3
    Python 3.7.0 (default, Nov 28 2018, 19:02:41)
    [GCC 4.8.5 20150623 (Red Hat 4.8.5-28)] on linux
    Type "help", "copyright", "credits" or "license" for more information.
    >>> exit()
    [root@izwz94664y88uf68wjzri0z bin]# pip3 --version
    pip 10.0.1 from /usr/local/python3/lib/python3.7/site-packages/pip (python 3.7)

Pip3 安装Selenium

1
2
3
4
5
6
7
8
9
10
11
12
13
# 安装好python之后,默认就可以执行pip命令
[root@izwz94664y88uf68wjzri0z bin]# pip3 install selenium
Looking in indexes: http://mirrors.aliyun.com/pypi/simple/
Collecting selenium
Downloading http://mirrors.aliyun.com/pypi/packages/80/d6/4294f0b4bce4de0abf13e17190289f9d0613b0a44e5dd6a7f5ca98459853/selenium-3.141.0-py2.py3-none-any.whl (904kB)
100% |████████████████████████████████| 911kB 106.4MB/s
Collecting urllib3 (from selenium)
Downloading http://mirrors.aliyun.com/pypi/packages/62/00/ee1d7de624db8ba7090d1226aebefab96a2c71cd5cfa7629d6ad3f61b79e/urllib3-1.24.1-py2.py3-none-any.whl (118kB)
100% |████████████████████████████████| 122kB 95.4MB/s
Installing collected packages: urllib3, selenium
Successfully installed selenium-3.141.0 urllib3-1.24.1
You are using pip version 10.0.1, however version 18.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.

Chrome & ChromeDriver安装

  • Chrome安装

    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    12
    13
    # 下载到本地再安装
    wget https://dl.google.com/linux/direct/google-chrome-stable_current_x86_64.rpm
    yum install ./google-chrome-stable_current_x86_64.rpm

    # 安装必要的库
    yum install mesa-libOSMesa-devel gnu-free-sans-fonts wqy-zenhei-fonts

    # 检查安装后确认/usr/bin目录下是否有google-chrome文件
    [root@izwz94664y88uf68wjzri0z bin]# ls /usr/bin/google-chrome
    /usr/bin/google-chrome
    # 查看chrome浏览器版本
    [root@izwz94664y88uf68wjzri0z soft]# google-chrome --version
    Google Chrome 70.0.3538.110
  • ChromeDriver安装

    chromeDriver官网下载地址:http://chromedriver.storage.googleapis.com/index.html,我这里下载对应的是70版本开头的

    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    12
    # chrome官网  wget下载
    [root@izwz94664y88uf68wjzri0z soft]# wget http://chromedriver.storage.googleapis.com/70.0.3538.97/chromedriver_linux64.zip
    # 解压赋予权限
    [root@izwz94664y88uf68wjzri0z soft]# unzip chromedriver_linux64.zip
    [root@izwz94664y88uf68wjzri0z soft]# chmod +x chromedriver
    [root@izwz94664y88uf68wjzri0z soft]# sudo mv -f chromedriver /usr/local/share/chromedriver
    # 建立连接
    [root@izwz94664y88uf68wjzri0z soft]# sudo ln -s /usr/local/share/chromedriver /usr/local/bin/chromedriver
    [root@izwz94664y88uf68wjzri0z soft]# sudo ln -s /usr/local/share/chromedriver /usr/bin/chromedriver
    # 检查安装版本
    [root@izwz94664y88uf68wjzri0z soft]# chromedriver --version
    ChromeDriver 70.0.3538.97 (d035916fe243477005bc95fe2a5778b8f20b6ae1)

总结

阿里云部署爬虫程序,发现需要这么依赖包,记录下吧。另外由于安装的是Python3.x,导致之前的安装的webpy无法使用了,之前安装的是0.38版本只支持Python2.x。不过幸好针对Python3.x已经有对应的版本,不过据说还只是开发版,不过对于我来说也够用了。

下载地址:https://github.com/webpy/webpy

安装方式与0.38webpy版本一样

分享到 评论