【Python3.6】BeautifulSoupのインストール＆実行手順

[test@test07 ~]$ sudo pip3 install beautifulsoup4
Collecting beautifulsoup4
Downloading beautifulsoup4-4.6.0-py3-none-any.whl (86kB)
100% |????????????????????????????????| 92kB 5.9MB/s
Installing collected packages: beautifulsoup4
Successfully installed beautifulsoup4-4.6.0
[test@test07 ~]$

[test@test07 ~]$ which yum
/usr/bin/yum

[test@test07 ~]$ head /usr/bin/yum　←　yum コマンドの先頭の10行を読み出します。
#!/usr/bin/python　←　「/usr/bin/python」です。
import sys
try:
import yum
except ImportError:
print >> sys.stderr, “””\
There was a problem importing one of the Python modules
required to run yum. The error leading to this problem was:

[test@test07 ~]$ /usr/bin/python –version
Python 2.7.5
[test@test07 ~]$

[test@test07 ~]$ which pip3
/usr/bin/pip3
[test@test07 ~]$ which pip
/usr/bin/pip

[test@test07 bin]$ ls -l /usr/bin/pip*
-rwxr-xr-x 1 root root 204 8月 19 08:15 pip
-rwxr-xr-x 1 root root 204 8月 19 08:15 pip3
-rwxr-xr-x 1 root root 204 8月 19 08:15 pip3.6
[test@test07 bin]$ diff pip pip3
[test@test07 bin]$ diff pip pip3.6
[test@test07 bin]$

[test@test07 bin]$ cat pip
#!/bin/python3.6

# -*- coding: utf-8 -*-
import re
import sys

from pip import main

if __name__ == ‘__main__’:
sys.argv[0] = re.sub(r'(-script\.pyw?|\.exe)?$’, ”, sys.argv[0])
sys.exit(main())
[test@test07 bin]$

[test@test07 bin]$ cat pip3
#!/bin/python3.6

# -*- coding: utf-8 -*-
import re
import sys

from pip import main

if __name__ == ‘__main__’:
sys.argv[0] = re.sub(r'(-script\.pyw?|\.exe)?$’, ”, sys.argv[0])
sys.exit(main())

[test@test07 pip_download]$ sudo python3.6 get-pip.py

[test@test07 pip_download]$ pip -V
pip 9.0.1 from /usr/lib/python3.6/site-packages (python 3.6)

[test@test07 bin]$ python3.6
Python 3.6.2 (default, Jul 18 2017, 22:59:34)
[GCC 4.8.5 20150623 (Red Hat 4.8.5-11)] on linux
Type “help”, “copyright”, “credits” or “license” for more information.
>>> from bs4 import BeautifulSoup　←　この行を入力します。
>>>　←　エラーにならなければインストールは正常にできています。
>>> exit()
[test@test07 bin]$

[test@test07 Python]$ vi beatifulsoup.py
from urllib.request import urlopen
from bs4 import BeautifulSoup

html = urlopen(“http://www.pythonscraping.com/pages/page1.html”)
bsObj = BeautifulSoup(html.read())
print(bsObj.h1)

[test@test07 Python]$

[test@test07 Python]$ python3.6 beatifulsoup.py
/usr/lib/python3.6/site-packages/bs4/__init__.py:181: UserWarning: No parser was explicitly specified, so I’m using the best available HTML parser for this system (“html.parser”). This usually isn’t a problem, but if you run this code on another system, or in a different virtual environment, it may use a different parser and behave differently.

The code that caused this warning is on line 5 of the file beatifulsoup.py. To get rid of this warning, change code that looks like this:

　BeautifulSoup(YOUR_MARKUP})

to this:

　BeautifulSoup(YOUR_MARKUP, “html.parser”)

　markup_type=markup_type))
<h1>An Interesting Title</h1>　←　<h1></h1>タグの情報を取得できました。
[test@test07 Python]$

/usr/lib/python3.6/site-packages/bs4/__init__.py:181: UserWarning: No parser was explicitly specified, so I’m using the best available HTML parser for this system (“html.parser”). This usually isn’t a problem, but if you run this code on another system, or in a different virtual environment, it may use a different parser and behave differently.

The code that caused this warning is on line 5 of the file beatifulsoup.py. To get rid of this warning, change code that looks like this:

BeautifulSoup(YOUR_MARKUP})

to this:

BeautifulSoup(YOUR_MARKUP, “html.parser”)

markup_type=markup_type))

from urllib.request import urlopen
from bs4 import BeautifulSoup

html = urlopen(“http://www.pythonscraping.com/pages/page1.html”)
#bsObj = BeautifulSoup(html.read())　←　コメントアウトします。

bsObj = BeautifulSoup(html.read(),”html.parser”)　←　追加します。
print(bsObj.h1)

[test@test07 Python]$ python3.6 beatifulsoup.py
<h1>An Interesting Title</h1>