文章詳情頁

python beautiful soup庫入門安裝教程

瀏覽：21日期：2022-08-06 18:29:08

目錄beautiful soup庫的安裝beautiful soup庫的理解beautiful soup庫的引用BeautifulSoup類回顧demo.htmlTag標(biāo)簽Tag的nameTag的attrs（屬性）Tag的NavigableStringHTML基本格式標(biāo)簽樹的下行遍歷標(biāo)簽樹的上行遍歷標(biāo)簽的平行遍歷bs庫的prettify()方法bs4庫的編碼beautiful soup庫的安裝

pip install beautifulsoup4beautiful soup庫的理解

beautiful soup庫是解析、遍歷、維護(hù)“標(biāo)簽樹”的功能庫

beautiful soup庫的引用

from bs4 import BeautifulSoupimport bs4BeautifulSoup類

BeautifulSoup對(duì)應(yīng)一個(gè)HTML/XML文檔的全部內(nèi)容

回顧demo.html

import requestsr = requests.get('http://python123.io/ws/demo.html')demo = r.textprint(demo)

<html><head><title>This is a python demo page</title></head><body>The demo python introduces several python courses.Python is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses:<a id='link1'>Basic Python</a> and <a id='link2'>Advanced Python</a>.</body></html>Tag標(biāo)簽

基本元素說明 Tag 標(biāo)簽，最基本的信息組織單元，分別用<>和</>標(biāo)明開頭和結(jié)尾

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')print(soup.title)tag = soup.aprint(tag)

<title>This is a python demo page</title><a >Basic Python</a>

任何存在于HTML語法中的標(biāo)簽都可以用soup.訪問獲得。當(dāng)HTML文檔中存在多個(gè)相同對(duì)應(yīng)內(nèi)容時(shí)，soup.返回第一個(gè)

Tag的name

基本元素說明 Name 標(biāo)簽的名字，

…

的名字是’p’,格式：.name

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')print(soup.a.name)print(soup.a.parent.name)print(soup.a.parent.parent.name)

ap bodyTag的attrs（屬性）

基本元素說明 Attributes 標(biāo)簽的屬性，字典形式組織，格式：.attrs

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')tag = soup.aprint(tag.attrs)print(tag.attrs[’class’])print(tag.attrs[’href’])print(type(tag.attrs))print(type(tag))

{’href’: ’http://www.icourse163.org/course/BIT-268001’, ’class’: [’py1’], ’id’: ’link1’}[’py1’]http://www.icourse163.org/course/BIT-268001<class ’dict’><class ’bs4.element.Tag’>Tag的NavigableString

Tag的NavigableString

基本元素說明 NavigableString 標(biāo)簽內(nèi)非屬性字符串，<>…</>中字符串，格式：.string

Tag的Comment

基本元素說明 Comment 標(biāo)簽內(nèi)字符串的注釋部分，一種特殊的Comment類型

import requestsfrom bs4 import BeautifulSoupnewsoup = BeautifulSoup('This is not a comment','html.parser')print(newsoup.b.string)print(type(newsoup.b.string))print(newsoup.p.string)print(type(newsoup.p.string))

This is a comment<class ’bs4.element.Comment’>This is not a comment<class ’bs4.element.NavigableString’>HTML基本格式標(biāo)簽樹的下行遍歷

屬性說明 .contents 子節(jié)點(diǎn)的列表，將所有兒子結(jié)點(diǎn)存入列表 .children 子節(jié)點(diǎn)的迭代類型，與.contents類似，用于循環(huán)遍歷兒子結(jié)點(diǎn) .descendents 子孫節(jié)點(diǎn)的迭代類型，包含所有子孫節(jié)點(diǎn)，用于循環(huán)遍歷

BeautifulSoup類型是標(biāo)簽樹的根節(jié)點(diǎn)

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')print(soup.head)print(soup.head.contents)print(soup.body.contents)print(len(soup.body.contents))print(soup.body.contents[1])

<head><title>This is a python demo page</title></head>[<title>This is a python demo page</title>][’n’, The demo python introduces several python courses., ’n’, Python is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses:<a >Basic Python</a> and <a >Advanced Python</a>., ’n’]5The demo python introduces several python courses.

for child in soup.body.children:print(child) #遍歷兒子結(jié)點(diǎn)for child in soup.body.descendants:print(child) #遍歷子孫節(jié)點(diǎn)標(biāo)簽樹的上行遍歷

屬性說明 .parent 節(jié)點(diǎn)的父親標(biāo)簽 .parents 節(jié)點(diǎn)先輩標(biāo)簽的迭代類型，用于循環(huán)遍歷先輩節(jié)點(diǎn)

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')print(soup.title.parent)print(soup.html.parent)

<head><title>This is a python demo page</title></head><html><head><title>This is a python demo page</title></head><body>The demo python introduces several python courses.Python is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses:<a >Basic Python</a> and <a >Advanced Python</a>.</body></html>

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')for parent in soup.a.parents: if parent is None:print(parent) else:print(parent.name)

pbody html [document]標(biāo)簽的平行遍歷屬性說明 .next_sibling 返回按照HTML文本順序的下一個(gè)平行節(jié)點(diǎn)標(biāo)簽 .previous.sibling 返回按照HTML文本順序的上一個(gè)平行節(jié)點(diǎn)標(biāo)簽 .next_siblings 迭代類型，返回按照HTML文本順序的后續(xù)所有平行節(jié)點(diǎn)標(biāo)簽 .previous.siblings 迭代類型，返回按照HTML文本順序的前續(xù)所有平行節(jié)點(diǎn)標(biāo)簽

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')print(soup.a.next_sibling)print(soup.a.next_sibling.next_sibling)print(soup.a.previous_sibling)print(soup.a.previous_sibling.previous_sibling)print(soup.a.parent)

and <a id='link2'>Advanced Python</a>Python is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses:NonePython is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses:<a id='link1'>Basic Python</a> and <a id='link2'>Advanced Python</a>.

for sibling in soup.a.next_sibling:print(sibling) #遍歷后續(xù)節(jié)點(diǎn)for sibling in soup.a.previous_sibling:print(sibling) #遍歷前續(xù)節(jié)點(diǎn)

python beautiful soup庫入門安裝教程

bs庫的prettify()方法

import requestsfrom bs4 import BeautifulSoupr = requests.get('http://python123.io/ws/demo.html')demo = r.textsoup = BeautifulSoup(demo,'html.parser')print(soup.prettify())

<html> <head> <title> This is a python demo page </title> </head> <body> The demo python introduces several python courses. Python is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses: Basic Python </a> and <a id='link2'> Advanced Python </a> . </body></html>

.prettify()為HTML文本<>及其內(nèi)容增加更加’n’.prettify()可用于標(biāo)簽，方法：.prettify()

bs4庫的編碼

bs4庫將任何HTML輸入都變成utf-8編碼python 3.x默認(rèn)支持編碼是utf-8,解析無障礙

import requestsfrom bs4 import BeautifulSoupsoup = BeautifulSoup('中文','html.parser')print(soup.p.string)print(soup.p.prettify())

中文 中文

到此這篇關(guān)于python beautiful soup庫入門安裝教程的文章就介紹到這了,更多相關(guān)python beautiful soup庫入門內(nèi)容請(qǐng)搜索好吧啦網(wǎng)以前的文章或繼續(xù)瀏覽下面的相關(guān)文章希望大家以后多多支持好吧啦網(wǎng)！

Python 編程

上一條：Python BeautifulSoup基本用法詳解(通過標(biāo)簽及class定位元素)下一條：Python torch.flatten()函數(shù)案例詳解

相關(guān)文章：

1. idea重置默認(rèn)配置的方法步驟2. idea給項(xiàng)目打war包的方法步驟3. IntelliJ IDEA設(shè)置自動(dòng)提示功能快捷鍵的方法4. IntelliJ IDEA安裝插件的方法步驟5. IntelliJ IDEA設(shè)置背景圖片的方法步驟6. idea 打包的jar運(yùn)行報(bào) "XXX中沒有主清單屬性"7. Docker 部署 Prometheus的安裝詳細(xì)教程8. idea打開多個(gè)窗口的操作方法9. IntelliJ IDEA調(diào)整字體大小的方法10. IntelliJ IDEA刪除類的方法步驟

排行榜

					
					idea 打包的jar運(yùn)行報(bào) "XXX中沒有主清單屬性"
IntelliJ IDEA設(shè)置背景圖片的方法步驟
IntelliJ IDEA安裝插件的方法步驟
Docker 部署 Prometheus的安裝詳細(xì)教程
idea給項(xiàng)目打war包的方法步驟
IntelliJ IDEA設(shè)置自動(dòng)提示功能快捷鍵的方法
idea重置默認(rèn)配置的方法步驟
php過濾器使用詳解
IntelliJ IDEA調(diào)整字體大小的方法
idea打開多個(gè)窗口的操作方法
docker /var/lib/docker/aufs/mnt 目錄清理方法
				