您好,欢迎访问一九零五行业门户网

python使用BeautifulSoup分析网页信息的方法

本文实例讲述了python使用beautifulsoup分析网页信息的方法。分享给大家供大家参考。具体如下:
这段python代码查找网页上的所有链接,分析所有的span标签,并查找class包含titletext的span的内容
复制代码 代码如下:#import the library used to query a website
import urllib2#specify the url you want to query
url = http://www.python.org
#query the website and return the html to the variable 'page'
page = urllib2.urlopen(url)
#import the beautiful soup functions to parse the data returned from the website
from beautifulsoup import beautifulsoup
#parse the html in the 'page' variable, and store it in beautiful soup format
soup = beautifulsoup(page)
#to print the soup.head is the head tag and soup.head.title is the title tag
print soup.head
print soup.head.title
#to print the length of the page, use the len function
print len(page)
#create a new variable to store the data you want to find.
tags = soup.findall('a')
#to print all the links
print tags
#to get all titles and print the contents of each title
titles = soup.findall('span', attrs = { 'class' : 'titletext' })
for title in alltitles:
print title.contents
希望本文所述对大家的python程序设计有所帮助。
其它类似信息

推荐信息