爬取中国天气网

最新推荐文章于 2025-01-16 00:25:03 发布

代码演奏家

最新推荐文章于 2025-01-16 00:25:03 发布

阅读量318

点赞数

CC 4.0 BY-SA版权

文章标签： python 爬虫 beatysooup

本文链接：https://blog.csdn.net/weixin_45312417/article/details/106268558

爬取城市和最低气温。

# 爬取全国所有城市名称和最低气温

# http://www.weather.com.cn/textFC/hb.shtml
import requests
from bs4 import BeautifulSoup

def parse_page(url):
    response = requests.get(url)
    text = response.content.decode('utf-8') # 解决乱码
    soup = BeautifulSoup(text,'html5lib')
    # 网页解析
    conMidtab = soup.find('div',class_= 'conMidtab')
    # table
    tables = conMidtab.find_all('table')
    # tr
    for table in tables:
        trs = table.find_all("tr")[2:]
        for tr in trs:
            city_td = tr.find_all('td')[-8]
            city = list(city_td.stripped_strings)[0] # 打印子孙节点的文本
            temp_td = tr.find_all('td')[-2]
            temp = list(temp_td.stripped_strings)[0]
            print(city,temp)


def main():
    areas = ['hb','hd','gat','hz']
    for area in areas:
        url = 'http://www.weather.com.cn/textFC/{}.shtml'.format(area)
        parse_page(url)


if __name__ == '__main__':
    main()