【playwright】访问不同链接方法

最新推荐文章于 2025-05-07 00:08:26 发布

原创最新推荐文章于 2025-05-07 00:08:26 发布 · 648 阅读

0 ·

CC 4.0 BY-SA版权

本文为博主原创文章，未经博主允许不得转载。

文章标签：

#python

爬虫专栏收录该内容

9 篇文章

订阅专栏

本文介绍了两种使用Python的Playwright库在不同的浏览器中打开新页面并访问URL的方法，包括在一个浏览器中新开多个标签页以及独立创建新浏览器实例。作者演示了如何等待页面加载完成并提取链接信息。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

every blog every motto: You can do more than you think.
https://blog.csdn.net/weixin_39190382?type=blog

0. 前言

访问不同页面方法方法比较

browser.new_page()
page = context.new_page()

1. 访问不同url

1.1 方法一

browser.new_page()
打开多个浏览器，然后再浏览器中访问链接

from playwright.sync_api import sync_playwright

url = 'https://www.baidu.com/'

def run(playwright):
    chromium = playwright.chromium  # or "firefox" or "webkit".
    browser = chromium.launch(headless=False, slow_mo=100)
    page = browser.new_page()
    page.goto(url)

    page.wait_for_load_state('networkidle')
    elements = page.query_selector_all('#s-top-left > a')
    print(elements)
    for ele in elements:
        href = ele.get_attribute('href')
        text = ele.inner_text()
        print(href, text)
        np = browser.new_page()
        np.goto(href)
   
    browser.close()

with sync_playwright() as playwright:
    run(playwright)

在这里插入图片描述

1.2 方法二

page = context.new_page()
再一个浏览器打开多个标签页（选项卡），

from playwright.sync_api import sync_playwright

url = 'https://www.baidu.com/'

def run(playwright):

    chromium = playwright.chromium  # or "firefox" or "webkit".
    browser = chromium.launch(headless=False, slow_mo=100)
    context = browser.new_context()
    page = context.new_page()

    page.goto(url)
    # 等待页面加载完成
    page.wait_for_load_state('networkidle')
    elements = page.query_selector_all('#s-top-left > a')
    print(elements)
    for ele in elements:
        href = ele.get_attribute('href')
        text = ele.inner_text()
        print(href, text)
        page = context.new_page()

        page.goto(href)

with sync_playwright() as playwright:
    run(playwright)