Google News Search¶

Scraper to perform a Google News search and parse the results.

Example usage:

import asyncio
from webquest.browsers import Hyperbrowser
from webquest.scrapers import GoogleNewsSearch

async def main():
    scraper = GoogleNewsSearch(browser=Hyperbrowser())
    response = await scraper.run(
        scraper.request_model(query="Artificial Intelligence"),
    )
    print(response.model_dump_json(indent=4))

if __name__ == "__main__":
    asyncio.run(main())

Settings¶

GoogleNewsSearchSettings

Configuration settings for the Google News search scraper.

Name	Type	Default	Description
`result_limit`	`int`	`10`	The maximum number of results to return.
`character_limit`	`int`	`1000`	The maximum number of characters to parse.

Request¶

GoogleNewsSearchRequest

Represents a request to search Google News.

Name	Type	Default	Description
`query`	`str`	Required	The search query.

Response¶

GoogleNewsSearchResponse

Represents the response from a Google News search.

Name	Type	Default	Description
`articles`	`list[Article]`	Required	The list of articles found.

Article

Represents a news article found in Google News.

Name	Type	Default	Description
`site`	`str`	Required	The name of the news site.
`url`	`str`	Required	The URL of the article.
`title`	`str`	Required	The title of the article.
`published_at`	`str`	Required	The publication date of the article.