Python Web Scraping Cookbook
上QQ阅读APP看书,第一时间看更新

Getting ready

As an example, we will build a vary simple ETL process that will read the main planets page and store the planets data in MySQL. It will also pass a single message for each more info link in the page to a queue, where 0 or more processes can receive those requests and perform further processing on those links.

To access SQS from Python, we will revisit using the boto3 library.