Scraping Data

From WPRDC Wiki
Revision as of 18:48, 10 February 2023 by DRW (talk | contribs) (Create "Scraping Data" page)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

So you want to scrape data from some web page on a regular basis, huh?

Here are some ways you could do it:

A pure Google-Sheets-based approach, which can be set to run hourly, daily, or on other schedules: https://www.computerworld.com/article/3684733/how-to-create-automatically-updating-google-sheet.html

A pure GitHub-based approach (exploiting GitHub actions): https://simonwillison.net/2020/Oct/9/git-scraping/