Data Scraping - Fetch/Browser Automation?

Ask the community
,
1

Hi All,

I’ve discovered that we can use wix-fetch to GET a page source, then use a regEx to scrape relevant data I want. However, in certain instances the data I need is not readily available upon page load, so that fetch call isn’t quite pulling what I need. For example https://www.shapiro-ingle.com/sales.aspx?state=NC

The data I need is only viewable after a user clicks “search”. Then the data table I need populates and is available in the source code. So if I just fetch this URL, it won’t yet show the table.

What is the way to work-around this?

2

Hi,
You can use the fetch API on the onClick event of the search button. If you need to send an object, you can do it as explained in the MDN fetch documentation .

Good luck,
Tal.