Discuss Web Scraper and web scraping

Nov 2, 2019 · There is indeed an iframe, but the more difficult challenge is that the iframe contains the video player which loads videos dynamically from the server. So I don't think you can get …

Aug 19, 2018 · Describe the problem. I'm trying setup a scraper that selects "5 years" from the dropdown box in the link, then scrapes the data in table below. I tried replicating a similar …

Jan 22, 2019 · Hey @bretfeig, Thank you very much for your help, changing the Popup Link Selector to Element Attribute Selector did manage to get me some links and fill out the csv …

May 19, 2019 · HI Webber, Thankyou very much for your help. It works quite well. The only trouble i am having is the scraping is very slow. Chrome just seems to sit there and wait. On …

Dec 28, 2017 · 0.4.1 [Fix] web scraper didn't recognize an XHTML header and was ignoring pages with this header 0.4.0 New web scraper version released 0.3.8.9 [Feature] Added …

Jun 18, 2022 · This all works fine. When start the scraper, it is going through all the items. Now on every item, I would like to scrape the following information: This information is on the right of …

Jul 28, 2021 · Thanks, I'll give the second option a try. I was planning on having this map crawl through followers of followers and that would require the long delay trick multiple time …

Nov 8, 2022 · When trying to get the data from a popup, I get 'parent element not found. I can replicate the issue on websummit for example, see the example sitemap: Url: Meet the …

Aug 27, 2018 · Is there anyway to start scraping from a list of urls instead of a json sitemap? Alternatively is there a free tool that converts a list of plain urls into a json sitemap working with …