Excel VBA Introduction Part 47.1 - Browsing to Websites and Scraping a Web Page
Why Stack Overflow recommends it
Stack Overflow users link it as the go-to beginner walkthrough for scraping and automating websites from VBA with Internet Explorer.
Recommended by 6 people across 7 different months, 2017 to 2020.
What it is
A feature-length Wise Owl tutorial by Andrew Gould on scraping web pages from Excel VBA. It covers driving Internet Explorer and basic XML HTTP requests, the Document Object Model, finding HTML elements by name and tag, and looping through element collections, using an exchange rate table as the worked example.
What people said
Strong rec ashleedawg · 2018-06 · Stack Overflow · on “VBA code to scrape the price of particular project from URL”
Unless there's a reason you need to use those platforms, I'd suggest you go with just [tag:vba] and use [tag:internet-explorer] for such a straightforward scraping job, If you're interested, here's an **excellent tutoria**l [this video] . IE is pretty standard as a browser for use with VBA. (As a fellow Firefox user, VBA is the only reason I have IE installed. I've looked into using Firefox, and it's *possible* but there isn't a lot of docs/examples available for it.)
Recommends Torc · 2017-10 · Stack Overflow · on “HTML elements in VBA”
I believe that you can use "IE.Navigate" to find / go to different hrefs. After you find the href by name or class ID, you can append the href to get the full URL and then make IE navigate to it. For example: `IE.Navigate " [LINK] "` I haven't given this a try yet, but my first references for scraping HTML with VBA is WiseOwl Tutorials. There are 3-4 really good videos that are uploaded to his channel on YouTube. For example: [this video]
Recommends user6432984 · 2017-11 · Stack Overflow · on “VBA web Scraping problems”
This site isn't the easiest to scrape. To save time I iterated over all the divs with class="listing_item span4" and parsed their innerText. I recommend that you watch these videos: Excel VBA Introduction Part 5 - Selecting Cells (Range, Cells, Activecell, End, Offset) [LINK] Excel VBA Introduction Part 47 - Browsing to Websites and Scraping a Web Page [this video] Excel VBA Introduction Part 48 - Web Scraping Across Multiple Pages [LINK] [LINK] Sub scrape() Dim URL As String Dim aNext As HTMLAnchorElement, div As HTMLDivElement, doc As HTMLDocument URL = " [LINK] " Set IE = CreateObject("InternetExplorer.Application") IE.Visible = True Do IE.navigate URL Do DoEvents Loop Until IE.readyState = RE
Recommends SIM · 2018-05 · Stack Overflow · on “Web crawling Accuweather”
Knowledge on what? If about `.queySelectorAll()` you are talking then I've already provided with the link. However, if it is about webscraping then this link [this video] might help. Thanks.
Recommends SIM · 2018-08 · Stack Overflow · on “scraping web vba tags nested”
If you are here to learn things anew then you found the wrong site. If you have a minimum knowledge on it then the way `QHarr` has described in his post suffices. However, you can check out this link to a video tutorial [this video] to learn things the way you expected.
Recommends learningvbahurts · 2020-01 · Stack Overflow · on “How to enter data into an Internet Explorer website?”
I am trying to enter info into an Internet Explorer 11 website form. The website/form was designed a long time ago (around 15-20 years). The website can only be accessed through Internet Explorer. I cannot share the website/source code as it is internal to my company. I have browsed online for a solution, but none worked (I tried many different versions). I am looking to login, then go through a few pages of entering information, while clicking next/submit at each stage. I am failing after I login. I have the following references on Excel: Microsoft Internet Controls, Microsoft HTML Object Library, Microsoft XML, v6.0 I am following the wise owl tutorial [this video] . Skip to about 17 mins in to
Recommends TinMan · 2020-12 · Stack Overflow · on “I want to automate excel to search and get result from a website”
These resources will help: Excel VBA Introduction Part 46 - Querying Web Pages using Query Tables [LINK] And Excel VBA Introduction Part 47 - Browsing to Websites and Scraping a Web Page [this video] Excel VBA Introduction Part 48 - Web Scraping Across Multiple Pages [LINK]