We chose the idea of this project by thinking about what we wanted to learn from this hackathon, and then aligning our project with that. Both me and David were interested in the process of web scraping and harnessing that information, so we decided to make the shopping scraper. The shopping scraper searches the web for reviews of products, filtering by keyword. It will then identify how many times a product shows up in reviews of that type of product or lists of the best items that serve the same purpose that the product serves. We faced many challenges during the process, such as finding sites that would let us “scrape” them, formatting the lists in such a way that we could access only the information we needed. This was a big project, especially for beginners, but we are just glad that we learned a lot.

Share this project:

Updates