Inspiration
Keeping up with the rapidly changing technology landscape of today is both essential and time-consuming which is something I struggled with. Our program provides an answer by sending out daily emails that outline the most recent innovations in technology in the New York Times. This guarantees that you stay up to date on the latest advancements and saves you a great deal of time.
What it does
Google Sheets web scraping simplifies data collection from websites directly into a spreadsheet (New York Times: Technology). The importXML function, alongside other import functions like importHTML, importFeed, and importData, streamlines this process. Gmail connectivity and Google Apps Script are required in order to automate emails using Google Sheets. Email sends are started by triggers, such modifications or checkbox statuses, which use parameters that can be customized, including recipient, subject, and body. It condenses all of this material into a short summary so you can read it quickly. If the synopsis peaks your interest, you can further investigate the topic. An email is sent out daily when the program scrapes the New York Times; in the technology section, the Google Sheets are updated with new information, and so on.
How I built it
To scrape data, we used Google Sheets' import functions and XPath queries, made manageable with Chrome's copy XPath feature. For email automation, Google Apps Script within Google Sheets' script editor enabled triggers based on spreadsheet changes, seamlessly linking with Gmail's send email function.
Challenges I ran into
It was also difficult to find the time to complete this project because I am in my junior year and have the SAT, ACT WorkKeys, MSTEP, and AP Exams. It was difficult for me to find the time to improve before the deadline because I have AP Exams to study for in addition to other personal projects I'm currently working on with their deadlines too.
Accomplishments that I was proud of
I'm pleased to have created a program that combines technology and everyday productivity in a seamless way. Through summary emails, I can easily stay up to date on technical breakthroughs using this application, saving important time and guaranteeing still be innovating for the future.
What I learned
While Google Sheets online scraping offers an approachable first step into data extraction, it is only useful for more complex jobs. XPath searches might be complex, but Chrome's tools make them easier to understand. Gmail with Google Sheets email automation highlights the value of conditional triggers and integration for effective workflows. It is also important to note that testing is also essential for dependability and not just debugging.
What's next for Insight Informer
My goal is to add an AI component to this application so that, rather than receiving an email summary that keeps you informed but isn't as helpful, you will receive a larger text AI summary that will provide you even more useful information and up-to-date knowledge on the newest technologies.
Built With
- appsscript
- code.gs
- gmail
- googlesheets
- newsletter
Log in or sign up for Devpost to join the conversation.