Datasets

Inspiration

Allowing organizations around the world to openly access public datasets and helping them bring value to end customers. Using this solution allows developers and companies to greatly improve the daily lives of the common people.

What it does

Provides an intuitive platform that allows anyone to upload datasets from various sources. These datasets can be downloaded and validated (with a review and rating system) by other users over time.

How we built it

I created a HTTP API using node/fastify for the backend. The platform also utilizes PostgreSQL for data storage, Wasabi S3 for file storage and react/nextjs with typescript for it's frontend.

The frontend interacts with the API using react-query and the backend uses fastify-postgres and aws-sdk to connect to the database and file storage system.

Challenges we ran into

Handling multiple file uploads with one API request was an obstacle that I ran into. It was my first time using multipart/form-data and an S3 storage platform. Enough time helped me overcome these challenges.

Accomplishments that we're proud of

As a Grade 9 student, it was a great experience to participate in my first hackathon and work for over 20 hours in a day to create a useful project.

What we learned

I learned how to use S3 as a storage platform, create and encrypt a login system and how to send files as a binary buffer over a HTTP API.

What's next for Datasets

Improving the overall interface and experience to make it easily accessible and responsive. Creating an open public API that allows developers to access the stored datasets. Also adding additional features like search functionality to make it easier to navigate through the platform.

Built With

• fastify
• nextjs
• node.js
• postgresql
• react