Noted

Inspiration

In an era where multimedia content is vast and attention spans are short, our team wanted to provide a tool that simplifies the process of content digestion. We were inspired by the potential to bridge the gap between extensive video and audio content and the powerful organization capabilities of Notion. Our goal was to create a seamless integration using Gemini to help enhance productivity.

What it does

Our application provides an elegant solution for summarizing audio and video content directly into Notion. Users can authenticate their Notion accounts, select a target database and upload multimedia files. They are then offered a choice of note styles before their files are processed. Our backend leverages the Gemini API to generate summaries, which are then formatted as per the user's preferences and directly inserted into the selected Notion database as a new note. This integration ensures that the summaries are not only useful but are also beautifully formatted and well-organized.

How we built it

We developed a React-based frontend that handles user authentication, database selection, and multimedia uploads. The frontend interacts with our Flask backend, which manages the communication between Google Gemini API for generating summaries and the Notion API for creating notes. We utilized modern cloud infrastructures to handle data processing and storage efficiently, ensuring a smooth user experience from start to finish.

Challenges we ran into

Integrating multiple APIs was a significant challenge, particularly ensuring that data passed seamlessly from the frontend, through our backend, and onto Notion. Handling multimedia files, especially large videos, required careful consideration of upload times and processing speeds. Ensuring user data privacy while authenticating with Notion and Google APIs also posed challenges that needed thorough attention.

Accomplishments that we're proud of

We are proud of creating a fully functional integration that not only works technically but also looks great and is user-friendly. Managing to successfully connect and automate interactions between the React frontend, Flask backend, Google Gemini API, and Notion API, while maintaining a high standard of user data security and privacy is a significant accomplishment for our team.

What we learned

Through this project, we deepened our understanding of API integration and multimedia processing. We also gained valuable insights into user experience design, especially concerning the handling of authentication and interactive elements in web applications. The complexities of data privacy and API security were also key learning points for our team.

What's next for Noted

Looking forward, we aim to expand the capabilities of Noted by supporting additional multimedia formats and integrating more customization options for note styles. We also plan to enhance our AI summarization algorithms to cater to specific user needs such as focus on particular topics or keywords. Additionally, we are considering partnerships with educational institutions and businesses to widen our user base and improve our service based on diverse user feedback.

Built With

Submitted to

Google x MHacks AI Hackathon

Created by

I worked on prompt engineering for Gemini and helped to integrate Gemini into the backend of the web app.

Ranjan Subbaraman
I worked on the front end on the React side of our Web App. Helped make design decisions, plan out the implementation, UI/UX testing.

Saarang Suryavanshi
I worked on the backend. Engineered flask routes that interacted with the frontend, Notion and Gemini. Deployed the backend to AWS EC2 with the help of Nginx and Gunicorn.

Jun Kit
Worked on the front end including routing/navigation, styling, api calls and authentication with supabase

Nor Danish Imran