BudgetBot, an AI-Powered Personal Finance Assistant
Chat GPT 3,5
Amazon Rekognition
iOS speech recognition
BudgetBot is not just a budgeting tool, it's a responsive AI assistant that relieves users from the burden of tracking expenses manually. Whether a user takes a photo of a receipt or verbally inputs expenditures, BudgetBot cleverly organizes the data received into distinctive categories, simplifying personal financial management. It empowers users with insightful, actionable data, reshaping their understanding, and control of personal finances.
Voice Input
Users narrate their expenses to the bot, which utilizes a speech recognition model to log expenses in the database accurately.
Speech Expense Logging
Spending Categorization and Editing
Once BudgetBot gathers expense data, AI categorizes them and allows manual adjustments for enhanced accuracy.
Detailed and Customizable Categorization
Native iOS speech recognition and Amazon Rekognition are used for simplified data input (speech and image recognition).
Upon gathering new expense data, the backend retrieves user information from the database and creates a user-specific prompt requesting ChatGPT to categorize expenses into predefined categories. Response is returned as a JSON structure, allowing structured data to be easily stored in the database, and displayed to the user.
Main Challenges
Interpreting Expense Information from Receipts
Translating receipt photos to text with AWS and dividing this text into essential data points—item names and costs—required meticulous attention for efficient Chat GPT input.
No Hallucinations
Designing Dynamic Prompts
Our focus is on crafting prompts that not only capture the right data within specific timeframes but also facilitate comprehensive budget analysis.
No Hallucinations
To enhance BudgetBot's functionality, we plan to incorporate:
Personalized Insights
Tailored summaries and budget-saving tips.
Enhanced Spending Analytics
More detailed analytics and personalized spending categories.
Widgets
App availability on Apple Watch and iPhone widgets for continuous tracking.
Use Cases
Insurance
Assists agents in capturing and categorizing documents like policies, claim forms, or damage reports.
Banking
Provides enterprises with detailed insights into company spending.
Fitness
Allows users to track and categorize calorie intake by scanning food receipts.