We developed PlantSnapper, a mobile application designed to empower outdoor enthusiasts, gardeners, and foragers with real-time plant identification, plant analysis, and safety tools. Utilizing augmented reality and voice-based features, PlantSnapper allows hands-free identification of plants, fungi, and flowers empowering users to explore nature without disrupting their outdoor experience.
This project is backed by user-centered research, combining secondary user research and user testing. From studying hikers, foragers, gardeners, and casual nature explorers, we identified common challenges that shaped our personas and guided every design decision.
Video with no sound demonstrates a mobile walkthrough of Plantsnapper's live-identify plant feature, showing how a user scans a plant and receives real-time identification.
From our initial research, we created four detailed user personas to visualize our findings and guide the design process, ensuring our decisions aligned with users’ real-world needs and challenges.
32
Shares photos from nature walks on social platforms and prefers quick, simple descriptions.
58
Wants simple, user-friendly tools to identify plants, learn sustainable plant foraging, and share her knowledge with family and friends.
27
Enjoys outdoor activities like hiking, camping, and mountain biking, and needs basic plant identification to enhance hikes.
40
Interested in gardening, sustainability, and native plants, and needs info on plants suitable for his garden.
We proposed a feature-rich app focused on real-time plant exploration, learning, and sharing. The main features proposed included:
Instantly identify plants using the camera
Option to identify plants using live view or from photo album photos
Warnings for toxic/invasive species and ethical foraging tips
Save and organize plant discoveries for future use. Connect with friends to share and explore finds together
Detailed info on species, edibility, toxicity, and ecological roles
I translated these ideas into wireframes and mockups to explore layout, navigation, and user flow.
I conducted a three-part usability study, beginning with open exploration to observe users’ natural behavior, followed by task completion to uncover specific pain points, and concluding with a short interview to gather feedback and highlight usability issues.
"Identify a plant from the photo album and save it to your personal journal"
This table lists usability issues found during user testing, grouped by common categories. This table helps identify recurring design issues to help prioritize fixes.
| Category | Issue |
|---|---|
| Navigation and Usability | Users were unsure how to use the voice-trigger features |
| Users got lost in plant identification pages | |
| Users struggled to return to key pages | |
| Photo and Journal Functionality | Images taken with the live-capture couldn’t be retrieved |
| Journal customization was limited | |
| Button and Icon Improvements | Mic on the home screen felt unintuitive |
| Buttons lacked affordances | |
| Overall Experience | Limited interactivity in the explore feed section |
| Side-scrolling wasn’t fully voice-accessible |
The category-issue table captures some of the recurring issues that was observed during a monitored user testing, especially around their ability to navigate the app. Noticing where users hesitated or paused provided a fresh perspective to understand design flaws and the importance of designing for real user behavior to support first-time users.
Despite the app's hands-free focus, users struggled to know when, how, or why to use its voice-based features and often got lost during key tasks like plant identification and photo capture. The user feedback helped us identify a crucial design challenge, asking how can we give better guidance to lead users toward a smoother, voice-driven experience?
One solution to this design challenge is to improve UI prompts with clear, contextual suggestions like “would you like to identify this plant?”, along with feedback loops that guide users when no input is detected to help build confidence and clarify next steps. This approach reduces user confusion and encourages more consistent use of PlantSnapper's voice features. As a result, users feel supported throughout the process, leading to higher task completion rates.
Developing PlantSnapper taught me the importance of balancing innovative features that may be new to users with clear, intuitive guidance. User testing showed that voice-based features remove familiar affordances like buttons and caused confusion. To address this, it was essential to introduce alternatives such as contextual text prompts and feedback loops to guide users effectively. My understanding of successful design has grown as a result of this experience, which goes beyond what a product can accomplish and shows me the value of prioritizing users’ perspectives and iterating based on real feedback.