FAILED EXPERIMENT
Interactive Board Demo [Jira Software]
I led the design of an interactive Jira board demo on Atlassian.com, animating key actions like creating an issue. This hands-on approach helped users experience Jira’s value directly.
Product
Jira Software Product Tour
What I did
Product Design
Interactive Prototyping
Wireframing
Quantative Analysis
My Role
Design Lead
Time Line
6 Weeks
Impact
Our pre-analysis predicted success criteria as a 5% uplift in signup rate, and we estimated runtime of 7 days to measure that 5%.
After 14 days, we did not see any of our metrics hit significance.
Context
In a previous experiment, we added an interactive component to the Jira Software product tour to demonstrate a key user action - timelines.
First interactive demo - Jira Software demo - timelines
As a result, there was a 10% statistically significant increase in the signup rate for users who engaged with the demo.
Building on this success, we launched a new interactive demo that focused on another essential Jira Software action - creating an issue.
Based on the previous experiment, we hoped to see a 5% lift in the signup rate.
Project Goal
The goal was to increase signups from the Jira Software product tour by introducing an interactive experience of the Board view and issue creation.
By blurring the lines between product and marketing, we aimed to give users a hands-on experience that would bolster their confidence in understanding Jira Software's value, ultimately leading to higher conversion rates.
What we learned
We found that triggering exposure events at page load was ineffective because many users didn’t scroll to see the interactive section
Why It Didn't Work: Low Engagement Due to Hidden Content
Was our target audience too broad, diluting results?
We targeted English-speaking desktop users, and data revealed that 30% of visitors were logged-in users likely returning to Jira Software. Since this experiment focused on driving new business signups, these existing users were not the primary audience.
Misfired exposure events for enrolled users
We automatically initiated an exposure event for users when they joined the experiment at page load.
However, the interactive section was frequently hidden below the fold due to varying browser window sizes. Data showed that only 37% of visitors triggered a scroll event, indicating that many users never saw the treatment.
This diluted our exposure population and reduced the accuracy of our observed metrics.
Process
I reviewed secondary insights from user testing on the first interactive demo (Jira timelines) to identify key design takeaways.
Insights from user testing of demo - Jira timelines
Insight#1: Copy is confusing
Users thought that the tone was too serious and technical.
Insight#4: Overwhelming design
Users thought designs that closely resembled in-product experiences were overwhelming.
Insight#2: Custom data flow
Users want the ability to plug in their data and see how this experience would function within their unique workflow.
Insight#5: User confusion on Jira features
Some users struggled to understand the differences between the issue types in Jira (e.g., story, bug and task).
Insight#3: Unclear what do next
It was not always clear to users what the next course of action should be in the interactive experience.
Crazy - eight
I facilitated a Crazy Eights workshop with the project manager, content designer, and lead engineer to quickly generate a wide range of ideas based on user testing.
This approach encouraged rapid, creative thinking from all team members and helped align cross-functional perspectives for improving the design of the interactive component.
Workshop Summary:
The Crazy Eights workshop generated a variety of actionable design ideas to enhance the interactive component, focusing on improving user guidance and showcasing key Jira features. Key concepts included:
Instructional Overlays: Using modals and tooltips to guide users through key actions.
Personalization: Allowing users to customize and configure their experience.
Instant Feedback: Providing immediate visual responses to user actions.
Interactive Features: Showcasing task creation, issue configuration, and moving tasks on Kanban boards.
Ease of Use: Highlighting shortcuts, sprints, and version history to simplify workflows.
Automation and Integrations: Demonstrating Jira's configurability with simplified automation features and integrations with Slack and GitHub.
Board Customization: Offering style-switching capabilities for boards and differentiating between scrum and kanban.
Competitive analysis
Conducting competitive analysis of platforms like Ramp.com, Teamhood.com, and Doly.ai provided valuable insights into how successful products onboard users through interactive, user-friendly experiences.
These sites utilize clear, step-by-step guidance, personalized onboarding flows, and instant feedback to engage users early. By analyzing these methods, I identified applicable strategies—such as instructional overlays, tooltips, and visual feedback—that could enhance the Jira interactive demo.
Incorporating these techniques, alongside user insights from the first interactive component and ideas from the Crazy Eights workshop, helped me refine the design to make it more intuitive, personalized, and user-centered.
Onboarding screenshots from competitors
Solution
The Jira interactive demo offers users a hands-on experience with important features in a simulated environment. It helps users understand how Jira boards integrate into their workflow and provides a smooth introduction that boosts confidence in using the tool.
Before
After
To make creating issues easier for new Jira users, I designed a demo that simplifies the process and makes it more intuitive. After logging in and selecting a project, users can click "Create" and follow a streamlined form to choose the issue type, add a summary, and critical details. This design reduces friction for beginners while maintaining flexibility for experienced teams.
User goes through interactive demo
Next Project
Optimizing User Flow:
Redesigning singup form to drive conversion