o to 1 Re-imagine and Rebuild

Timeline

10 Months

My Role

UX/UI Lead, Product Manager

Skills Used

Self-Directed

Frameworks & Procedures

Developing Workflows

Systems Thinking

Stakeholder Interviews

Heuristic Analysis

User Research

User Interviews

User Behavior Analysis

Qualitative Research Repositories

Goal

Re-image our product from a "tries to do a lot and does none of it well" product to one with a focused set of features to help teachers incorporate personalized math learning into traditional math classrooms.

Constraints

  • Aug 1, 2024 launch date - our old platform contract was ending July 31.

  • Limited development resources and new tech stack.

  • Be acceptable to users of the current product for continuing contracts and renewals while shifting from a "lots of features to meet every need but none done that well" to a "focus on our core value and think deeply about the features that support it"

Summary

While we didn't throw out our philosophy (that every student should have personalized math learning experiences), and we still used our institutional understanding of how students learn math skills, we did get rid of all other notions of what our product had been in the past and focused on what it needs to be to solve the problem of helping teachers facilitate personalized learning in classrooms with core curriculum and diverse student populations.

The result is a web application with a streamlined experience for students, and the features for educators focused on our singular goal of incorporating personalized education into the realities of the classroom setting, and organized by task.

18% Increase

Percentage of student licenses sold that were rostered into classes in first 30 days

41% Increase

Percentage of rostered students completeing a diagnostic in first 30 days

Process

Advocacy & Set-up

Our product was hosted on a 3rd party platform that resulted in very slow response time between design and deployment. Our solutions and designs were boxed in by their platform.

We weren't able to build the features users needed, in the way we needed to meet user needs, in a timely way.

I championed the bringing of our product 100% in-house utilizing the React framework and was instrumental in getting this project approved and off the ground.

Our product was hosted on a 3rd party platform that resulted in very slow response time between design and deployment. Our solutions and designs were boxed in by their platform.

We weren't able to build the features users needed, in the way we needed to meet user needs, in a timely way.

I championed the bringing of our product 100% in-house utilizing the React framework and was instrumental in getting this project approved and off the ground.

My Contributions

My Contributions

User Needs

Take-away

Issues with the old product:

  • overly-complex user flows

  • inconsistent information architecture

  • trying to do too many things and none of them were done particularly well

  • student portal needed streamlining to guide students to what they should do next

Take-away

Issues with the old product:

  • overly-complex user flows

  • inconsistent information architecture

  • trying to do too many things and none of them were done particularly well

  • student portal needed streamlining to guide students to what they should do next

Our product is used in the context of a classroom with peers and teacher(s) - that meant it was imperative that we incorporate observations in classrooms before undertaking this rebuild!


We completed classroom observations in 7 schools in 3 states - I participated at 4 of those schools.

Product and Customer Success team members participated in observations of our existing product in classrooms, one-on-one interviews, surveys and focus groups to gather feedback on the needs of users.

Our product is used in the context of a classroom with peers and teacher(s) - that meant it was imperative that we incorporate observations in classrooms before undertaking this rebuild!


We completed classroom observations in 7 schools in 3 states - I participated at 4 of those schools.

Product and Customer Success team members participated in observations of our existing product in classrooms, one-on-one interviews, surveys and focus groups to gather feedback on the needs of users.

My Contributions

Resource

Served as a resource for user research for various org members that would participate - holding workshops for interview and observation techniques.

Consolidating Research

Lead consolidating user research from sources across the org

Dovetail

Implemented Dovetail as a research and insight tool

My Contributions

Resource

Served as a resource for user research for various org members that would participate - holding workshops for interview and observation techniques.

Consolidating Research

Lead consolidating user research from sources across the org

Dovetail

Implemented Dovetail as a research and insight tool

...and Business Outcomes

...and Business Outcomes

Take-away

We measured every potential feature for the new product against this product strategy - will it help teachers plan individualized instruction within a classroom setting and a unit planning framework?

If not, it didn't make it into the new product.

Take-away

We measured every potential feature for the new product against this product strategy - will it help teachers plan individualized instruction within a classroom setting and a unit planning framework?

If not, it didn't make it into the new product.

We know we can't compete with the big guys in the field - we needed to identify our value-add to the classrooms that leveraged our institutional knowledge and "special sauce", so that we could move the needle on business outcomes.

The product leadership team found that the sweet spot was helping teachers plan instructional units for their core curriculum with:

  • a diverse population of students

  • leveraging our knowledge of the student's individual progress

  • leveraging our understanding of skill progressions that are likely to help a student succeed on the unit's target skills

We know we can't compete with the big guys in the field - we needed to identify our value-add to the classrooms that leveraged our institutional knowledge and "special sauce", so that we could move the needle on business outcomes.

The product leadership team found that the sweet spot was helping teachers plan instructional units for their core curriculum with:

  • a diverse population of students

  • leveraging our knowledge of the student's individual progress

  • leveraging our understanding of skill progressions that are likely to help a student succeed on the unit's target skills

Business Outcome Informed Design Decisions

Take-away

There was no way for a student to use the algorithm-determined most-ready skills WITHIN a subset of the long-term goal skills (the topic they were working on in class).

Take-away

There was no way for a student to use the algorithm-determined most-ready skills WITHIN a subset of the long-term goal skills (the topic they were working on in class).

Problem

We didn't have time and resources to build both:

  • unit planner - we'd prioritized based on evaluating user needs and business outcomes

  • an assignments feature - existed in our old platform and we heard from Customer Success, Marketing and teachers was a frequently used feature

I dug further down into the core needs of users that led them to assign skills to students…

Problem

We didn't have time and resources to build both:

  • unit planner - we'd prioritized based on evaluating user needs and business outcomes

  • an assignments feature - existed in our old platform and we heard from Customer Success, Marketing and teachers was a frequently used feature

I dug further down into the core needs of users that led them to assign skills to students…

Why did teachers want the assignment feature?

What purpose was it serving for them?

Could we meet that need in a different way that more closely aligned with our business outcomes?

Why did teachers want the assignment feature?

What purpose was it serving for them?

Could we meet that need in a different way that more closely aligned with our business outcomes?

Impact

Allowing students to see suggested skills within a single instructional unit met the core user need and the business needs…and it did it with automating a process the teachers used to have to do manually!

Impact

Allowing students to see suggested skills within a single instructional unit met the core user need and the business needs…and it did it with automating a process the teachers used to have to do manually!

Solution

We decided to implement a way for students to browse skills by "unit".

This allowed us to continue suggesting the top three skills a student was ready for (based on the algorithm), but now within the context of the shorter-term goal the teacher was focusing on.

Solution

We decided to implement a way for students to browse skills by "unit".

This allowed us to continue suggesting the top three skills a student was ready for (based on the algorithm), but now within the context of the shorter-term goal the teacher was focusing on.

Data Informed Design Decisions

Impact

UI was tested before releasing to end users, allowing iterations to be made and the released product to be a better version than if I hadn't implemented usability testing prior to release.

Impact

UI was tested before releasing to end users, allowing iterations to be made and the released product to be a better version than if I hadn't implemented usability testing prior to release.

I implemented usability testing for the first time at the organization and completed 25+ usability tests at various stages as well as beta testing prior to launch.

Early versions of reports filters lumped all settings and filters together, leaving users confused about which fields were required before any data was displayed versus what would refine the displayed data.

Iterations included separating out settings from filters and clearly indicating which were required fields.

I implemented usability testing for the first time at the organization and completed 25+ usability tests at various stages as well as beta testing prior to launch.

Early versions of reports filters lumped all settings and filters together, leaving users confused about which fields were required before any data was displayed versus what would refine the displayed data.

Iterations included separating out settings from filters and clearly indicating which were required fields.

Accessibility & Responsiveness

With our previous product on a third-party platform, we had little control over accessibility measures. It was important that the new product be built with universal design principles and responsiveness.

With our previous product on a third-party platform, we had little control over accessibility measures. It was important that the new product be built with universal design principles and responsiveness.

Reflections

Keep editing and refining the roadmap with a focus on the product strategy

Keep editing and refining the roadmap with a focus on the product strategy

Choosing to stick to a launch deadline and continually edit the product roadmap as we saw things took longer, or weren't going to work together as expected, was definitely the right move.

We launched a product with minimal bugs that meet the value proposition and we're taking a thoughtful approach to mapping the opportunity space to determine what to layer on next.

Choosing to stick to a launch deadline and continually edit the product roadmap as we saw things took longer, or weren't going to work together as expected, was definitely the right move.

We launched a product with minimal bugs that meet the value proposition and we're taking a thoughtful approach to mapping the opportunity space to determine what to layer on next.

When you solve one core need, there may be others that are the same at the surface level but need a different solution

When you solve one core need, there may be others that are the same at the surface level but need a different solution

It was the right move to focus on the product strategy of supporting teachers as they planning personalized learning within the context of instructional units in a diverse classroom.

And the combination of unit selector and suggested skills did meet ONE core need that was under the request for the ability to assign skills.

But we've uncovered other core needs in our feedback post launch beneath the "I want to assign skills to students" requests, such as:

  • Some teachers doesn't trust the suggestions - they seem to advanced for the student

  • Some teachers want to use our product to auto-suggest and ALSO as daily exit slips for students, which would require assigning a specific skill for that date

The first core need wouldn't be well-served by an assignment feature, but instead suggests we need to take a look at the suggestion algorithm.

The second core need is narrow and specific and now we can design a targeted assignment feature to meet that need!

It was the right move to focus on the product strategy of supporting teachers as they planning personalized learning within the context of instructional units in a diverse classroom.

And the combination of unit selector and suggested skills did meet ONE core need that was under the request for the ability to assign skills.

But we've uncovered other core needs in our feedback post launch beneath the "I want to assign skills to students" requests, such as:

  • Some teachers doesn't trust the suggestions - they seem to advanced for the student

  • Some teachers want to use our product to auto-suggest and ALSO as daily exit slips for students, which would require assigning a specific skill for that date

The first core need wouldn't be well-served by an assignment feature, but instead suggests we need to take a look at the suggestion algorithm.

The second core need is narrow and specific and now we can design a targeted assignment feature to meet that need!