UX Strategy
As part of the UX Strategy...
User Usage Tracking
Contents
-
-
Frequency
-
Specific metrics
-
Variables
-
-
Data Structure
-
Usage Tracking Data Structure
-
Usage Tracking Summarised Metrics Table structure
-
Modifications to the Users table
-
-
Calculation Methodology
-
Architecture
-
Structure Diagram of WebJob and Main Code
-
-
Times and Dates in Calculations
-
User Types
-
-
Display of the Metrics
User Story - Improved usage monitoring leading to user led prioritisation
Acceptance Criteria
Confirmed metrics to monitor:
General Note: 2 levels of reporting needed:
Level 1: Application, accounting for all projects inside MIDP online.
Level 2: Project level (one project).
General Note: Refer to attached PDF
General Note: Exclude all global admins from the count and DPM team members to not influence counts.
General Note: Key actions "activation milestones" include: Setting up the sync to CDE, Project Config, Delivery Planner, Sync to CDE, Assign Milestone, Create Deliverable, Add user to user group.
1) Product Adoption Rate at the frequency of: Daily, Weekly, Monthly, quarterly and Yearly for all pages in the product.:
Definition- New Active Users: The number of people who completed one or more of key actions in the stated time period.
Definition- New Users: The number if people who obtained a user account in MIDP in a given period stated previously.
Definition- Total Users: All users who have a user profile in MIDP (active and inactive users)
Definition- Daily Active Users (DAU)-The number of people who performed 1 or more key actions in a day.
Definition- Monthly Active Users (MAU) - The number of people who performed 1 or more key actions in a week.
Formula: (New Users Divided by Total Users) x 100
Note: Exclude all global admins from the count and DPM team members to not influence counts.
NFRs:
Build new loggers to allow for the above.
Build web job to pre-calculate the appropriate metrics
Appropriate data structures to store both logger raw entries and surmised metric values
Build PowerBi Dashboard to report on the above to account for: page hit and page updating
Update Wiki accordingly.
2) User Activation Rate (Not for new users to the whole product) that interact with "Activation Milestones" at the frequency of: Daily, Weekly, Monthly, quarterly and Yearly for all pages in the product.
Formula: (Number of users who reached one or more of the listed activation milestones divided by number of users who signed up) x 100
3) Metrics for Product Stickiness Rate: at the frequency of: Daily, Monthly, quarterly and Yearly for all pages in the product.
DAU = Number of unique users + number of unique returning users (In both cases performing more than one key action per day)
MAU = Number of unique users in a month + number of unique returning users (In both cases performing more than one key action per month)
Product Stickiness Formula: (DAU divided by MAU) X 100
4) Metrics for Active User Growth at the frequency of: Weekly, Monthly, quarterly and Yearly for all pages in the product.
Calculates growth rate in weekly active users (WAU).
Formula: ((Current WAU - Previous period WAU) divided by Previous period WAU) x 100
6) Product Usage Frequency at the frequency of: Daily, Weekly, Monthly, quarterly and Yearly for all pages in the product.
Number of user sessions with a performed key action(s) within a specific time period
Introduction
To properly track both user usage of features and also tracking user usages of the whole site we need a tracking system that is robust and does some of the calculation work up front and stores it in the Database to ensure it's easy for a range of sources to consume. To that end the intent is to make a system that tracks both page hits with a unique identifier and also specific 'Activation Milestones'.
An 'Activation Milestone' is a key event that is completed within the application that marks a user doing a specific action. These can be seen in the PDF.
Metrics
The following section explains the metrics we are collecting, the frequency and whether they are for the whole application or specifically for a project.
Key Activation Milestones
The key activation milestones for MIDP Online are:
-
Setting up a connection to a CDE
-
Setting up rules of credit (Advanced Analytics)
-
Delivery Planner - i.e. accessing the page
-
Sync a CDE - i.e. import, export, sync or configuring a CDE schedule
-
Assign a Milestone
-
Create a Deliverable
-
Add a user to a group in the project
-
Importing a schedule
Frequency
The frequency of measurements will depend on the specific metric but the periods we will be using with example date times (all times are in UTC) are:
What Our Clients Say
Name, Title
"I'm a testimonial. Click to edit me and add text that says something nice about you and your services. Let your customers review you and tell their friends how great you are."