-
Notifications
You must be signed in to change notification settings - Fork 9
docs: in-context analytics #326
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
3 commits
Select commit
Hold shift + click to select a range
File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,64 @@ | ||
| In-Context Dashboards | ||
| ##################### | ||
|
|
||
| In-Context Dashboards are available starting in the Teak Open edX release. They are shown in the Analytics sidebar in Studio and present metrics relevant to the content being viewed. The following dashboards are included with Aspects. | ||
|
|
||
| .. image:: /_static/in_context_sidebar.png | ||
|
|
||
| Course Dashboard | ||
| **************** | ||
|
|
||
| This board contains 3 charts presenting course-level metrics, and is displayed when viewing in-context analytics for the course outline. | ||
|
|
||
| .. image:: /_static/in_context_course.png | ||
|
|
||
| Subsection Engagement: | ||
| ====================== | ||
| The first chart shows the number of learners who attempted at least one problem in each graded subsection throughout the course and the average subsection score for those learners. | ||
|
|
||
| Problem Engagement: | ||
| =================== | ||
| The second chart shows the number of learners who attempted each problem in the course and the percentage of learners who got each problem correct on their first attempt at the problem. A high percentage correct on the first attempt indicates that learners are finding the problem manageable (even easy if the percentage is very high), while a low percentage correct on the first attempt indicates that the problem may be very difficult or potentially unclear to learners. | ||
|
|
||
| Video Engagement: | ||
| ================= | ||
| The third chart shows the number of unique and repeat views for each video in the course. | ||
|
|
||
| Graded Subsection Performance | ||
| ***************************** | ||
|
|
||
| This board contains 2 charts presenting subsection-level metrics, and is displayed when viewing in-context analytics for a graded subsection from the course outline. | ||
|
|
||
| .. image:: /_static/in_context_graded_subsection.png | ||
|
|
||
| Graded Subsection Performance: | ||
| ============================== | ||
| The first chart shows the number of respondents in each score range for the graded subsection as well as the average subsection score for all learners who attempted at least one problem in the subsection. | ||
|
|
||
| Final Response Results: | ||
| ======================= | ||
| The second chart shows the total number of correct and incorrect responses for each problem in the subsection. | ||
|
|
||
| Problem | ||
| ******* | ||
|
|
||
| This board contains 2 tables presenting problem-level metrics, and is displayed when viewing in-context analytics for a problem block from the course outline or from a unit page. | ||
|
|
||
| .. image:: /_static/in_context_problem.png | ||
|
|
||
| Problem Results Table: | ||
| ====================== | ||
|
|
||
| The first table shows the percentage of correct attempts and of correct first attempts. | ||
|
|
||
| Initial Responses: | ||
| ================== | ||
|
|
||
| The second table shows a breakdown of how learners responded to the problem on their first attempt. The idea is to give course delivery teams a peak into learners’ thought process when they approach the problem for the first time. | ||
|
|
||
| Video | ||
| ***** | ||
|
|
||
| The Unique vs. Repeat Views chart shows the number of unique and repeat views for a single video in the course across the duration of the video. Timestamp ranges with a large number of repeat views should be reviewed as this might be an indicator that this particular section of video is unclear to learners. | ||
|
|
||
| .. image:: /_static/in_context_video.png |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -9,3 +9,4 @@ Reference Material | |
| learner_groups_dashboard | ||
| operator_reports | ||
| course_comparison_dashboard | ||
| in_context_dashboards | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@ArturGaspar did we miss adding
ASPECTS_ENABLE_STUDIO_IN_CONTEXT_METRICS?There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
on side note have a look at this thread, we should also update
Installationinstruction adding which images to rebuild and same should be mentioned inHow to upgradesection. cc: @bmtcril