Mission Context
Severity ratings reflect the supplied evidence, user goal, optional-profile scope, and any stated evidence limits. Support flows and activities should never outrank the checklist scorecard.
The biggest visible usability risk is important information may appear too late. It affects Aesthetic and Minimalist Design and should be fixed before broader polish.
Fix severity 3-4 checklist items first, then rerun the same source state for comparison.
Accessibility Readiness Signal: WCAG AAA-level criteria are implicated by Error Prevention needs targeted review; this remains evidence-limited until manual accessibility testing.
Cultural Context Signal: CJK Layout And Typography Requirements flags Consistency and trust cues need review as needing evidence-bound local or community-context validation.
Before using this interface, address Aesthetic and Minimalist Design first: Move the task-critical information above the fold and defer supporting details until after the first decision.
Important information may appear too late
Oppia logo, brand colors, and mission statement present throughout.
Heuristic Scorecard - AI Audit, 14 Heuristics
Findings - Prioritized Fix Order
Important information may appear too late
Page clutter competing with primary actions
Primary action hierarchy is not clear
Primary action hierarchy is not clear
Visual hierarchy is not supporting the task
Visual hierarchy is not supporting the task
Visual hierarchy is not supporting the task
Visual hierarchy is not supporting the task
Consistency and trust cues need review
Consistency and trust cues need review
Owner-Role Triage Matrix
| Owner | Linked finding | Next action | Impact | Effort | Confidence | Supporting roles |
|---|---|---|---|---|---|---|
| Designer | h08 / h08_d_13 | Move the task-critical information above the fold and defer supporting details until after the first decision. | high | Low | high | |
| Designer | h08 / h08_d_03 | Audit the screen for competing visual elements and remove or demote anything that does not support the user's next action. | high | Low | medium | |
| Designer | h08 / h08_d_01 | Make the primary action the clearest visual starting point and reduce secondary actions around it. | high | Low | medium | |
| Designer | h08 / h08_d_02 | Make the primary action the clearest visual starting point and reduce secondary actions around it. | high | Low | medium | |
| Designer | h08 / h08_d_04 | Rework the visual hierarchy so the page guides users from the main purpose to the next action without extra scanning. | high | Low | medium | |
| Designer | h08 / h08_d_06 | Rework the visual hierarchy so the page guides users from the main purpose to the next action without extra scanning. | high | Low | medium | |
| Designer | h08 / h08_d_07 | Rework the visual hierarchy so the page guides users from the main purpose to the next action without extra scanning. | high | Low | medium | |
| Designer | h08 / h08_d_14 | Rework the visual hierarchy so the page guides users from the main purpose to the next action without extra scanning. | high | Low | high | |
| Product | h04 / h04_d_04 | Audit repeated navigation, labels, components, and trust cues, then align any pattern that changes meaning across screens. | high | Low | medium | |
| Product | h04 / h04_d_05 | Audit repeated navigation, labels, components, and trust cues, then align any pattern that changes meaning across screens. | high | Low | medium |
What Is Working Well
No heuristic scored at A- or above in this payload. Use this section after fixes to preserve strengths.
Evidence Limits
- source: source preparation status was partial (ratings may be incomplete or unavailable)
- host_supplied-1 missing across 102 checklist ratings; rating remains usable but traceability is reduced.
Show detailed evidence-limit notes (103 source notes)
- source: source preparation status was partial (ratings may be incomplete or unavailable)
- host_supplied-1: 102 checklist ratings cite this missing evidence ref. Affected items: h01_d_01, h01_d_02, h01_d_03, h01_d_04, h01_d_05, h01_d_06, h01_d_07, h01_d_08, h01_d_09, h02_d_01, h02_d_02, h02_d_03; plus 90 more.
WCAG-Informed Accessibility Readiness
Support-only advisory. This section does not change H01-H14 scores, 0-4 checklist ratings, report readiness, or finding order.
WCAG Level Signal: AAA
Top signal: Accessibility Readiness Signal: WCAG AAA-level criteria are implicated by Error Prevention needs targeted review; this remains evidence-limited until manual accessibility testing.
Caveat: Evidence-limited accessibility support guidance only; not WCAG, ADA, legal, procurement, or conformance certification.
| Lens / cue | Applies to | Evidence | Why it matters | Caveat |
|---|---|---|---|---|
| Accessible Authentication | h05/h05_d_02 | host_supplied-1 | The finding connects to WCAG accessible-authentication guidance: sign-in should not rely on avoidable memory or cognitive tests without alternatives. | UXHC can flag authentication burden, but WCAG evaluation needs the actual auth flow and security constraints; this is not WCAG conformance certification. |
| Contrast And Visual Presentation | h04/h04_d_17 | host_supplied-1 | The finding connects to WCAG contrast and visual-presentation guidance: important information or controls may not be perceivable enough. | UXHC can flag visible contrast risk, but measured contrast ratios and state-by-state review are needed before conformance claims. |
| Contrast And Visual Presentation | h04/h04_d_19 | host_supplied-1 | The finding connects to WCAG contrast and visual-presentation guidance: important information or controls may not be perceivable enough. | UXHC can flag visible contrast risk, but measured contrast ratios and state-by-state review are needed before conformance claims. |
| Focus Order, Visibility, And Obscured Focus | h04/h04_d_08 | host_supplied-1 | The finding connects to WCAG focus guidance: keyboard users need a visible, logical focus path that is not hidden by the interface. | UXHC can flag likely focus risk, but keyboard traversal and viewport-state testing are needed before WCAG conformance claims. |
| Labels, Instructions, And Input Purpose | h02/h02_d_01 | host_supplied-1 | The finding connects to WCAG labels-and-instructions guidance: users need visible and programmatic cues for what controls mean. | UXHC can flag labeling risk, but programmatic label associations and accessible-name checks require technical review; this is not WCAG conformance certification. |
| Modals, Popovers, Tooltips, And Focus Management | h04/h04_d_10 | host_supplied-1 | The finding connects to accessible overlay guidance: modals and popovers must preserve focus, escape, labels, and context. | UXHC can flag overlay access risk, but keyboard and screen-reader testing are required before WCAG conformance claims. |
Cultural Context Integrity Advisory
Support-only advisory. This section does not change H01-H14 scores, 0-4 checklist ratings, report readiness, or finding order.
Context Integrity Index: 0 - Insufficient Context Safety
Top signal: Cultural Context Signal: CJK Layout And Typography Requirements flags Consistency and trust cues need review as needing evidence-bound local or community-context validation.
Caveat: Evidence-limited support guidance only; not a cultural certification, moral judgment, universal cultural claim, or substitute for affected-community review.
| Lens / cue | Applies to | Evidence | Why it matters | Caveat |
|---|---|---|---|---|
| CJK Layout And Typography Requirements | h04/h04_d_04 | host_supplied-1 | The finding may need CJK layout review because typography, line breaking, punctuation, or annotations could change the user's reading path. | CJK layout quality varies by language context and requires target-language content and rendered typography evidence, not translated strings alone. |
| CJK Layout And Typography Requirements | h04/h04_d_18 | host_supplied-1 | The finding may need CJK layout review because typography, line breaking, punctuation, or annotations could change the user's reading path. | CJK layout quality varies by language context and requires target-language content and rendered typography evidence, not translated strings alone. |
| CJK Layout And Typography Requirements | h04/h04_d_19 | host_supplied-1 | The finding may need CJK layout review because typography, line breaking, punctuation, or annotations could change the user's reading path. | CJK layout quality varies by language context and requires target-language content and rendered typography evidence, not translated strings alone. |
| Indigenous-Language Orthography And Voice Support | h02/h02_d_02 | host_supplied-1 | The finding may need target-language validation because spelling, diacritics, pronunciation, or assistive-technology output can affect comprehension and dignity. | Language support should be validated with speakers and local language authorities; UXHC can only flag visible or stated risks. |
| Literacy, Orality, And Multimodal Access | h05/h05_d_02 | host_supplied-1 | The finding may need multimodal support because dense text or text-only instruction can exclude users whose access path is oral, visual, assisted, or low-literacy. | Literacy and modality needs vary widely; the lens should preserve agency rather than simplify or infantilize users. |
| Local Contexts And Traditional Knowledge Labels | h04/h04_d_13 | host_supplied-1 | The finding may need stronger cultural provenance or permission cues at the point where users view, reuse, or export content. | Labels depend on community-defined protocols; absence of a label in the evidence is not proof that no protocol applies. |
Recommended Next Validation Steps
Supporting UX Laws And Principles
Support-only explanation. These lenses do not create findings, change 0-4 checklist ratings, or certify compliance.
| Lens | Source family | Applies to | Why it matters | Caveat / evidence needed |
|---|---|---|---|---|
| Shneiderman's Eight Golden Rules | UX/UI Support Lens | h04/h04_d_04, h04/h04_d_05, h04/h04_d_13 | The finding is also consistent with Shneiderman-style interface review principles. Applicability: Use only when it helps explain an evidence-backed UXHC finding or bounded host observation. | The rules are broad and require domain-specific interpretation. Evidence needed: Visible interface evidence, source context, or a stated evidence limit must remain the basis for the finding. |
| ISO 9241-11 Usability In Context | ISO UX/UI/HCI Support | h07/h07_d_02, h07/h07_d_03, h07/h07_d_06 | This finding connects to ISO 9241-11 style usability-in-context framing: usable for whom, for what task, and in what context. Applicability: Use when the finding benefits from ISO-informed framing around context of use, interaction quality, evidence traceability, process quality, or operational risk. | ISO-informed support reference only; not formal ISO standards compliance, conformance, certification, procurement proof, or legal assurance. Evidence needed: Requires project, process, technical, or audit evidence before standards-strength claims. |
| Visual Hierarchy | UX/UI Support Lens | h08/h08_d_13, h08/h08_d_01, h08/h08_d_02 | The finding is supported by visual hierarchy: the screen does not make the most important next action visually primary. Applicability: Use only when it helps explain an evidence-backed UXHC finding or bounded host observation. | Hierarchy needs to match the user's current task, not only stakeholder importance. Evidence needed: Visible interface evidence, source context, or a stated evidence limit must remain the basis for the finding. |
| Peak-End Rule | UX/UI Support Lens | h09/h09_d_01, h03/h03_d_01, h03/h03_d_03 | The finding is supported by peak-end risk: this moment may heavily shape how users remember the experience. Applicability: Use only when it helps explain an evidence-backed UXHC finding or bounded host observation. | Memory effects need real user evidence to confirm; use this as a risk lens. Evidence needed: Visible interface evidence, source context, or a stated evidence limit must remain the basis for the finding. |
| CJK Layout And Typography Requirements | Cultural Context Support | h04/h04_d_04, h04/h04_d_18, h04/h04_d_19 | The finding may need CJK layout review because typography, line breaking, punctuation, or annotations could change the user's reading path. Applicability: Use only when interface evidence raises a culturally situated, language, access-context, authority, data-governance, or community-validation issue. | CJK layout quality varies by language context and requires target-language content and rendered typography evidence, not translated strings alone. Evidence needed: Requires local context, affected-community review, language/script evidence, or a clear evidence limit before stronger claims. |
| CX Status Transparency | CX Service-Journey Support | h01/h01_d_03, h07/h07_d_04, h07/h07_d_09 | This finding can reference status transparency: long-running customer work needs a visible current state, next step, owner, and update expectation. Applicability: Use when the evidence concerns journey continuity, promise delivery, effort, recovery, complaint handling, handoff, or customer relationship clarity. | CX support guidance only; no ROI, NPS, retention, loyalty, satisfaction, revenue, churn, or real-customer outcome claim unless supplied evidence supports it. Evidence needed: Requires customer, journey, service, operational, or analytics evidence before any real-world outcome claim. |
Support-only context; not a separate score, proof of user behavior, compliance claim, or replacement for the H01-H14 checklist.
Do not use this as a replacement rubric; map it back to the active UXHC checklist item.
ISO-informed support reference only; not formal ISO standards compliance, conformance, certification, procurement proof, or legal assurance.
Do not present this lens as an ISO audit result, standards-conformance evidence, certification evidence, procurement proof, or legal assurance.
Do not make every business priority visually dominant; hierarchy requires tradeoffs.
Prioritized Fix Roadmap
| When | Recommended action |
|---|---|
| Sprint 1 | Move the task-critical information above the fold and defer supporting details until after the first decision. |
| Sprint 1 | Audit the screen for competing visual elements and remove or demote anything that does not support the user's next action. |
| Sprint 1 | Make the primary action the clearest visual starting point and reduce secondary actions around it. |
| Sprint 1 | Make the primary action the clearest visual starting point and reduce secondary actions around it. |
| Sprint 1 | Rework the visual hierarchy so the page guides users from the main purpose to the next action without extra scanning. |
| Sprint 1 | Rework the visual hierarchy so the page guides users from the main purpose to the next action without extra scanning. |
| Sprint 1 | Rework the visual hierarchy so the page guides users from the main purpose to the next action without extra scanning. |
| Sprint 1 | Rework the visual hierarchy so the page guides users from the main purpose to the next action without extra scanning. |
| Sprint 1 | Audit repeated navigation, labels, components, and trust cues, then align any pattern that changes meaning across screens. |
| Sprint 1 | Audit repeated navigation, labels, components, and trust cues, then align any pattern that changes meaning across screens. |
| Sprint 1 | Audit repeated navigation, labels, components, and trust cues, then align any pattern that changes meaning across screens. |
| Sprint 1 | Audit repeated navigation, labels, components, and trust cues, then align any pattern that changes meaning across screens. |
High-Impact / Low-Effort Micro-Solutions
| Role | Micro-solution | Linked finding | Why high impact | Estimated effort |
|---|---|---|---|---|
| Designer | Move the task-critical information above the fold and defer supporting details until after the first decision. | h08 / h08_d_13 | This checklist item indicates measurable heuristic friction for the evaluated surface. | Low |
| Designer | Audit the screen for competing visual elements and remove or demote anything that does not support the user's next action. | h08 / h08_d_03 | This checklist item indicates measurable heuristic friction for the evaluated surface. | Low |
| Designer | Make the primary action the clearest visual starting point and reduce secondary actions around it. | h08 / h08_d_01 | This checklist item indicates measurable heuristic friction for the evaluated surface. | Low |
| Designer | Make the primary action the clearest visual starting point and reduce secondary actions around it. | h08 / h08_d_02 | This checklist item indicates measurable heuristic friction for the evaluated surface. | Low |
| Designer | Rework the visual hierarchy so the page guides users from the main purpose to the next action without extra scanning. | h08 / h08_d_04 | This checklist item indicates measurable heuristic friction for the evaluated surface. | Low |
| Designer | Rework the visual hierarchy so the page guides users from the main purpose to the next action without extra scanning. | h08 / h08_d_06 | This checklist item indicates measurable heuristic friction for the evaluated surface. | Low |
Audit Scope and Omitted Profiles
Active scope: Active scope: H1-H14, 102/102 scored
Status: all_optionals_active
Optional profile mode: scoped
Scored optional profiles: accessibility (h11), inclusion (h12), journey (h13), ux_writing (h14)
Omitted optional profiles:
None
For a full advanced audit, rerun with optional_profile_mode='all_optionals' or profiles=['accessibility','inclusion','journey','ux_writing'].
Complete Checklist Scores
All checklist rows are shown. Use the Score and Status columns to scan Passed, Issue, and Major rows without JavaScript filters.
Visibility of System Status (h01) - 9 checklist items
| Item | Checklist text | Score | Status | Confidence | Severity basis | Evidence | Rationale |
|---|---|---|---|---|---|---|---|
| h01_d_01 | Every interface begins with a title/header that describes page contents | 1.0 | Issue | high | host_supplied-1 | Homepage shows 'Loading | Oppia' title on SPA load — confirm load artifact present. Title eventually resolves. | |
| h01_d_02 | Headings and subheadings are short, straightforward and descriptive | 1.0 | Issue | high | host_supplied-1 | Dashboard main content shows 'Loading...' for 5+ seconds with blank skeleton — no content shimmer or spinner. | |
| h01_d_03 | Value proposition is clearly stated on the home page (tagline or welcome blurb) | 2.0 | Issue | high | host_supplied-1 | Once loaded, active tab is visually indicated; breadcrumb shows location. But login success is implicit — no confirmation. | |
| h01_d_04 | The items on the home page are clearly focused on primary actions | 2.0 | Issue | high | host_supplied-1 | Login success is implicit (redirect to dashboard); no explicit 'You are now logged in' toast or confirmation message. | |
| h01_d_05 | Each page is clearly branded so that the user knows they are on the same site | 1.0 | Issue | high | host_supplied-1 | Two uncaught JS console errors on dashboard after login — silent failures that may affect functionality. | |
| h01_d_06 | Navigation makes it clear which page I am on | 2.0 | Issue | medium | host_supplied-1 | OAuth error states handled by Google (external); Oppia-level OAuth failure states not observed or tested. | |
| h01_d_07 | Link names match the title of destination pages, so users will know when they have reached the intended page | 2.0 | Issue | medium | host_supplied-1 | No forms on sign-up screen — Google handles auth. Dashboard nav links match destinations. | |
| h01_d_08 | Standard elements (page titles, site navigation, page navigation, privacy policy, etc.) are easy to locate | 2.0 | Issue | high | host_supplied-1 | Navigation reflects URL change; title eventually resolves from 'Loading | Oppia'. | |
| h01_d_09 | Logo is in a consistent location, and clicking the logo returns the user back to the home page | 1.0 | Issue | high | host_supplied-1 | No real-time status indicators; SPA title bug and silent JS errors reduce system transparency. |
Match Between System and the Real World (h02) - 3 checklist items
| Item | Checklist text | Score | Status | Confidence | Severity basis | Evidence | Rationale |
|---|---|---|---|---|---|---|---|
| h02_d_01 | Navigation tabs are located at the top of the page, and look like clickable versions of real-world tabs | 3.0 | Major | high | host_supplied-1 | Language is plain and appropriate — 'Goals', 'Progress', 'Continue' map to learner mental models. | |
| h02_d_02 | Items that are not clickable do not have characteristics that suggest that they are clickable | 3.0 | Major | high | host_supplied-1 | Dashboard structure (Home > Goals > Progress) maps well to academic learning concepts. | |
| h02_d_03 | Items that are clickable look like they are clickable | 2.0 | Issue | high | host_supplied-1 | OAuth redirect breaks Oppia context — user transported to Google's auth page unexpectedly. |
User Control and Freedom (h03) - 5 checklist items
| Item | Checklist text | Score | Status | Confidence | Severity basis | Evidence | Rationale |
|---|---|---|---|---|---|---|---|
| h03_d_01 | There is a search box | 2.0 | Issue | medium | host_supplied-1 | Browser back works but OAuth flow effectively disables it during redirect chain. | |
| h03_d_02 | There are clearly marked exits on every page allowing the user to bail out of the current task without having to depend on the browser Back button | 1.0 | Issue | high | host_supplied-1 | No explicit Sign Up CTA — new users must discover that 'Sign In' also handles account creation. | |
| h03_d_03 | The site does not disable the browser Back button and the Back button appears on the browser toolbar on every page | 2.0 | Issue | medium | host_supplied-1 | Browser back available; cookie consent OK button dismisses overlay. OAuth redirect chain limits back. | |
| h03_d_04 | Clicking the back button always takes the user back to the page they came from | 2.0 | Issue | high | host_supplied-1 | Cookie consent appears immediately without user action — must be dismissed before proceeding. | |
| h03_d_05 | Undo and redo are supported | 2.0 | Issue | medium | host_supplied-1 | Logout accessible via User Menu avatar; no other session management controls observed. |
Consistency and Standards (h04) - 21 checklist items
| Item | Checklist text | Score | Status | Confidence | Severity basis | Evidence | Rationale |
|---|---|---|---|---|---|---|---|
| h04_d_01 | In your expert opinion, site content does not look like advertisements | 2.0 | Issue | medium | host_supplied-1 | Home link present in logged-out nav but disappears in logged-in state — inconsistency. | |
| h04_d_02 | Clickable elements use a consistent style/color for primary, secondary, and tertiary actions | 1.0 | Issue | high | host_supplied-1 | H4 headings used as tab controls — violates ARIA tab pattern; inconsistent heading semantics. | |
| h04_d_03 | Value proposition is clearly stated on the home page (tagline or welcome blurb) | 2.0 | Issue | high | host_supplied-1 | 'Setting a goal!' CTA styled as inline link text — looks like body text, not a button. | |
| h04_d_04 | Navigation choices are ordered in the most logical or task-oriented manner, with less important corporate information at the bottom | 3.0 | Major | medium | host_supplied-1 | Color palette appears consistent across navigation and content areas. | |
| h04_d_05 | All corporate information is grouped in one distinct area, such as About Us | 3.0 | Major | medium | host_supplied-1 | Typography appears consistent; lesson card labels are uniformly styled. | |
| h04_d_06 | The home page of the site has a memorable URL | 2.0 | Issue | medium | host_supplied-1 | Icon in User Menu button — label 'User Menu' may not match user expectation of 'Account'. | |
| h04_d_07 | Terminology is consistent with general web usage | 2.0 | Issue | medium | host_supplied-1 | Navigation items change between logged-in and logged-out states without clear pattern. | |
| h04_d_08 | There is a visible change when the mouse points at something clickable, excluding cursor changes | 3.0 | Major | low | host_supplied-1 | No forms on this screen — form styling N/A; rated neutral. | |
| h04_d_09 | Hypertext links that invoke actions, such as downloads or new windows, are clearly distinguished from hypertext links that load another page | 2.0 | Issue | medium | host_supplied-1 | Error message style not observed — JS errors are silent; no in-page error displays. | |
| h04_d_10 | If the site spawns new windows, these will not confuse the user and can be easily closed | 3.0 | Major | medium | host_supplied-1 | Spacing and layout appears consistent; grid-based card layout consistent. | |
| h04_d_11 | Menu instructions, prompts and messages appear in the same place on each screen | 2.0 | Issue | high | host_supplied-1 | Interactive tab elements and 'setting a goal!' CTA not consistently styled as interactive. | |
| h04_d_12 | The content is up-to-date, authoritative and trustworthy | 2.0 | Issue | medium | host_supplied-1 | Breadcrumb uses '>' ASCII character instead of semantic separator. | |
| h04_d_13 | The site contains third-party support, such as citations or testimonials, to verify the accuracy of information | 3.0 | Major | high | host_supplied-1 | Terminology consistent — 'Lessons', 'Goals', 'Progress' used throughout. | |
| h04_d_14 | It is clear that there is a real organization behind the site, such as a physical address or office photo | 2.0 | Issue | high | host_supplied-1 | No Sign Up CTA in nav; Sign In is the only auth entry point; new users must infer. | |
| h04_d_15 | The content is fresh: the site includes recent content | 2.0 | Issue | high | host_supplied-1 | H4 used for tab controls creates false visual hierarchy. | |
| h04_d_16 | The site is free of typographic errors and spelling mistakes | 2.0 | Issue | medium | host_supplied-1 | Active tab not clearly differentiated in accessibility tree. | |
| h04_d_17 | The visual design is consistent, including colors, layout, iconography, etc. | 3.0 | Major | high | host_supplied-1 | Oppia logo and brand colors present throughout; footer includes mission. | |
| h04_d_18 | On content pages, line lengths are neither too short (under 50 characters per line) nor too long (over 100 characters per line) when viewed in a standard browser width window | 3.0 | Major | medium | host_supplied-1 | Language selector present in nav; multiple languages supported. | |
| h04_d_19 | Fonts are used consistently and are legible | 3.0 | Major | medium | host_supplied-1 | No jarring animations or motion observed; loading state is simple text. | |
| h04_d_20 | The site can be used without scrolling horizontally | 2.0 | Issue | low | host_supplied-1 | Touch target sizes not verified; mobile not tested in this session. | |
| h04_d_21 | Design components, such as radio buttons and checkboxes, are used appropriately | 2.0 | Issue | medium | host_supplied-1 | Focus states not directly observable; H4 misuse likely affects keyboard navigation. |
Error Prevention (h05) - 5 checklist items
| Item | Checklist text | Score | Status | Confidence | Severity basis | Evidence | Rationale |
|---|---|---|---|---|---|---|---|
| h05_d_01 | Pages are free of scroll stoppers: headings or page elements that create the illusion that users have reached the top or bottom of a page when they have not | 3.0 | Major | high | host_supplied-1 | OAuth reduces password reuse risk; no destructive actions available at account creation. | |
| h05_d_02 | The user does not need to consult user manuals or other external information to use the site | 3.0 | Major | high | host_supplied-1 | No irreversible actions at account creation stage. | |
| h05_d_03 | User confirmation is required before carrying out potentially dangerous actions, such as deleting something | 3.0 | Major | high | host_supplied-1 | No user input forms at this stage that could generate errors. | |
| h05_d_04 | The site provides feedback that helps the user learn how to use the site | 3.0 | Major | medium | host_supplied-1 | Dashboard defaults to Home tab; category sections have sensible defaults. | |
| h05_d_05 | There is sufficient space between targets to prevent the user from hitting multiple or incorrect targets | 1.0 | Issue | high | host_supplied-1 | No warning shown that Google account is required before initiating sign-up flow — users without Google accounts hit a dead end. |
Recognition Rather Than Recall (h06) - 4 checklist items
| Item | Checklist text | Score | Status | Confidence | Severity basis | Evidence | Rationale |
|---|---|---|---|---|---|---|---|
| h06_d_01 | Search suggestions or filters are provided | 2.0 | Issue | high | host_supplied-1 | Dashboard tabs are visible but not labeled as tabs — no affordance for tab interaction. | |
| h06_d_02 | Each page is clearly labeled with a descriptive and useful title that makes sense as a bookmark | 2.0 | Issue | medium | host_supplied-1 | Breadcrumb provides minimal context; new user cannot know where they are in the site. | |
| h06_d_03 | Links and link titles are descriptive and predictive, and there are no Click here links | 2.0 | Issue | high | host_supplied-1 | 'Setting a goal!' link styled as body text — low affordance; hard to identify as interactive. | |
| h06_d_04 | Buttons and links show that they have been clicked | 2.0 | Issue | high | host_supplied-1 | New user must remember that 'Sign In' is also 'Sign Up'; dashboard state not explained. |
Flexibility and Efficiency of Use (h07) - 9 checklist items
| Item | Checklist text | Score | Status | Confidence | Severity basis | Evidence | Rationale |
|---|---|---|---|---|---|---|---|
| h07_d_01 | Useful content is presented on the home page or within one click of the home page | 1.0 | Issue | medium | host_supplied-1 | No keyboard shortcuts observed on dashboard or in auth flow. | |
| h07_d_02 | The terms used for navigation items and hypertext links are unambiguous and jargon-free | 2.0 | Issue | medium | host_supplied-1 | Greeting 'Good Morning, jkhobson1!' is personalized; category topics available. | |
| h07_d_03 | If there are product pages, they contain the detail necessary to make a purchase, and users can zoom in on product images | 2.0 | Issue | low | host_supplied-1 | No bulk actions applicable at this stage. | |
| h07_d_04 | The words, phrases and concepts used will be familiar to the typical user | 1.0 | Issue | high | host_supplied-1 | No 'continue where you left off' widget — confirmed unresolved bug; progress not persisted. | |
| h07_d_05 | Content feels friendly for new users | 1.0 | Issue | high | host_supplied-1 | No search functionality on the dashboard — users must browse categories. | |
| h07_d_06 | Content feels customizable or useable for frequent or expert users | 2.0 | Issue | medium | host_supplied-1 | OAuth flow adds multi-step friction; redirect chain is longer than necessary. | |
| h07_d_07 | The screen density is appropriate for the target users and their tasks | 1.0 | Issue | high | host_supplied-1 | No adaptive UI behaviors — same content shown for new and returning users. | |
| h07_d_08 | Icons and graphics are standard and/or intuitive (concrete and familiar) | 2.0 | Issue | low | host_supplied-1 | No expert or power-user modes at dashboard level. | |
| h07_d_09 | Where tooltips are used, they provide useful additional help and do not simply duplicate text in the icon, link or field label | 1.0 | Issue | high | host_supplied-1 | No cross-device continuation; progress persistence bug means no resumable sessions. |
Aesthetic and Minimalist Design (h08) - 16 checklist items
| Item | Checklist text | Score | Status | Confidence | Severity basis | Evidence | Rationale |
|---|---|---|---|---|---|---|---|
| h08_d_01 | By just looking at the home page, the first time user will understand where to start | 3.0 | Major | medium | host_supplied-1 | Dashboard is clean and visually simple; good use of white space around card grid. | |
| h08_d_02 | Primary actions are easy to find and understand | 3.0 | Major | medium | host_supplied-1 | Information density is appropriate — lesson cards with counts and thumbnails. | |
| h08_d_03 | Individual pages are free of clutter and irrelevant information, and attention-attracting features are used sparingly and only where relevant | 3.0 | Major | medium | host_supplied-1 | Adequate white space between sections; category cards well-spaced. | |
| h08_d_04 | The home page is professionally designed and will create a positive first impression | 3.0 | Major | medium | host_supplied-1 | Color palette appears harmonious; brand colors consistently applied. | |
| h08_d_05 | The home page looks like a home page; pages lower in the site will not be confused with it | 2.0 | Issue | high | host_supplied-1 | Typography hierarchy undermined by H4 misuse for tab labels. | |
| h08_d_06 | The site avoids advertisements, especially pop-ups | 3.0 | Major | medium | host_supplied-1 | Image quality appears good; lesson card thumbnails and avatar visible. | |
| h08_d_07 | Text is concise, with no needless instructions or welcome notes | 3.0 | Major | medium | host_supplied-1 | No jarring animations; transitions appear smooth. | |
| h08_d_08 | Pages use bulleted and numbered lists in preference to narrative text | 1.0 | Issue | high | host_supplied-1 | Loading state is blank/text-only with no skeleton UI — 5+ second blank screen for new users. | |
| h08_d_09 | The most important items in a list are placed at the top | 2.0 | Issue | low | host_supplied-1 | Mobile layout not directly tested; desktop layout is well-structured. | |
| h08_d_10 | Pages are quick to scan, with ample headings and subheadings and short paragraphs | 2.0 | Issue | low | host_supplied-1 | Color contrast not directly testable from accessibility snapshots. | |
| h08_d_11 | Information is organized hierarchically, from the general to the specific, and the organization is clear and logical | 2.0 | Issue | low | host_supplied-1 | Responsive design not directly tested in this session. | |
| h08_d_12 | Text links are long enough to be understood, but short enough to minimize wrapping, especially when used as a navigation list | 2.0 | Issue | low | host_supplied-1 | Limited hover/focus states visible in accessibility snapshot. | |
| h08_d_13 | On all pages, the most important information, such as frequently used topics, features and functions, is presented on the first screenful of information above the fold | 3.0 | Major | high | host_supplied-1 | Oppia logo, brand colors, and mission statement present throughout. | |
| h08_d_14 | The relationship between controls and their actions is obvious | 3.0 | Major | high | host_supplied-1 | Professional, clean first impression on dashboard; category cards inviting. | |
| h08_d_15 | There is a clear visual starting point to every page | 2.0 | Issue | low | host_supplied-1 | Dark mode not observed or tested. | |
| h08_d_16 | The site is pleasant to look at | 2.0 | Issue | low | host_supplied-1 | Print view not applicable or tested at this stage. |
Help Users Recognize, Diagnose, and Recover from Errors (h09) - 2 checklist items
| Item | Checklist text | Score | Status | Confidence | Severity basis | Evidence | Rationale |
|---|---|---|---|---|---|---|---|
| h09_d_01 | The site uses a customised 404 page, which includes tips on how to find the missing page and links to Home and Search | 2.0 | Issue | medium | host_supplied-1 | OAuth errors shown by Google (external); Oppia does not provide contextual auth error help. | |
| h09_d_02 | Error messages contain clear instructions on what to do next, including form error states | 1.0 | Issue | high | host_supplied-1 | Two silent JS console errors with no recovery path; users unaware anything is wrong. |
Help and Documentation (h10) - 5 checklist items
| Item | Checklist text | Score | Status | Confidence | Severity basis | Evidence | Rationale |
|---|---|---|---|---|---|---|---|
| h10_d_01 | Help is available and easy to find | 1.0 | Issue | high | host_supplied-1 | No contextual help visible anywhere on the dashboard for new users. | |
| h10_d_02 | FAQs are present if appropriate | 1.0 | Issue | high | host_supplied-1 | No help center, FAQ, or search accessible from the dashboard. | |
| h10_d_03 | When giving instructions, pages tell users what to do rather than what to avoid doing | 1.0 | Issue | high | host_supplied-1 | No onboarding modal, welcome sequence, or guided tour for first-time users. | |
| h10_d_04 | The site shows users how to do common tasks where appropriate, such as demonstrations of the site's functionality | 2.0 | Issue | low | host_supplied-1 | Tooltips may exist on some elements but none observed in this session. | |
| h10_d_05 | It is easy to contact someone for assistance and a reply is received quickly | 2.0 | Issue | medium | host_supplied-1 | OAuth error guidance provided by Google; Oppia-specific auth help unavailable. |
Accessibility and Ease of Access (h11) - 4 checklist items
| Item | Checklist text | Score | Status | Confidence | Severity basis | Evidence | Rationale |
|---|---|---|---|---|---|---|---|
| h11_d_01 | P - Content alternatives are provided, content is adaptable, and content is easy to hear and see | 2.0 | Issue | high | host_supplied-1 | H4 used as tab controls violates ARIA tab pattern. Dashboard may lack accessible names for sections. Progress ring unlabeled. Cookie consent banner may lack accessible label. SPA title bug creates screen reader confusion. | |
| h11_d_02 | O - All functionality is available and flexible, enough time is provided, content is safe, and content is easy to find | 1.0 | Issue | medium | host_supplied-1 | Keyboard navigation possible via standard browser; no focus traps observed. Cookie consent dismissible via keyboard. Tab order not fully verified. | |
| h11_d_03 | U - Content text is readable and understandable, content appears and operates in predictable ways, and users are helped to avoid and correct mistakes | 1.0 | Issue | high | host_supplied-1 | Language is clear and simple. SPA title bug creates momentary confusion. 'Sign In' covering Sign Up reduces understandability for first-time users. | |
| h11_d_04 | R - Compatibility is maximized for current and future user agents | 2.0 | Issue | high | host_supplied-1 | H4 elements used as tab controls are not robust across AT. Custom interactive elements without proper ARIA roles undermine robustness. 2 silent JS errors may affect AT compatibility. |
Empathetic Engagement and Inclusion (h12) - 6 checklist items
| Item | Checklist text | Score | Status | Confidence | Severity basis | Evidence | Rationale |
|---|---|---|---|---|---|---|---|
| h12_d_01 | The interface acknowledges and responds to user emotions, either through design, content, or interactive elements | 1.0 | Issue | medium | host_supplied-1 | Sign-up experience is emotionally neutral. Missing welcome/onboarding moment is a minor emotional gap for new learners. | |
| h12_d_02 | The design ensures users feel safe and secure, minimizing anxiety-inducing elements | 2.0 | Issue | high | host_supplied-1 | Google-only auth creates safety/access concern for users on shared devices, restricted networks, or in regions where Google is blocked (including parts of Oppia's target population in under-resourced communities). | |
| h12_d_03 | The content and design elements respect and reflect a wide range of cultural norms and values | 2.0 | Issue | high | host_supplied-1 | Google-only authentication excludes learners in Google-restricted regions (China, some corporate/school networks). Oppia serves global learners; this is a meaningful access gap. | |
| h12_d_04 | Information is presented in a way that shows understanding and consideration for the user's emotional state | 1.0 | Issue | medium | host_supplied-1 | Dashboard greeting is personalized. No welcome sequence showing understanding of first-time learner anxiety or excitement. | |
| h12_d_05 | Design and content are accessible to users with various physical and cognitive abilities, promoting inclusivity | 2.0 | Issue | high | host_supplied-1 | H4 misuse, custom elements, ARIA concerns affect users with assistive technology. Same as H11 concerns. | |
| h12_d_06 | Features and functionalities empower users, giving them control and choice in their interactions | 1.0 | Issue | medium | host_supplied-1 | User can sign in and out; basic session control available. No additional empowerment features at sign-up stage. |
Customer Journey and Satisfaction (h13) - 6 checklist items
| Item | Checklist text | Score | Status | Confidence | Severity basis | Evidence | Rationale |
|---|---|---|---|---|---|---|---|
| h13_d_01 | The interface reflects the brand's values and aesthetics consistently across all elements | 1.0 | Issue | high | host_supplied-1 | Oppia brand and mission ('For free, for everyone, forever') is consistent throughout the sign-up journey. | |
| h13_d_02 | Navigation and workflows are intuitive, creating a seamless experience from start to finish | 2.0 | Issue | high | host_supplied-1 | OAuth redirect breaks Oppia context — user leaves Oppia for Google, then returns. No seamless embedded auth. This creates a jarring journey break. | |
| h13_d_03 | The system offers personalized options or content based on user data and preferences | 1.0 | Issue | medium | host_supplied-1 | Dashboard greeting with username is personalized. Limited additional personalization at sign-up stage. | |
| h13_d_04 | Easy access to support and a straightforward method for users to provide feedback | 2.0 | Issue | high | host_supplied-1 | No help channel for sign-up failures within Oppia. Google-level errors not explained by Oppia context. | |
| h13_d_05 | Features or elements make the user feel valued and rewarded for their engagement | 2.0 | Issue | high | host_supplied-1 | No welcome celebration or onboarding sequence for first-time account creation. Users land on the dashboard without any sense of milestone or accomplishment. | |
| h13_d_06 | Clear communication about data usage, privacy policies, and other aspects that build user trust | 2.0 | Issue | high | host_supplied-1 | No privacy statement or data use explanation shown during or after OAuth. Users not informed what data Oppia collects via Google. |
UX Writing / Content and Tone (h14) - 7 checklist items
| Item | Checklist text | Score | Status | Confidence | Severity basis | Evidence | Rationale |
|---|---|---|---|---|---|---|---|
| h14_d_01 | Follows the current product's established style guide and brand voice | 1.0 | Issue | medium | host_supplied-1 | Interface mostly follows Oppia style guide. Minor inconsistencies in interactive element labeling. | |
| h14_d_02 | Content is clear | 1.0 | Issue | medium | host_supplied-1 | Dashboard content is generally clear. 'Setting a goal!' inline link is ambiguous. | |
| h14_d_03 | Content avoids jargon and uses simple, everyday language | 1.0 | Issue | high | host_supplied-1 | 'Sign In' covering Sign Up is a UX writing gap. Dashboard labels are otherwise learner-appropriate. | |
| h14_d_04 | All UI labels use simple and concise words | 2.0 | Issue | high | host_supplied-1 | 'Sign In with Google' does not clarify account creation. 'User Menu' label may not match expectation. 'Setting a goal!' styled as link is ambiguous. | |
| h14_d_05 | Calls to action are specific, use active language, and are clearly organized by importance | 2.0 | Issue | high | host_supplied-1 | No explicit Sign Up CTA. 'Sign In with Google' covers both but doesn't tell new users they can create an account this way. | |
| h14_d_06 | No paragraphs more than three lines | 0.0 | Passed | medium | host_supplied-1 | Dashboard content is concise; no paragraphs over three lines observed. | |
| h14_d_07 | The content above the fold, including headings, subheadings, and copy, makes each page's purpose clear and obvious | 2.0 | Issue | high | host_supplied-1 | Important auth content competes with category clutter above the fold. SPA loading blank screen occupies the above-fold area for 5+ seconds. |
Evidence Appendix
No evidence references were supplied.