{
 "cells": [
  {
   "cell_type": "markdown",
   "id": "ch08-preview-title",
   "metadata": {},
   "source": [
    "# Preview\n",
    "\n",
    "- Use these questions before class to check your familiarity with the chapter glossary and core terms.\n",
    "- Sign in from the account menu before you start answering the questions.\n",
    "- Multiple submissions are allowed. The highest score is kept.\n",
    "\n",
    "Review the [Chapter 14 glossary](../1400-classification.ipynb) before class. These ten questions mix multiple-choice and true/false: seven recognize terms and three connect related ideas. No calculations or code tracing are required.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "ch08-preview-quiz",
   "metadata": {},
   "source": [
    "<style>\n",
    ".ch14-preview-quiz { max-width: 900px; }\n",
    ".ch14-preview-question { border: 1px solid #d8dee4; border-radius: 6px; padding: 1rem; margin: 1rem 0; background: #fff; }\n",
    ".ch14-preview-question p { margin-top: 0; font-weight: 600; }\n",
    ".ch14-preview-question label { display: block; margin: 0.35rem 0; cursor: pointer; }\n",
    ".ch14-preview-question input { margin-right: 0.4rem; }\n",
    ".ch14-preview-actions { display: flex; gap: 0.75rem; align-items: center; margin: 1rem 0; flex-wrap: wrap; }\n",
    ".ch14-preview-actions button { border: 1px solid #176de8; border-radius: 6px; background: #176de8; color: white; padding: 0.55rem 0.9rem; cursor: pointer; font-weight: 600; }\n",
    ".ch14-preview-actions button.secondary { background: white; color: #176de8; }\n",
    ".ch14-preview-actions.is-locked { opacity: 0.55; }\n",
    ".ch14-preview-actions button:disabled { cursor: not-allowed; opacity: 0.65; }\n",
    ".ch14-preview-result { font-weight: 600; }\n",
    ".ch14-preview-feedback { margin-top: 0.65rem; font-weight: 600; }\n",
    ".ch14-preview-feedback.correct { color: #1a7f37; }\n",
    ".ch14-preview-feedback.incorrect { color: #cf222e; }\n",
    "</style>\n",
    "\n",
    "<div class='ch14-preview-quiz' id='ch14-preview-quiz' data-question-set-version='dsm-ch14-preview-2026-10-19-v2'>\n",
    "  <p>Earlier submissions and best scores are retained. If you already completed this Preview, you do not need to repeat it; you may retry the revised questions.</p>\n",
    "  <div id='ch14-preview-questions'></div>\n",
    "  <div class='ch14-preview-actions'>\n",
    "    <button type='button' id='ch14-preview-submit' disabled>Submit</button>\n",
    "    <button type='button' class='secondary' id='ch14-preview-reset'>Reset</button>\n",
    "    <span class='ch14-preview-result' id='ch14-preview-result' aria-live='polite'></span>\n",
    "  </div>\n",
    "</div>\n",
    "\n",
    "<script>\n",
    "(function () {\n",
    "  var quizId = 'ch14-preview';\n",
    "  var questionSetVersion = 'dsm-ch14-preview-2026-10-19-v2';\n",
    "  var answersUnlocked = false;\n",
    "  var attemptState = null;\n",
    "  var stateQueue = Promise.resolve();\n",
    "\n",
    "  function stateRequest(action, extra) {\n",
    "    return fetch('/api/v1/preview-options.php', {\n",
    "      method: 'POST', credentials: 'same-origin',\n",
    "      headers: { 'Content-Type': 'application/json' },\n",
    "      body: JSON.stringify(Object.assign({\n",
    "        assignment_id: quizId, version: questionSetVersion, action: action,\n",
    "        page: window.location.pathname.replace(/^\\/+/, '').replace(/\\.html$/, ''),\n",
    "        questions: authoredQuestions, legacy_questions: legacyQuestions, legacy_version: legacyVersion, token: attemptState && attemptState.token,\n",
    "        revision: attemptState && attemptState.revision\n",
    "      }, extra || {}))\n",
    "    }).then(function (response) {\n",
    "      return response.json().then(function (payload) {\n",
    "        if (!response.ok || !payload.ok) throw new Error(payload.error || 'Could not save Preview state.');\n",
    "        attemptState = payload.state;\n",
    "        return payload;\n",
    "      });\n",
    "    });\n",
    "  }\n",
    "\n",
    "  function draftAnswers(quiz) {\n",
    "    var answers = {};\n",
    "    questions.forEach(function (question) {\n",
    "      var input = quiz.querySelector('input[name=' + question.id + ']:checked');\n",
    "      if (input) answers[question.id] = input.value;\n",
    "    });\n",
    "    return answers;\n",
    "  }\n",
    "\n",
    "  function saveAnswers(quiz) {\n",
    "    var answers = draftAnswers(quiz);\n",
    "    stateQueue = stateQueue.catch(function () {}).then(function () {\n",
    "      return stateRequest('save', { answers: answers });\n",
    "    });\n",
    "    return stateQueue;\n",
    "  }\n",
    "  var questions = [\n",
    "  {\n",
    "    \"format\": \"true_false\",\n",
    "    \"prompt\": \"True or false: Classification predicts a category or label for an observation.\",\n",
    "    \"concepts\": [\n",
    "      \"Classification\",\n",
    "      \"Label\"\n",
    "    ],\n",
    "    \"explanation\": \"True. Classification assigns a categorical label, such as a service-request category. Regression predicts a numerical outcome, while clustering seeks groups without requiring known target labels.\",\n",
    "    \"retry_hint\": \"Review what kind of outcome a classifier produces.\",\n",
    "    \"id\": \"q1\",\n",
    "    \"cognitive_level\": \"recognition\",\n",
    "    \"reading\": \"../1401-classification.html\",\n",
    "    \"choices\": {\n",
    "      \"A\": \"True\",\n",
    "      \"B\": \"False\"\n",
    "    }\n",
    "  },\n",
    "  {\n",
    "    \"format\": \"multiple_choice\",\n",
    "    \"prompt\": \"A classifier uses transaction amount and account age to predict a label. What are those inputs called?\",\n",
    "    \"concepts\": [\n",
    "      \"Feature\",\n",
    "      \"Label\"\n",
    "    ],\n",
    "    \"explanation\": \"Features are input variables supplied for prediction. The label is the category being predicted, and the classifier is the model or rule that makes the prediction.\",\n",
    "    \"retry_hint\": \"Distinguish the information supplied to a model from the category it predicts.\",\n",
    "    \"id\": \"q2\",\n",
    "    \"cognitive_level\": \"recognition\",\n",
    "    \"reading\": \"../1404-rows-of-tables.html\",\n",
    "    \"choices\": {\n",
    "      \"A\": \"Labels\",\n",
    "      \"B\": \"Prediction errors\",\n",
    "      \"C\": \"Features\",\n",
    "      \"D\": \"Classifiers\"\n",
    "    }\n",
    "  },\n",
    "  {\n",
    "    \"format\": \"multiple_choice\",\n",
    "    \"prompt\": \"An observation is recorded as either returned or kept, and the model is trained to predict that category. The category is its:\",\n",
    "    \"concepts\": [\n",
    "      \"Label\",\n",
    "      \"Classification\"\n",
    "    ],\n",
    "    \"explanation\": \"A label is the category assigned to an observation and predicted by the classifier. Distance and feature space concern how inputs are represented or compared, rather than the target category.\",\n",
    "    \"retry_hint\": \"Identify the target category rather than a way to compare inputs.\",\n",
    "    \"id\": \"q3\",\n",
    "    \"cognitive_level\": \"recognition\",\n",
    "    \"reading\": \"../1401-classification.html\",\n",
    "    \"choices\": {\n",
    "      \"A\": \"Distance metric\",\n",
    "      \"B\": \"Feature space\",\n",
    "      \"C\": \"Training algorithm\",\n",
    "      \"D\": \"Label\"\n",
    "    }\n",
    "  },\n",
    "  {\n",
    "    \"format\": \"true_false\",\n",
    "    \"prompt\": \"True or false: Under the same distance rule, a larger distance means two observations are more similar.\",\n",
    "    \"concepts\": [\n",
    "      \"Distance\",\n",
    "      \"Similarity\"\n",
    "    ],\n",
    "    \"explanation\": \"False. Distance measures dissimilarity: larger distance indicates that observations are farther apart under the chosen rule. Similarity depends on the features and rule used for that comparison.\",\n",
    "    \"retry_hint\": \"Check whether distance measures likeness or dissimilarity.\",\n",
    "    \"id\": \"q4\",\n",
    "    \"cognitive_level\": \"recognition\",\n",
    "    \"reading\": \"../1402-nearest-neighbors.html\",\n",
    "    \"choices\": {\n",
    "      \"A\": \"True\",\n",
    "      \"B\": \"False\"\n",
    "    }\n",
    "  },\n",
    "  {\n",
    "    \"format\": \"multiple_choice\",\n",
    "    \"prompt\": \"Which data are used to build or fit the classifier before it is evaluated on held-out cases?\",\n",
    "    \"concepts\": [\n",
    "      \"Training data\",\n",
    "      \"Test data\"\n",
    "    ],\n",
    "    \"explanation\": \"Training data supply labeled examples for building the classifier. Test data are reserved for evaluating predictions on cases not used for fitting; they serve a different role.\",\n",
    "    \"retry_hint\": \"Separate the examples used to fit a model from those reserved for evaluation.\",\n",
    "    \"id\": \"q5\",\n",
    "    \"cognitive_level\": \"recognition\",\n",
    "    \"reading\": \"../1403-training-testing-accuracy.html\",\n",
    "    \"choices\": {\n",
    "      \"A\": \"Test data\",\n",
    "      \"B\": \"Only the labels predicted for future cases\",\n",
    "      \"C\": \"Training data\",\n",
    "      \"D\": \"A confusion matrix\"\n",
    "    }\n",
    "  },\n",
    "  {\n",
    "    \"format\": \"true_false\",\n",
    "    \"prompt\": \"True or false: A nearest-neighbor classifier uses the most similar labeled training example to predict a new case.\",\n",
    "    \"concepts\": [\n",
    "      \"Nearest neighbor\",\n",
    "      \"Training data\"\n",
    "    ],\n",
    "    \"explanation\": \"True. The nearest-neighbor rule finds a similar training observation using selected features and a distance rule, then uses its known label to predict the new observation.\",\n",
    "    \"retry_hint\": \"Connect a known training label with the idea of the closest comparison case.\",\n",
    "    \"id\": \"q6\",\n",
    "    \"cognitive_level\": \"recognition\",\n",
    "    \"reading\": \"../1402-nearest-neighbors.html\",\n",
    "    \"choices\": {\n",
    "      \"A\": \"True\",\n",
    "      \"B\": \"False\"\n",
    "    }\n",
    "  },\n",
    "  {\n",
    "    \"format\": \"multiple_choice\",\n",
    "    \"prompt\": \"Which table compares predicted categories with actual categories, showing different kinds of correct and incorrect predictions?\",\n",
    "    \"concepts\": [\n",
    "      \"Confusion matrix\",\n",
    "      \"Accuracy\"\n",
    "    ],\n",
    "    \"explanation\": \"A confusion matrix compares predicted and true labels by category. Unlike a single overall accuracy value, it helps separate different types of correct and incorrect classification.\",\n",
    "    \"retry_hint\": \"Look for a summary that compares predictions with known outcomes by category.\",\n",
    "    \"id\": \"q7\",\n",
    "    \"cognitive_level\": \"recognition\",\n",
    "    \"reading\": \"../1400-classification.html\",\n",
    "    \"choices\": {\n",
    "      \"A\": \"Feature matrix\",\n",
    "      \"B\": \"A table of distances only\",\n",
    "      \"C\": \"A list of training row numbers\",\n",
    "      \"D\": \"Confusion matrix\"\n",
    "    }\n",
    "  },\n",
    "  {\n",
    "    \"format\": \"multiple_choice\",\n",
    "    \"prompt\": \"A model flags an ordinary transaction as fraudulent, with fraud defined as the positive class. What type of error is this?\",\n",
    "    \"concepts\": [\n",
    "      \"False positive\",\n",
    "      \"False negative\",\n",
    "      \"Label\"\n",
    "    ],\n",
    "    \"explanation\": \"This is a false positive: the model predicts the positive class even though the actual case is negative. A false negative would miss a truly fraudulent transaction.\",\n",
    "    \"retry_hint\": \"Keep the predicted label and the actual label separate, using the stated positive class.\",\n",
    "    \"id\": \"q8\",\n",
    "    \"cognitive_level\": \"connection\",\n",
    "    \"reading\": \"../1400-classification.html\",\n",
    "    \"choices\": {\n",
    "      \"A\": \"False negative\",\n",
    "      \"B\": \"Correct positive\",\n",
    "      \"C\": \"Correct negative\",\n",
    "      \"D\": \"False positive\"\n",
    "    }\n",
    "  },\n",
    "  {\n",
    "    \"format\": \"true_false\",\n",
    "    \"prompt\": \"True or false: High accuracy on the same cases used for training guarantees equally high accuracy on new cases.\",\n",
    "    \"concepts\": [\n",
    "      \"Overfitting\",\n",
    "      \"Generalization\",\n",
    "      \"Training data\",\n",
    "      \"Test data\"\n",
    "    ],\n",
    "    \"explanation\": \"False. A classifier can fit its training cases very closely and still generalize poorly. Held-out evaluation checks behavior beyond those familiar cases; training accuracy alone supplies no guarantee.\",\n",
    "    \"retry_hint\": \"Connect the difference between training and test data with overfitting.\",\n",
    "    \"id\": \"q9\",\n",
    "    \"cognitive_level\": \"connection\",\n",
    "    \"reading\": \"../1403-training-testing-accuracy.html\",\n",
    "    \"choices\": {\n",
    "      \"A\": \"True\",\n",
    "      \"B\": \"False\"\n",
    "    }\n",
    "  },\n",
    "  {\n",
    "    \"format\": \"multiple_choice\",\n",
    "    \"prompt\": \"A team wants the fraction of held-out cases whose predicted labels match their actual labels. Which measure is it asking for?\",\n",
    "    \"concepts\": [\n",
    "      \"Accuracy\",\n",
    "      \"Test data\",\n",
    "      \"Generalization\"\n",
    "    ],\n",
    "    \"explanation\": \"Test accuracy is the fraction of held-out cases classified correctly. It summarizes performance on those test cases, while a confusion matrix can show which categories or errors need closer attention.\",\n",
    "    \"retry_hint\": \"Match the requested fraction with both the evaluation set and the comparison of labels.\",\n",
    "    \"id\": \"q10\",\n",
    "    \"cognitive_level\": \"connection\",\n",
    "    \"reading\": \"../1403-training-testing-accuracy.html\",\n",
    "    \"choices\": {\n",
    "      \"A\": \"Training accuracy\",\n",
    "      \"B\": \"The total number of test cases, regardless of correctness\",\n",
    "      \"C\": \"Test accuracy\",\n",
    "      \"D\": \"Distance to the nearest training example\"\n",
    "    }\n",
    "  }\n",
    "];\n",
    "\n",
    "  var legacyQuestions = [\n",
    "  {\n",
    "    \"id\": \"q1\",\n",
    "    \"prompt\": \"Which term matches this explanation? Predicting a categorical label for an observation.\",\n",
    "    \"choices\": {\n",
    "      \"A\": \"Classification\",\n",
    "      \"B\": \"Classifier\",\n",
    "      \"C\": \"Label\",\n",
    "      \"D\": \"Feature\"\n",
    "    },\n",
    "    \"format\": \"multiple_choice\",\n",
    "    \"cognitive_level\": \"recognition\",\n",
    "    \"concepts\": [\n",
    "      \"Classification\"\n",
    "    ],\n",
    "    \"explanation\": \"Classification: Predicting a categorical label for an observation. This is the glossary meaning used by this original question.\",\n",
    "    \"retry_hint\": \"Compare the related terms in the assigned chapter glossary; identify what the description refers to.\",\n",
    "    \"reading\": \"../1400-classification.html\"\n",
    "  },\n",
    "  {\n",
    "    \"id\": \"q2\",\n",
    "    \"prompt\": \"Which term matches this explanation? The category being predicted.\",\n",
    "    \"choices\": {\n",
    "      \"A\": \"Feature\",\n",
    "      \"B\": \"Training data\",\n",
    "      \"C\": \"Label\",\n",
    "      \"D\": \"Test data\"\n",
    "    },\n",
    "    \"format\": \"multiple_choice\",\n",
    "    \"cognitive_level\": \"recognition\",\n",
    "    \"concepts\": [\n",
    "      \"Label\"\n",
    "    ],\n",
    "    \"explanation\": \"Label: The category being predicted. This is the glossary meaning used by this original question.\",\n",
    "    \"retry_hint\": \"Compare the related terms in the assigned chapter glossary; identify what the description refers to.\",\n",
    "    \"reading\": \"../1400-classification.html\"\n",
    "  },\n",
    "  {\n",
    "    \"id\": \"q3\",\n",
    "    \"prompt\": \"Which term matches this explanation? Labeled data used to build a classifier.\",\n",
    "    \"choices\": {\n",
    "      \"A\": \"Classification\",\n",
    "      \"B\": \"Classifier\",\n",
    "      \"C\": \"Label\",\n",
    "      \"D\": \"Training data\"\n",
    "    },\n",
    "    \"format\": \"multiple_choice\",\n",
    "    \"cognitive_level\": \"recognition\",\n",
    "    \"concepts\": [\n",
    "      \"Training data\"\n",
    "    ],\n",
    "    \"explanation\": \"Training data: Labeled data used to build a classifier. This is the glossary meaning used by this original question.\",\n",
    "    \"retry_hint\": \"Compare the related terms in the assigned chapter glossary; identify what the description refers to.\",\n",
    "    \"reading\": \"../1400-classification.html\"\n",
    "  },\n",
    "  {\n",
    "    \"id\": \"q4\",\n",
    "    \"prompt\": \"Which term matches this explanation? A numeric measure of dissimilarity between observations.\",\n",
    "    \"choices\": {\n",
    "      \"A\": \"Classification\",\n",
    "      \"B\": \"Distance\",\n",
    "      \"C\": \"Label\",\n",
    "      \"D\": \"Classifier\"\n",
    "    },\n",
    "    \"format\": \"multiple_choice\",\n",
    "    \"cognitive_level\": \"recognition\",\n",
    "    \"concepts\": [\n",
    "      \"Distance\"\n",
    "    ],\n",
    "    \"explanation\": \"Distance: A numeric measure of dissimilarity between observations. This is the glossary meaning used by this original question.\",\n",
    "    \"retry_hint\": \"Compare the related terms in the assigned chapter glossary; identify what the description refers to.\",\n",
    "    \"reading\": \"../1400-classification.html\"\n",
    "  },\n",
    "  {\n",
    "    \"id\": \"q5\",\n",
    "    \"prompt\": \"Which term matches this explanation? The coordinate system formed by model features.\",\n",
    "    \"choices\": {\n",
    "      \"A\": \"Classifier\",\n",
    "      \"B\": \"Classification\",\n",
    "      \"C\": \"Feature space\",\n",
    "      \"D\": \"Label\"\n",
    "    },\n",
    "    \"format\": \"multiple_choice\",\n",
    "    \"cognitive_level\": \"recognition\",\n",
    "    \"concepts\": [\n",
    "      \"Feature space\"\n",
    "    ],\n",
    "    \"explanation\": \"Feature space: The coordinate system formed by model features. This is the glossary meaning used by this original question.\",\n",
    "    \"retry_hint\": \"Compare the related terms in the assigned chapter glossary; identify what the description refers to.\",\n",
    "    \"reading\": \"../1400-classification.html\"\n",
    "  },\n",
    "  {\n",
    "    \"id\": \"q6\",\n",
    "    \"prompt\": \"Which term matches this explanation? The fraction of test cases classified correctly.\",\n",
    "    \"choices\": {\n",
    "      \"A\": \"Accuracy\",\n",
    "      \"B\": \"Classification\",\n",
    "      \"C\": \"Classifier\",\n",
    "      \"D\": \"Label\"\n",
    "    },\n",
    "    \"format\": \"multiple_choice\",\n",
    "    \"cognitive_level\": \"recognition\",\n",
    "    \"concepts\": [\n",
    "      \"Accuracy\"\n",
    "    ],\n",
    "    \"explanation\": \"Accuracy: The fraction of test cases classified correctly. This is the glossary meaning used by this original question.\",\n",
    "    \"retry_hint\": \"Compare the related terms in the assigned chapter glossary; identify what the description refers to.\",\n",
    "    \"reading\": \"../1400-classification.html\"\n",
    "  },\n",
    "  {\n",
    "    \"id\": \"q7\",\n",
    "    \"prompt\": \"Which term matches this explanation? A table comparing predicted labels with true labels.\",\n",
    "    \"choices\": {\n",
    "      \"A\": \"Classification\",\n",
    "      \"B\": \"Classifier\",\n",
    "      \"C\": \"Label\",\n",
    "      \"D\": \"Confusion matrix\"\n",
    "    },\n",
    "    \"format\": \"multiple_choice\",\n",
    "    \"cognitive_level\": \"recognition\",\n",
    "    \"concepts\": [\n",
    "      \"Confusion matrix\"\n",
    "    ],\n",
    "    \"explanation\": \"Confusion matrix: A table comparing predicted labels with true labels. This is the glossary meaning used by this original question.\",\n",
    "    \"retry_hint\": \"Compare the related terms in the assigned chapter glossary; identify what the description refers to.\",\n",
    "    \"reading\": \"../1400-classification.html\"\n",
    "  },\n",
    "  {\n",
    "    \"id\": \"q8\",\n",
    "    \"prompt\": \"Which term matches this explanation? When a classifier matches training data too closely.\",\n",
    "    \"choices\": {\n",
    "      \"A\": \"Classification\",\n",
    "      \"B\": \"Classifier\",\n",
    "      \"C\": \"Label\",\n",
    "      \"D\": \"Overfitting\"\n",
    "    },\n",
    "    \"format\": \"multiple_choice\",\n",
    "    \"cognitive_level\": \"recognition\",\n",
    "    \"concepts\": [\n",
    "      \"Overfitting\"\n",
    "    ],\n",
    "    \"explanation\": \"Overfitting: When a classifier matches training data too closely. This is the glossary meaning used by this original question.\",\n",
    "    \"retry_hint\": \"Compare the related terms in the assigned chapter glossary; identify what the description refers to.\",\n",
    "    \"reading\": \"../1400-classification.html\"\n",
    "  },\n",
    "  {\n",
    "    \"id\": \"q9\",\n",
    "    \"prompt\": \"Which term matches this explanation? Learning from examples with known labels.\",\n",
    "    \"choices\": {\n",
    "      \"A\": \"Classification\",\n",
    "      \"B\": \"Supervised learning\",\n",
    "      \"C\": \"Classifier\",\n",
    "      \"D\": \"Label\"\n",
    "    },\n",
    "    \"format\": \"multiple_choice\",\n",
    "    \"cognitive_level\": \"recognition\",\n",
    "    \"concepts\": [\n",
    "      \"Supervised learning\"\n",
    "    ],\n",
    "    \"explanation\": \"Supervised learning: Learning from examples with known labels. This is the glossary meaning used by this original question.\",\n",
    "    \"retry_hint\": \"Compare the related terms in the assigned chapter glossary; identify what the description refers to.\",\n",
    "    \"reading\": \"../1400-classification.html\"\n",
    "  },\n",
    "  {\n",
    "    \"id\": \"q10\",\n",
    "    \"prompt\": \"Which term matches this explanation? One observation or case in a dataset.\",\n",
    "    \"choices\": {\n",
    "      \"A\": \"Classification\",\n",
    "      \"B\": \"Classifier\",\n",
    "      \"C\": \"Row of a table\",\n",
    "      \"D\": \"Label\"\n",
    "    },\n",
    "    \"format\": \"multiple_choice\",\n",
    "    \"cognitive_level\": \"recognition\",\n",
    "    \"concepts\": [\n",
    "      \"Row of a table\"\n",
    "    ],\n",
    "    \"explanation\": \"Row of a table: One observation or case in a dataset. This is the glossary meaning used by this original question.\",\n",
    "    \"retry_hint\": \"Compare the related terms in the assigned chapter glossary; identify what the description refers to.\",\n",
    "    \"reading\": \"../1400-classification.html\"\n",
    "  }\n",
    "];\n",
    "  var legacyVersion = 'dsm-ch14-preview-before-2026-10-19';\n",
    "  var authoredQuestions = JSON.parse(JSON.stringify(questions));\n",
    "\n",
    "  function text(value) {\n",
    "    return document.createTextNode(value);\n",
    "  }\n",
    "\n",
    "  function getParams() {\n",
    "    var params = new URLSearchParams(window.location.search);\n",
    "    return {\n",
    "      canvas_course_id: params.get('canvas_course_id') || params.get('course_id') || '',\n",
    "      canvas_assignment_id: params.get('canvas_assignment_id') || params.get('assignment_id') || '',\n",
    "      canvas_user_id: params.get('canvas_user_id') || params.get('user_id') || '',\n",
    "      student_identifier: params.get('student_identifier') || params.get('student_id') || params.get('email') || ''\n",
    "    };\n",
    "  }\n",
    "\n",
    "  function loadSessionIdentity(identity, actions, submit, result) {\n",
    "    submit.disabled = true;\n",
    "    actions.classList.add('is-locked');\n",
    "    result.textContent = 'Sign in from the account menu to submit this assignment.';\n",
    "\n",
    "    return fetch('/api/v1/session.php', { credentials: 'same-origin' })\n",
    "      .then(function (response) { return response.ok ? response.json() : null; })\n",
    "      .then(function (payload) {\n",
    "        if (!payload || !payload.authenticated || !payload.identity) return identity;\n",
    "        identity.canvas_user_id = payload.identity.canvas_user_id || identity.canvas_user_id || '';\n",
    "        identity.student_identifier = payload.identity.student_identifier || identity.student_identifier || '';\n",
    "        submit.disabled = false;\n",
    "        actions.classList.remove('is-locked');\n",
    "        result.textContent = payload.identity.display_name ? 'Signed in as ' + payload.identity.display_name + '.' : 'Signed in.';\n",
    "        return identity;\n",
    "      })\n",
    "      .catch(function () { return identity; });\n",
    "  }\n",
    "\n",
    "  function renderQuestions(container) {\n",
    "    container.textContent = '';\n",
    "    questions.forEach(function (question, index) {\n",
    "      var card = document.createElement('div');\n",
    "      card.className = 'ch14-preview-question';\n",
    "      card.dataset.question = question.id;\n",
    "\n",
    "      var prompt = document.createElement('p');\n",
    "      prompt.appendChild(text((index + 1) + '. ' + question.prompt));\n",
    "      card.appendChild(prompt);\n",
    "\n",
    "      (attemptState ? attemptState.orders[question.id] : Object.keys(question.choices)).forEach(function (letter, position) {\n",
    "        var label = document.createElement('label');\n",
    "        var input = document.createElement('input');\n",
    "        input.type = 'radio';\n",
    "        input.name = question.id;\n",
    "        input.value = letter;\n",
    "        input.checked = !!(attemptState && attemptState.answers[question.id] === letter);\n",
    "        label.appendChild(input);\n",
    "        label.appendChild(text(String.fromCharCode(65 + position) + '. ' + question.choices[letter]));\n",
    "        card.appendChild(label);\n",
    "      });\n",
    "\n",
    "      var feedback = document.createElement('div');\n",
    "      feedback.className = 'ch14-preview-feedback';\n",
    "      feedback.setAttribute('aria-live', 'polite');\n",
    "      card.appendChild(feedback);\n",
    "      container.appendChild(card);\n",
    "    });\n",
    "  }\n",
    "\n",
    "  function collectAnswers(quiz) {\n",
    "    var answers = {};\n",
    "    questions.forEach(function (question) {\n",
    "      var selected = quiz.querySelector('input[name=' + question.id + ']:checked');\n",
    "      answers[question.id] = selected ? selected.value : '';\n",
    "    });\n",
    "    // Press stores this marker with the submitted answers; it is not a scored question.\n",
    "    answers.__question_set = attemptState ? attemptState.version : questionSetVersion;\n",
    "    if (attemptState) answers.preview_attempt = attemptState.token;\n",
    "    return answers;\n",
    "  }\n",
    "\n",
    "  function loadFeedbackPolicy() {\n",
    "    // Use the existing server release setting; a network failure must not unlock answers.\n",
    "    return fetch('/api/v1/assignment-settings.php?assignment_id=' + encodeURIComponent(quizId), {\n",
    "      credentials: 'same-origin'\n",
    "    })\n",
    "      .then(function (response) { return response.ok ? response.json() : null; })\n",
    "      .then(function (payload) {\n",
    "        answersUnlocked = !!(payload && payload.ok && payload.answers_unlocked === true);\n",
    "      })\n",
    "      .catch(function () { answersUnlocked = false; });\n",
    "  }\n",
    "\n",
    "  function applyFeedback(quiz, feedback) {\n",
    "    questions.forEach(function (question) {\n",
    "      var card = quiz.querySelector('[data-question=' + question.id + ']');\n",
    "      var message = card.querySelector('.ch14-preview-feedback');\n",
    "      var item = feedback[question.id];\n",
    "      message.className = 'ch14-preview-feedback';\n",
    "      var status = (!item || !item.submitted) ? 'No answer submitted.' :\n",
    "        (item.correct ? 'Correct.' : 'Review and try again.');\n",
    "      var guidance = answersUnlocked ? question.explanation : question.retry_hint;\n",
    "      message.textContent = status + ' ' + guidance;\n",
    "      var reading = document.createElement('a');\n",
    "      reading.href = question.reading || \"../1400-classification.html\";\n",
    "      reading.appendChild(text('Review this concept'));\n",
    "      message.appendChild(text(' '));\n",
    "      message.appendChild(reading);\n",
    "      message.classList.add(item && item.correct ? 'correct' : 'incorrect');\n",
    "    });\n",
    "  }\n",
    "\n",
    "  function initLegacyPreviewQuiz() {\n",
    "    var quiz = document.getElementById('ch14-preview-quiz');\n",
    "    if (!quiz || quiz.dataset.ready === 'true') return;\n",
    "    quiz.dataset.ready = 'true';\n",
    "\n",
    "    var identity = getParams();\n",
    "    var questionsContainer = document.getElementById('ch14-preview-questions');\n",
    "    var result = document.getElementById('ch14-preview-result');\n",
    "    var submit = document.getElementById('ch14-preview-submit');\n",
    "    var actions = quiz.querySelector('.ch14-preview-actions');\n",
    "    var reset = document.getElementById('ch14-preview-reset');\n",
    "\n",
    "    renderQuestions(questionsContainer);\n",
    "    loadSessionIdentity(identity, actions, submit, result);\n",
    "\n",
    "    submit.addEventListener('click', function () {\n",
    "      var answers = collectAnswers(quiz);\n",
    "      submit.disabled = true;\n",
    "      result.textContent = 'Submitting...';\n",
    "\n",
    "      fetch('/api/v1/quiz-attempts.php', {\n",
    "        method: 'POST',\n",
    "        headers: { 'Content-Type': 'application/json' },\n",
    "        credentials: 'same-origin',\n",
    "        body: JSON.stringify({\n",
    "          quiz_id: quizId,\n",
    "          question_set_version: questionSetVersion,\n",
    "          answers: answers,\n",
    "          student_identifier: identity.student_identifier || identity.canvas_user_id || '',\n",
    "          canvas_course_id: identity.canvas_course_id,\n",
    "          canvas_assignment_id: identity.canvas_assignment_id,\n",
    "          canvas_user_id: identity.canvas_user_id\n",
    "        })\n",
    "      })\n",
    "        .then(function (response) {\n",
    "          return response.text().then(function (text) {\n",
    "            var payload = null;\n",
    "            try {\n",
    "              payload = text ? JSON.parse(text) : null;\n",
    "            } catch (error) {\n",
    "              throw new Error('Server returned a non-JSON response (HTTP ' + response.status + '): ' + text.slice(0, 160));\n",
    "            }\n",
    "            if (!payload) {\n",
    "              throw new Error('Server returned an empty response (HTTP ' + response.status + '). Check that PHP is enabled for /api/v1/quiz-attempts.php.');\n",
    "            }\n",
    "            if (!response.ok || !payload.ok) {\n",
    "              throw new Error(payload.message || payload.error || 'Submission failed.');\n",
    "            }\n",
    "            return payload;\n",
    "          });\n",
    "        })\n",
    "        .then(function (payload) {\n",
    "          var best = (payload.best_score === null || typeof payload.best_score === 'undefined') ? payload.score : payload.best_score;\n",
    "          var attempt = (payload.attempt_count === null || typeof payload.attempt_count === 'undefined') ? '' : ' Attempt ' + payload.attempt_count + '.';\n",
    "          return loadFeedbackPolicy().then(function () {\n",
    "            applyFeedback(quiz, payload.feedback || {});\n",
    "            result.textContent = 'Submission saved.' + attempt + ' Score: ' + payload.score + ' / ' + payload.max_score + '. Best score: ' + best + ' / ' + payload.max_score + '. Canvas sync: ' + payload.canvas_sync_status + '.';\n",
    "            if (!answersUnlocked) result.textContent += ' Full explanations are available when answers are released.';\n",
    "          });\n",
    "        })\n",
    "        .catch(function (error) {\n",
    "          result.textContent = 'Could not save this attempt: ' + error.message;\n",
    "        })\n",
    "        .finally(function () {\n",
    "          submit.disabled = false;\n",
    "        });\n",
    "    });\n",
    "\n",
    "    reset.addEventListener('click', function () {\n",
    "      quiz.querySelectorAll('input[type=radio]').forEach(function (input) {\n",
    "        input.checked = false;\n",
    "      });\n",
    "      quiz.querySelectorAll('.ch14-preview-feedback').forEach(function (feedback) {\n",
    "        feedback.className = 'ch14-preview-feedback';\n",
    "        feedback.textContent = '';\n",
    "      });\n",
    "      result.textContent = '';\n",
    "    });\n",
    "  }\n",
    "\n",
    "\n",
    "  function initPreviewQuiz() {\n",
    "    // The legacy PHP host retains its existing fixed-order delivery until it migrates to Press.\n",
    "    if (!/(^|\\.)thinkpress\\.org$/.test(window.location.hostname) &&\n",
    "        !['localhost', '127.0.0.1'].includes(window.location.hostname)) return initLegacyPreviewQuiz();\n",
    "    var quiz = document.getElementById('ch14-preview-quiz');\n",
    "    if (!quiz || quiz.dataset.ready === 'true') return;\n",
    "    quiz.dataset.ready = 'true';\n",
    "\n",
    "    var identity = getParams();\n",
    "    var questionsContainer = document.getElementById('ch14-preview-questions');\n",
    "    var result = document.getElementById('ch14-preview-result');\n",
    "    var submit = document.getElementById('ch14-preview-submit');\n",
    "    var actions = quiz.querySelector('.ch14-preview-actions');\n",
    "    var reset = document.getElementById('ch14-preview-reset');\n",
    "\n",
    "    // Press owns this quiz's draft and option order; the generic runner must not restore older inputs over it.\n",
    "    quiz.classList.add('press-preview-managed');\n",
    "    var next = document.createElement('button');\n",
    "    next.type = 'button';\n",
    "    next.textContent = 'Start a new attempt';\n",
    "    next.hidden = true;\n",
    "    actions.appendChild(next);\n",
    "\n",
    "    function lockQuestions(locked) {\n",
    "      quiz.querySelectorAll('input[type=radio]').forEach(function (input) { input.disabled = locked; });\n",
    "      reset.disabled = locked;\n",
    "    }\n",
    "    function showState(payload) {\n",
    "      questions = attemptState.questions;\n",
    "      renderQuestions(questionsContainer);\n",
    "      lockQuestions(payload.completed);\n",
    "      submit.disabled = payload.completed;\n",
    "      next.hidden = !payload.completed;\n",
    "      if (!payload.completed) result.textContent = '';\n",
    "      if (attemptState.preserved_draft && !payload.completed) {\n",
    "        result.textContent = 'Resumed your saved answers with their original option order.';\n",
    "      }\n",
    "      if (payload.result) {\n",
    "        return loadFeedbackPolicy().then(function () {\n",
    "          applyFeedback(quiz, payload.result.feedback || {});\n",
    "          result.textContent = 'Saved attempt. Score: ' + payload.result.score + ' / ' + payload.result.max_score +\n",
    "            '. Best score: ' + payload.result.best_score + ' / ' + payload.result.max_score + '.';\n",
    "          if (!answersUnlocked) result.textContent += ' Full explanations are available when answers are released.';\n",
    "        });\n",
    "      }\n",
    "      return Promise.resolve();\n",
    "    }\n",
    "    renderQuestions(questionsContainer);\n",
    "    lockQuestions(true);\n",
    "    loadSessionIdentity(identity, actions, submit, result).then(function () {\n",
    "      if (submit.disabled) return;\n",
    "      submit.disabled = true;\n",
    "      result.textContent = 'Resuming your Preview...';\n",
    "      return stateRequest('resume').then(showState).catch(function (error) {\n",
    "        submit.disabled = true;\n",
    "        result.textContent = 'Could not resume this Preview: ' + error.message + ' Reload to retry.';\n",
    "      });\n",
    "    });\n",
    "\n",
    "    quiz.addEventListener('change', function (event) {\n",
    "      if (!event.target || event.target.type !== 'radio' || !attemptState) return;\n",
    "      saveAnswers(quiz).catch(function (error) { result.textContent = 'Answers not saved: ' + error.message; });\n",
    "    });\n",
    "\n",
    "    submit.addEventListener('click', async function () {\n",
    "      submit.disabled = true;\n",
    "      lockQuestions(true);\n",
    "      result.textContent = 'Submitting...';\n",
    "      try {\n",
    "        await saveAnswers(quiz);\n",
    "        var response = await fetch('/api/v1/quiz-attempts.php', {\n",
    "          method: 'POST', headers: { 'Content-Type': 'application/json' }, credentials: 'same-origin',\n",
    "          body: JSON.stringify({ quiz_id: quizId, answers: collectAnswers(quiz),\n",
    "            question_set_version: attemptState.version,\n",
    "            student_identifier: identity.student_identifier || identity.canvas_user_id || '',\n",
    "            canvas_course_id: identity.canvas_course_id, canvas_assignment_id: identity.canvas_assignment_id,\n",
    "            canvas_user_id: identity.canvas_user_id })\n",
    "        });\n",
    "        var payload = await response.json();\n",
    "        if (!response.ok || !payload.ok) throw new Error(payload.message || payload.error || 'Submission failed.');\n",
    "        await loadFeedbackPolicy();\n",
    "        applyFeedback(quiz, payload.feedback || {});\n",
    "        result.textContent = 'Submission saved. Attempt ' + payload.attempt_count + '. Score: ' + payload.score +\n",
    "          ' / ' + payload.max_score + '. Best score: ' + payload.best_score + ' / ' + payload.max_score + '.';\n",
    "        if (!answersUnlocked) result.textContent += ' Full explanations are available when answers are released.';\n",
    "        next.hidden = false;\n",
    "      } catch (error) {\n",
    "        result.textContent = 'Could not save this attempt: ' + error.message;\n",
    "        submit.disabled = false;\n",
    "        lockQuestions(false);\n",
    "      }\n",
    "    });\n",
    "\n",
    "    reset.addEventListener('click', function () {\n",
    "      submit.disabled = true;\n",
    "      stateQueue = stateQueue.catch(function () {}).then(function () { return stateRequest('clear'); });\n",
    "      stateQueue.then(function (payload) { result.textContent = ''; return showState(payload); })\n",
    "        .catch(function (error) { result.textContent = error.message; submit.disabled = false; });\n",
    "    });\n",
    "    next.addEventListener('click', function () {\n",
    "      next.disabled = true;\n",
    "      stateRequest('next').then(function (payload) { result.textContent = ''; return showState(payload); })\n",
    "        .catch(function (error) { result.textContent = error.message; })\n",
    "        .finally(function () { next.disabled = false; });\n",
    "    });\n",
    "  }\n",
    "\n",
    "  if (document.readyState === 'loading') {\n",
    "    document.addEventListener('DOMContentLoaded', initPreviewQuiz);\n",
    "  } else {\n",
    "    initPreviewQuiz();\n",
    "  }\n",
    "})();\n",
    "</script>"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "name": "python"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}