{"id":25449,"date":"2024-05-30T00:56:17","date_gmt":"2024-05-30T05:56:17","guid":{"rendered":"https:\/\/assess.com\/?p=25449"},"modified":"2026-01-01T07:29:26","modified_gmt":"2026-01-01T07:29:26","slug":"modified-angoff-method","status":"publish","type":"post","link":"https:\/\/assess.com\/modified-angoff-method\/","title":{"rendered":"Modified-Angoff Method: Guide to a Defensible Cutscore"},"content":{"rendered":"\n<p>The modified-Angoff method is one of the most common ways to set a defensible <a href=\"https:\/\/assess.com\/cutscore-passing-point\/\">cutscore<\/a> on an exam, especially in <a href=\"https:\/\/assess.com\/certification-exams\/\">Certification<\/a>.\u00a0A panel of experts reviews the items on a test and sets the cutscore based on difficulty and the intended population. It therefore means that the pass\/fail decisions made by the test are more meaningful than if you picked an arbitrary round number like 70%.\u00a0<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-what-is-the-angoff-method\">What is the Angoff method?<\/h2>\n\n\n\n<p>The Angoff method is a scientific way of setting a cutscore (pass point) on a test.\u00a0 If you have a <a href=\"https:\/\/assess.com\/norm-referenced-vs-criterion-referenced-testing\/\">criterion-referenced interpretation<\/a>, it is not legally defensible to just conveniently pick a round number like 70%; you need a formal process.\u00a0 There are a number of acceptable methodologies in the psychometric literature for <a href=\"https:\/\/assess.com\/what-is-a-standard-setting-study\/\"><strong>standard-setting studies<\/strong><\/a>, also known as cutscores or passing points.\u00a0 Some examples include Angoff, modified-Angoff, <a href=\"https:\/\/assess.com\/the-bookmark-method-of-standard-setting\/\">Bookmark<\/a>, Contrasting Groups, and <a href=\"https:\/\/assess.com\/borderline-group-method-standard-setting\/\">Borderline<\/a>.\u00a0 The <strong>modified-Angoff approach<\/strong> is by far the most popular approach.\u00a0 It is used especially frequently for certification, licensure, certificate, and other credentialing exams.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Intro to the Modified Angoff Method of Standard Setting\" width=\"1200\" height=\"675\" src=\"https:\/\/www.youtube.com\/embed\/bQF1kSlZkBE?start=57&#038;feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>It was originally suggested as a mere footnote by renowned researcher <a href=\"https:\/\/en.wikipedia.org\/wiki\/William_H._Angoff\">William Angoff<\/a>, at Educational Testing Service. Studies found that panelists involved in modified-Angoff sessions typically <a href=\"https:\/\/mededpublish.org\/articles\/7-200\">demonstrate high agreement levels<\/a>, with inter-rater reliability often surpassing 0.85, showcasing its robustness in decision consistency<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-how-does-the-angoff-approach-work\">How does the Angoff approach work?<\/h2>\n\n\n\n<p>First, you gather a group of <a href=\"https:\/\/assess.com\/subject-matter-experts-exam-development\/\">subject matter experts<\/a> (SMEs), with a minimum of 6, though 8-10 is preferred for better reliability, and have them define what they consider to be a Minimally Competent Candidate (MCC).&nbsp; Next, you have them estimate the percentage of minimally competent candidates that will answer each item correctly.&nbsp; You then analyze the results for outliers or inconsistencies.&nbsp; If experts disagree, you will need to evaluate <a href=\"https:\/\/assess.com\/inter-rater-reliability-vs-agreement\/\">inter-rater reliability and agreement<\/a>, and after that have the experts discuss and re-rate the items to gain better consensus.&nbsp; The average final rating is then the expected percent-correct score for a minimally competent candidate.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-advantages-of-the-angoff-method\">Advantages of the Angoff method<\/h2>\n\n\n\n<ol class=\"wp-block-list\">\n<li>It is defensible.&nbsp; Because it is the most commonly used approach and is widely studied in the scientific literature, it is well-accepted.<\/li>\n\n\n\n<li>You can implement it&nbsp;<em>before a test is ever delivered.&nbsp;<\/em> Some other methods require you to deliver the test to a large sample first.<\/li>\n\n\n\n<li>It is conceptually simple, easy enough to explain to non-psychometricians.<\/li>\n\n\n\n<li>It incorporates the judgment of a panel of experts, not just one person or a round number.<\/li>\n\n\n\n<li>It works for tests with both classical test theory and item response theory.<\/li>\n\n\n\n<li>It does not take long to implement &#8211; if a short test, it can be done in a matter of hours!<\/li>\n\n\n\n<li>It can be used with different item types, including <a href=\"https:\/\/assess.com\/what-do-dichotomous-and-polytomous-mean-in-irt\/\">polytomously scored items<\/a> (multi-points).<\/li>\n<\/ol>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-disadvantages-of-the-angoff-method\">Disadvantages of the Angoff method<\/h2>\n\n\n\n<ol class=\"wp-block-list\">\n<li>It does not use actual data, unless you implement the <a href=\"https:\/\/assess.com\/beuk-compromise\/\">Beuk method<\/a> alongside.<\/li>\n\n\n\n<li>It can lead to the experts overestimating the performance of entry-level candidates, as they forgot what it was like to start out 20-30 years ago.&nbsp; This is one reason to use the Beuk method as a &#8220;reality check&#8221; by showing the experts that if they stay with the cutscore they just picked, the majority of candidates might fail!<\/li>\n<\/ol>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-walkthrough-example-of-the-modified-angoff-approach\">Walkthrough Example of the Modified-Angoff Approach<\/h2>\n\n\n\n<p>First of all, do not expect a straightforward, easy process that leads to an unassailably correct cutscore. &nbsp;All standard-setting methods involve some degree of subjectivity. &nbsp;The goal of the methods is to reduce that subjectivity as much as possible. &nbsp;Some methods focus on content, others on examinee performance data, while some try to meld the two.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-step-1-prepare-your-team\">Step 1: Prepare Your Team<\/h3>\n\n\n\n<p>The modified-Angoff process depends on a representative sample of SMEs, usually 6-20. By &#8220;representative&#8221; I mean they should represent the various stakeholders. For instance, a certification for medical assistants might include experienced medical assistants, nurses, and physicians, from different areas of the country. You must train them about their role and how the process works, so they can understand the end goal and drive toward it.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-step-2-define-the-minimally-competent-candidate-mcc\">Step 2: Define The Minimally Competent Candidate (MCC)<\/h3>\n\n\n\n<p>This concept is the core of the modified-Angoff method, though it is known by a range of terms or acronyms, including minimally qualified candidates (MQC) or just barely qualified (JBQ). &nbsp;The reasoning is that we want our exam to separate candidates that are qualified from those that are not. &nbsp;So we ask the SMEs to define what makes someone qualified (or unqualified!) from a perspective of skills and knowledge. This leads to a conceptual definition of an MCC. We then want to estimate <strong>what score this borderline candidate would achieve<\/strong>, which is the goal of the remainder of the study. This step can be conducted in person, or via webinar.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-step-3-round-1-ratings\">Step 3: Round 1 Ratings<\/h3>\n\n\n\n<p>Next, ask your SMEs to read through all the items on your test form and estimate the percentage of MCCs that would answer each correctly. &nbsp;A rating of 100 means the item is a slam dunk; it is so easy that every MCC would get it right. &nbsp;A rating of 40 is very difficult. &nbsp;Most ratings are in the 60-90 range if the items are well-developed. The ratings should be gathered independently; if everyone is in the same room, let them work on their own in silence. This can easily be conducted remotely, though.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-step-4-discussion\">Step 4: Discussion<\/h3>\n\n\n\n<p>This is where it gets fun. &nbsp;Identify items where there is the most disagreement (as defined by grouped frequency distributions or standard deviation) and make the SMEs discuss it. &nbsp;Maybe two SMEs thought it was super easy and gave it a 95 and two other SMEs thought it was super hard and gave it a 45. &nbsp;They will try to convince the other side of their folly. Chances are that there will be <strong>no shortage of opinions<\/strong> and you, as the facilitator, will find your greatest challenge is keeping the meeting on track. This step can be conducted in person, or via webinar.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-step-5-round-2-ratings\">Step 5: Round 2 Ratings<\/h3>\n\n\n\n<p>Raters then re-rate the items based on the discussion. &nbsp;The goal is that there will be a <strong>greater consensus<\/strong>. &nbsp;In the previous example, it&#8217;s not likely that every rater will settle on a 70. &nbsp;But if your raters all end up from 60-80, that&#8217;s OK. How do you know there is enough consensus? &nbsp;We recommend the inter-rater reliability suggested by Shrout and Fleiss (1979), as well as looking at inter-rater agreement and dispersion of ratings for each item. This use of multiple rounds is known as the <a href=\"https:\/\/en.wikipedia.org\/wiki\/Delphi_method\" rel=\"nofollow\">Delphi approach<\/a>; it pertains to all consensus-driven discussions in any field, not just psychometrics.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"h-step-6-evaluate-nbsp-results-and-final-recommendation\">Step 6: Evaluate&nbsp;Results and Final Recommendation<\/h3>\n\n\n\n<p>Evaluate the results from Round 2 as well as Round 1. &nbsp;An example of this is below. &nbsp;What is the recommended cutscore, which is the average or sum of the Angoff ratings depending on the scale you prefer? &nbsp;Did the reliability improve? &nbsp;Estimate the mean and SD of examinee scores (there are several methods for this). What sort of pass rate do you expect? &nbsp;Even better, utilize the <a href=\"https:\/\/assess.com\/beuk-compromise\/\">Beuk Compromise<\/a> as a &#8220;reality check&#8221; between the modified-Angoff approach and actual test data. &nbsp;You should take multiple points of view into account, and the SMEs need to vote on a final recommendation. They, of course, know the material and the candidates so they have the final say. &nbsp;This means that standard setting is a political process; again, reduce that effect as much as you can.<\/p>\n\n\n\n<p>Some organizations do not set the cutscore at the recommended point, but at one standard error of judgment (SEJ) below the recommended point.\u00a0 The SEJ is based on the inter-rater reliability; note that it is NOT the standard error of the mean or the <a href=\"https:\/\/assess.com\/what-is-standard-error-measurement\/\">standard error of measurement<\/a>.\u00a0 Some organizations use the latter; the former is just plain wrong and irrelevant (though I have seen it used by amateurs).<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"916\" height=\"648\" src=\"https:\/\/assess-21e9b.kxcdn.com\/wp-content\/uploads\/2025\/03\/Angoff-analysis-tool.webp\" alt=\"Angoff-analysis-tool\" class=\"wp-image-61920\" title=\"modified angoff\" srcset=\"https:\/\/assess-21e9b.kxcdn.com\/wp-content\/uploads\/2025\/03\/Angoff-analysis-tool.webp 916w, https:\/\/assess-21e9b.kxcdn.com\/wp-content\/uploads\/2025\/03\/Angoff-analysis-tool-300x212.webp 300w, https:\/\/assess-21e9b.kxcdn.com\/wp-content\/uploads\/2025\/03\/Angoff-analysis-tool-768x543.webp 768w\" sizes=\"auto, (max-width: 916px) 100vw, 916px\" \/><\/figure>\n<\/div>\n\n\n<h3 class=\"wp-block-heading\" id=\"h-step-7-write-up-your-report\">Step 7: Write Up Your Report<\/h3>\n\n\n\n<p>Validity refers to evidence gathered to support test score interpretations. &nbsp;Well, you have lots of relevant evidence here. Document it. &nbsp;If your test gets challenged, you&#8217;ll have all this in place. &nbsp;On the other hand, if you just picked 70% as your cutscore because it was a nice round number, you could be in trouble.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-additional-topics\">Additional Topics<\/h2>\n\n\n\n<p>In some situations, there are more issues to worry about. &nbsp;Multiple forms? &nbsp;You&#8217;ll need to equate in some way. &nbsp;Using item response theory? &nbsp;You&#8217;ll have to convert the cutscore from the modified-Angoff method onto the theta metric using the <a href=\"https:\/\/assess.com\/what-is-the-test-response-function-in-irt\/\">Test Response Function<\/a> (TRF). &nbsp;New credential and no data available? That&#8217;s a real chicken-and-egg problem there.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-where-do-i-go-from-here\">Where Do I Go From Here?<\/h2>\n\n\n\n<p>Ready to take the next step and actually apply the modified-Angoff process to improving your exams?&nbsp; Sign up for a free account in our <em><a href=\"https:\/\/assess.com\/fasttest\/\">FastTest item banker<\/a><\/em>. You can also download our <a href=\"https:\/\/assess.com\/angoff-analysis-tool\/\">Angoff analysis tool<\/a> for free.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-references\">References<\/h2>\n\n\n\n<p>Shrout, P. E., &amp; Fleiss, J. L. (1979). Intraclass correlations: uses in assessing rater reliability.&nbsp;<i>Psychological bulletin<\/i>,&nbsp;<i>86<\/i>(2), 420.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The modified-Angoff method is one of the most common ways to set a defensible cutscore on an exam, especially in Certification.\u00a0A panel of experts reviews the items on a test and sets the cutscore based on difficulty and the intended population. It therefore means that the pass\/fail decisions made by the test are more meaningful &#8230; <a title=\"Modified-Angoff Method: Guide to a Defensible Cutscore\" class=\"read-more\" href=\"https:\/\/assess.com\/modified-angoff-method\/\" aria-label=\"Read more about Modified-Angoff Method: Guide to a Defensible Cutscore\">Read more<\/a><\/p>\n","protected":false},"author":2,"featured_media":40576,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[31,23,25],"tags":[34],"class_list":["post-25449","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-credentialing","category-psychometrics","category-test-development","tag-test-development"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v27.4 (Yoast SEO v27.4) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>How Do I Conduct a Modified-Angoff Study? - Assessment Systems<\/title>\n<meta name=\"description\" content=\"Modified-Angoff is the most commonly used method for setting defensible cutscores on certification and licensure exams. Here are instructions\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/assess.com\/modified-angoff-method\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Modified-Angoff Method: Guide to a Defensible Cutscore\" \/>\n<meta property=\"og:description\" content=\"Modified-Angoff is the most commonly used method for setting defensible cutscores on certification and licensure exams. Here are instructions\" \/>\n<meta property=\"og:url\" content=\"https:\/\/assess.com\/modified-angoff-method\/\" \/>\n<meta property=\"og:site_name\" content=\"Assessment Systems\" \/>\n<meta property=\"article:published_time\" content=\"2024-05-30T05:56:17+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-01-01T07:29:26+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/assess-21e9b.kxcdn.com\/wp-content\/uploads\/2025\/01\/ai_assessment.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"1200\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/webp\" \/>\n<meta name=\"author\" content=\"Nathan Thompson\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Nathan Thompson\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"7 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/assess.com\\\/modified-angoff-method\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/assess.com\\\/modified-angoff-method\\\/\"},\"author\":{\"name\":\"Nathan Thompson\",\"@id\":\"https:\\\/\\\/assess.com\\\/#\\\/schema\\\/person\\\/cc6c0bba1f9d13a94a73d899282bce54\"},\"headline\":\"Modified-Angoff Method: Guide to a Defensible Cutscore\",\"datePublished\":\"2024-05-30T05:56:17+00:00\",\"dateModified\":\"2026-01-01T07:29:26+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/assess.com\\\/modified-angoff-method\\\/\"},\"wordCount\":1514,\"publisher\":{\"@id\":\"https:\\\/\\\/assess.com\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/assess.com\\\/modified-angoff-method\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/assess.com\\\/wp-content\\\/uploads\\\/2022\\\/04\\\/Beuk.bmp\",\"keywords\":[\"test development\"],\"articleSection\":[\"Credentialing\",\"Psychometrics\",\"Test Development\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/assess.com\\\/modified-angoff-method\\\/\",\"url\":\"https:\\\/\\\/assess.com\\\/modified-angoff-method\\\/\",\"name\":\"How Do I Conduct a Modified-Angoff Study? - Assessment Systems\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/assess.com\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/assess.com\\\/modified-angoff-method\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/assess.com\\\/modified-angoff-method\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/assess.com\\\/wp-content\\\/uploads\\\/2022\\\/04\\\/Beuk.bmp\",\"datePublished\":\"2024-05-30T05:56:17+00:00\",\"dateModified\":\"2026-01-01T07:29:26+00:00\",\"description\":\"Modified-Angoff is the most commonly used method for setting defensible cutscores on certification and licensure exams. Here are instructions\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/assess.com\\\/modified-angoff-method\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/assess.com\\\/modified-angoff-method\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/assess.com\\\/modified-angoff-method\\\/#primaryimage\",\"url\":\"https:\\\/\\\/assess.com\\\/wp-content\\\/uploads\\\/2022\\\/04\\\/Beuk.bmp\",\"contentUrl\":\"https:\\\/\\\/assess.com\\\/wp-content\\\/uploads\\\/2022\\\/04\\\/Beuk.bmp\",\"width\":485,\"height\":292,\"caption\":\"modified-Angoff Beuk compromise\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/assess.com\\\/modified-angoff-method\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/assess.com\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Modified-Angoff Method: Guide to a Defensible Cutscore\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/assess.com\\\/#website\",\"url\":\"https:\\\/\\\/assess.com\\\/\",\"name\":\"Assessment Systems\",\"description\":\"Smarter Online Testing &amp; Psychometrics\",\"publisher\":{\"@id\":\"https:\\\/\\\/assess.com\\\/#organization\"},\"alternateName\":\"ASC\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/assess.com\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/assess.com\\\/#organization\",\"name\":\"Assessment Systems\",\"alternateName\":\"AssessmentSystems\",\"url\":\"https:\\\/\\\/assess.com\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/assess.com\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/assess.com\\\/wp-content\\\/uploads\\\/2024\\\/10\\\/cropped-Assessment-Systems_logo_white-min.webp\",\"contentUrl\":\"https:\\\/\\\/assess.com\\\/wp-content\\\/uploads\\\/2024\\\/10\\\/cropped-Assessment-Systems_logo_white-min.webp\",\"width\":500,\"height\":128,\"caption\":\"Assessment Systems\"},\"image\":{\"@id\":\"https:\\\/\\\/assess.com\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.linkedin.com\\\/company\\\/assessment-systems-corporation\\\/\"],\"description\":\"Assessment Systems is dedicated to improving career and education opportunities by empowering organizations to build smarter, more accurate assessments\",\"email\":\"solutions@assess.com\",\"legalName\":\"Assessment Systems Corporation\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/assess.com\\\/#\\\/schema\\\/person\\\/cc6c0bba1f9d13a94a73d899282bce54\",\"name\":\"Nathan Thompson\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/10395989d11cca01d6130ffb613398b0bd0d3719897b4e78c3f5e54fccda53f4?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/10395989d11cca01d6130ffb613398b0bd0d3719897b4e78c3f5e54fccda53f4?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/10395989d11cca01d6130ffb613398b0bd0d3719897b4e78c3f5e54fccda53f4?s=96&d=mm&r=g\",\"caption\":\"Nathan Thompson\"},\"description\":\"Nathan Thompson earned his PhD in Psychometrics from the University of Minnesota, with a focus on computerized adaptive testing. His undergraduate degree was from Luther College with a triple major of Mathematics, Psychology, and Latin. He is primarily interested in the use of AI and software automation to augment and replace the work done by psychometricians, which has provided extensive experience in software design and programming. Dr. Thompson has published over 100 journal articles and conference presentations, but his favorite remains https:\\\/\\\/scholarworks.umass.edu\\\/pare\\\/vol16\\\/iss1\\\/1\\\/ .\",\"sameAs\":[\"https:\\\/\\\/www.linkedin.com\\\/in\\\/nathanthompsonasc\\\/\",\"https:\\\/\\\/www.youtube.com\\\/ascpsychometrics\"],\"url\":\"https:\\\/\\\/assess.com\\\/author\\\/nathan\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"How Do I Conduct a Modified-Angoff Study? - Assessment Systems","description":"Modified-Angoff is the most commonly used method for setting defensible cutscores on certification and licensure exams. Here are instructions","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/assess.com\/modified-angoff-method\/","og_locale":"en_US","og_type":"article","og_title":"Modified-Angoff Method: Guide to a Defensible Cutscore","og_description":"Modified-Angoff is the most commonly used method for setting defensible cutscores on certification and licensure exams. Here are instructions","og_url":"https:\/\/assess.com\/modified-angoff-method\/","og_site_name":"Assessment Systems","article_published_time":"2024-05-30T05:56:17+00:00","article_modified_time":"2026-01-01T07:29:26+00:00","og_image":[{"width":1200,"height":1200,"url":"https:\/\/assess-21e9b.kxcdn.com\/wp-content\/uploads\/2025\/01\/ai_assessment.webp","type":"image\/webp"}],"author":"Nathan Thompson","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Nathan Thompson","Est. reading time":"7 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/assess.com\/modified-angoff-method\/#article","isPartOf":{"@id":"https:\/\/assess.com\/modified-angoff-method\/"},"author":{"name":"Nathan Thompson","@id":"https:\/\/assess.com\/#\/schema\/person\/cc6c0bba1f9d13a94a73d899282bce54"},"headline":"Modified-Angoff Method: Guide to a Defensible Cutscore","datePublished":"2024-05-30T05:56:17+00:00","dateModified":"2026-01-01T07:29:26+00:00","mainEntityOfPage":{"@id":"https:\/\/assess.com\/modified-angoff-method\/"},"wordCount":1514,"publisher":{"@id":"https:\/\/assess.com\/#organization"},"image":{"@id":"https:\/\/assess.com\/modified-angoff-method\/#primaryimage"},"thumbnailUrl":"https:\/\/assess.com\/wp-content\/uploads\/2022\/04\/Beuk.bmp","keywords":["test development"],"articleSection":["Credentialing","Psychometrics","Test Development"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/assess.com\/modified-angoff-method\/","url":"https:\/\/assess.com\/modified-angoff-method\/","name":"How Do I Conduct a Modified-Angoff Study? - Assessment Systems","isPartOf":{"@id":"https:\/\/assess.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/assess.com\/modified-angoff-method\/#primaryimage"},"image":{"@id":"https:\/\/assess.com\/modified-angoff-method\/#primaryimage"},"thumbnailUrl":"https:\/\/assess.com\/wp-content\/uploads\/2022\/04\/Beuk.bmp","datePublished":"2024-05-30T05:56:17+00:00","dateModified":"2026-01-01T07:29:26+00:00","description":"Modified-Angoff is the most commonly used method for setting defensible cutscores on certification and licensure exams. Here are instructions","breadcrumb":{"@id":"https:\/\/assess.com\/modified-angoff-method\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/assess.com\/modified-angoff-method\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/assess.com\/modified-angoff-method\/#primaryimage","url":"https:\/\/assess.com\/wp-content\/uploads\/2022\/04\/Beuk.bmp","contentUrl":"https:\/\/assess.com\/wp-content\/uploads\/2022\/04\/Beuk.bmp","width":485,"height":292,"caption":"modified-Angoff Beuk compromise"},{"@type":"BreadcrumbList","@id":"https:\/\/assess.com\/modified-angoff-method\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/assess.com\/"},{"@type":"ListItem","position":2,"name":"Modified-Angoff Method: Guide to a Defensible Cutscore"}]},{"@type":"WebSite","@id":"https:\/\/assess.com\/#website","url":"https:\/\/assess.com\/","name":"Assessment Systems","description":"Smarter Online Testing &amp; Psychometrics","publisher":{"@id":"https:\/\/assess.com\/#organization"},"alternateName":"ASC","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/assess.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/assess.com\/#organization","name":"Assessment Systems","alternateName":"AssessmentSystems","url":"https:\/\/assess.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/assess.com\/#\/schema\/logo\/image\/","url":"https:\/\/assess-21e9b.kxcdn.com\/wp-content\/uploads\/2024\/10\/cropped-Assessment-Systems_logo_white-min.webp","contentUrl":"https:\/\/assess-21e9b.kxcdn.com\/wp-content\/uploads\/2024\/10\/cropped-Assessment-Systems_logo_white-min.webp","width":500,"height":128,"caption":"Assessment Systems"},"image":{"@id":"https:\/\/assess.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.linkedin.com\/company\/assessment-systems-corporation\/"],"description":"Assessment Systems is dedicated to improving career and education opportunities by empowering organizations to build smarter, more accurate assessments","email":"solutions@assess.com","legalName":"Assessment Systems Corporation"},{"@type":"Person","@id":"https:\/\/assess.com\/#\/schema\/person\/cc6c0bba1f9d13a94a73d899282bce54","name":"Nathan Thompson","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/10395989d11cca01d6130ffb613398b0bd0d3719897b4e78c3f5e54fccda53f4?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/10395989d11cca01d6130ffb613398b0bd0d3719897b4e78c3f5e54fccda53f4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/10395989d11cca01d6130ffb613398b0bd0d3719897b4e78c3f5e54fccda53f4?s=96&d=mm&r=g","caption":"Nathan Thompson"},"description":"Nathan Thompson earned his PhD in Psychometrics from the University of Minnesota, with a focus on computerized adaptive testing. His undergraduate degree was from Luther College with a triple major of Mathematics, Psychology, and Latin. He is primarily interested in the use of AI and software automation to augment and replace the work done by psychometricians, which has provided extensive experience in software design and programming. Dr. Thompson has published over 100 journal articles and conference presentations, but his favorite remains https:\/\/scholarworks.umass.edu\/pare\/vol16\/iss1\/1\/ .","sameAs":["https:\/\/www.linkedin.com\/in\/nathanthompsonasc\/","https:\/\/www.youtube.com\/ascpsychometrics"],"url":"https:\/\/assess.com\/author\/nathan\/"}]}},"_links":{"self":[{"href":"https:\/\/assess.com\/wp-json\/wp\/v2\/posts\/25449","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/assess.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/assess.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/assess.com\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/assess.com\/wp-json\/wp\/v2\/comments?post=25449"}],"version-history":[{"count":5,"href":"https:\/\/assess.com\/wp-json\/wp\/v2\/posts\/25449\/revisions"}],"predecessor-version":[{"id":65376,"href":"https:\/\/assess.com\/wp-json\/wp\/v2\/posts\/25449\/revisions\/65376"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/assess.com\/wp-json\/wp\/v2\/media\/40576"}],"wp:attachment":[{"href":"https:\/\/assess.com\/wp-json\/wp\/v2\/media?parent=25449"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/assess.com\/wp-json\/wp\/v2\/categories?post=25449"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/assess.com\/wp-json\/wp\/v2\/tags?post=25449"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}