{"id":144,"date":"2007-08-18T21:37:42","date_gmt":"2007-08-18T21:37:42","guid":{"rendered":"http:\/\/ivyrun.com\/wordpress\/?p=144"},"modified":"2007-08-18T21:37:42","modified_gmt":"2007-08-18T21:37:42","slug":"naep-and-reading-research","status":"publish","type":"post","link":"https:\/\/www.ivyrun.com\/inanotherplace\/?p=144","title":{"rendered":"NAEP and Reading Research"},"content":{"rendered":"

I just finished reading Gerald Bracey<\/a>‘s Reading Educational Research: How to Avoid Getting Statistically Snookered<\/em>.\u00a0 It was an excellent review of my quantitative research class as well as a very real-life application of the information from that class.\u00a0\u00a0 Bracey spends several pages discussing the National Assessment of Educational Progress, or NAEP.\u00a0 This test, which began in the late 1960s, was designed to be a national descriptive assessment.\u00a0\u00a0 However, Bracey points out that in 1988, Congress changed the law under which NAEP is administered to allow state comparisons and established a governing board, whose first president, added achievement levels to the test.\u00a0 The test became a prescriptive assessment.\u00a0 According to Bracey, “the achievement levels–basic, proficient, and advanced–were set ludicrously high and led to demeaning statements about the competence of students and, by implication, the competence of teachers and the quality of schools” (p. 149).\u00a0 Many groups have suggested that the achievement levels are “fundamentally” flawed.\u00a0 The problem, Bracey says, is with the word “proficient.”\u00a0 This word differs from state to state.\u00a0 But some folks, including Diane Ravitch (whose new book is on my shelf), would like to see a national definition and believe NAEP would be the perfect vehicle for getting at that definition, something Bracey says would be a disaster.<\/p>\n

After I closed up Bracey, I reached for this week’s Education Week.\u00a0 There on the front was a note about the recent results of the NAEP Economics test.<\/a>\u00a0 The headline indicated that the results were better than expected and the article inside indicated that the results showed that students had a pretty good understanding of the basics of economics.\u00a0 They only ran into trouble with the details such as concepts like interest rates, gross domestic product, or the role of the Federal Reserve.\u00a0 After reading Bracey, I had to wonder how many of the students taking the test had had direct instruction in these concepts.\u00a0 According to the Education Week article, “87 percent of test-takers said they had received some kind of exposure to economics content during high school.\u00a0 Sixteen percent reported they had taken advanced economics; the greatest proportion, 49 percent, said they had taken general economics, 11 percent said they had taken a business or personal finance class; 12 percent said they had been enrolled in some kind of combined economics course; and 13 percent said they had not taken any economics course.” \u00a0 The article goes on to quote a federal transcript study that showed that 66 percent of high school graduates had taken an economics class in 2005.\u00a0 So, this really is an example of an invalid test, since it is testing material to which the students may or may not have been exposed.<\/p>\n

The article quotes Darvin M. Winick, the chairman of the NAEP Governing Board, who helps perpetuate the idea that our schools are failing.\u00a0 He says, “While there is clear room for improvement, the results are not discouraging.\u00a0 Given the number of students who finish high school with a limited vocabulary, not reading well, and weak in math, the results may be as good as or better than we should expect.”\u00a0 OUCH!\u00a0 There’s finally some good news about education, and this guy manages to turn it into an insult.<\/p>\n

The issue of Education Week also has a general article about using NAEP as a way of comparing the states.\u00a0 The fundamental problem for now seems to be that there needs to be more information about “exclusion rates,” that is the number of students that each state keeps from taking the test or to whom they provide special help or accommodations.\u00a0 This information, according to the article, will be more visible in future NAEP reports.\u00a0 And, the governing board will press for nation-wide inclusion policies for the exams scheduled in 2009.<\/p>\n

One other criticism that Bracey has of NAEP that I think is particularly important is how meaningless the test is to students.\u00a0 Since they are not held accountable for the test results since they can’t be traced to an individual student,\u00a0 getting kids to take the test seriously is a problem.\u00a0 Bracey quotes Archie Lapointe,\u00a0 a former executive director of NAEP: “Yes, the problem with NAEP is keeping students awake during the test” (p. 147).<\/p>\n

The National Center for Educational Statistics has a NAEP website <\/a>that has lots of information about the history of the test. \u00a0 And, here’s a Bracey post<\/a> from February 2007 about NAEP testing.\u00a0 I added his blog to my aggregator!\u00a0 I LOVE it when people like him use weblogs to comment on contemporary education issues.<\/p>\n","protected":false},"excerpt":{"rendered":"

I just finished reading Gerald Bracey‘s Reading Educational Research: How to Avoid Getting Statistically Snookered.\u00a0 It was an excellent review of my quantitative research class as well as a very real-life application of the information from that class.\u00a0\u00a0 Bracey spends several pages discussing the National Assessment of Educational Progress, or NAEP.\u00a0 This test, which began … Continue reading NAEP and Reading Research<\/span> →<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[51],"tags":[],"class_list":["post-144","post","type-post","status-publish","format-standard","hentry","category-testing"],"jetpack_shortlink":"https:\/\/wp.me\/p4X3L0-2k","jetpack_sharing_enabled":true,"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/www.ivyrun.com\/inanotherplace\/index.php?rest_route=\/wp\/v2\/posts\/144","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ivyrun.com\/inanotherplace\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ivyrun.com\/inanotherplace\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ivyrun.com\/inanotherplace\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ivyrun.com\/inanotherplace\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=144"}],"version-history":[{"count":0,"href":"https:\/\/www.ivyrun.com\/inanotherplace\/index.php?rest_route=\/wp\/v2\/posts\/144\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.ivyrun.com\/inanotherplace\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=144"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ivyrun.com\/inanotherplace\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=144"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ivyrun.com\/inanotherplace\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=144"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}