Monday, June 29, 2020

A Look at DESE's Cited Sources: Results of a Critical Look at the Initial Reopening Guidance References

Note: I've been doing a lot more work around education safety lately, but moved it away from this blog. I founded Massachusetts Education Safety Advocacy Group (MESAG) and you can find up-to-date research on the website, Twitter, and Facebook. Please follow, like, and share!

I read and analyzed all of the sources cited in the DESE document released 6/25. You can see my write-ups of all of the sources here.

Here's what I found:

The report has 84 citations of 53 unique sources:
  • 8 of the 53 sources are public-facing CDC web pages
  • 2 of the 53 sources are state school reopening plans (California and Oregon)
  • 4 of the 53 sources are from government sources in non-USA countries. The reports are from Australia, Denmark, France, and Hong Kong.
  • 2 of the 53 sources are WHO (World Health Organization) web pages.
  • 1 of the 53 sources is a public-facing guidance document from a Toronto Children's Hospital
  • 3 of the 53 sources are Massachusetts public-facing state web pages.
  • 4 of the 53 sources are news articles
  • 18 of the 53 sources are peer-reviewed scientific journal articles.
  • 5 of the 53 sources are pre-print (not yet peer reviewed) scientific journal manuscripts
  • 6 of the 53 sources were scientific journal articles/manuscripts for which peer review status was unclear
Many of the studies cited have an extremely small sample size.
  • This study looked at 13 family clusters in Israel.
  • This study looked at 39 households in Switzerland. 
  • This study looked at 11 people, only one child, in the French Alps.
  • This study looked at 18 COVID-19 cases in schools in New South Wales, Australia.
  • This study focused on 6 COVID-19 cases in schools in Ireland.
Several locations where studies took place or for which guidelines were written have much lower COVID-19 infection rates than Massachusetts.
  • Oregon's infection rate per 100,000 people is over 9 times lower than that of Massachusetts.
  • California's infection rate per 100,000 people is less than half of that of Massachusetts.
  • France's infection rate per 100,000 is over 6 times lower than Massachusetts.
  • New South Wales, Australia's infection rate per 100,000 is over 37 times lower than that of Massachusetts.
Additionally, some of the sources did not prove the claim that DESE attempted to make with them. Of 81 claims made: 
  • 7 are not supported by the source cited
  • 59 claims are supported by the source cited
  • 4 claims have partial support
  • 1 claim is somewhat supported
  • 4 claims have limited support 
  • 4 claims have extremely limited support
Here are some of the unsupported claims (all quotes from DESE guidance):
  • "In NYC, in households with at least one COVID-19 case, prevalence of infection for children 5-≤18 was 31.9% vs. overall prevalence 52.5%."
  • "Whereas for COVID-19 it appears children are less likely to be infected with and to transmit COVID-19, this is not the case for influenza, where children are frequent transmitters."
  • "As noted in previous guidance, temperature checks are not recommended as screening for all students due to the high likelihood of potential false positive and false negative results"
  • "Finally, this guidance is for fall reopening and is predicated on the Commonwealth continuing to progress through the phases of reopening with low COVID-19 public health metrics"
  • "Mask breaks should occur throughout the day."
  • Schools do not appear to have played a major role in COVID-19 transmission. In a review of COVID clusters, only 4% (8 of 210) involved school transmission."
  •  "If infected, it appears children may be less likely to infect others with COVID-19."
It appears that DESE cherry-picked data that supported a return to school, rather than looking critically at all available evidence to make a science-based decision about school safety. Inconsistencies in the report, such as inconsistent citation formatting and claims which do not align with the geographical facts of a study, raise concern as to the accuracy of the report. Additionally, the fact that none of the medical professionals involved are named raises questions as to why they do not want their work recognized.

The DESE report also leaves out important research on adult COVID-19 infection risk and transmission data. For schools to open for in-person schooling, numerous adults will need to be in school buildings. There was a recent outbreak in a school in North Carolina amongst the staff. To ignore the data on adult transmission when adults must be present for schools to re-open, is irresponsible. I will write a separate post with some studies about COVID-19 in adults, and school-related COVID-19 cases.

I urge you to contact state level education officials to urge them to reconsider this guidance in light of the dangers to school staff safety. 
  • Massachusetts Board of Education: boe@doe.mass.edu
  • Massachusetts Secretary of Education James Peyser: eoe@massmail.state.ma.us
  • Massachusetts Return to School Working Group: RTSWG@mass.gov
  • Massachusetts Governor Charlie Baker contact form or constituent.services@state.ma.us

7 comments:

  1. Thank you for posting about this. When I read the memo, I was immediately taken aback by a lot of the data referenced, and the conclusions that it supposedly supported. I have been working my way through the source material, but your analysis has been very helpful.

    ReplyDelete
  2. This is certainly concerning if it's true, but can you elaborate on why you believe some of the claims to be unsupported? I checked on the first one and found the exact numbers in the quote listed in Table 2 of the paper: pg. 17 https://watermark.silverchair.com/ciaa549.pdf?token=AQECAHi208BE49Ooan9kkhW_Ercy7Dm3ZL_9Cf3qfKAc485ysgAAApwwggKYBgkqhkiG9w0BBwagggKJMIIChQIBADCCAn4GCSqGSIb3DQEHATAeBglghkgBZQMEAS4wEQQMGJRWtaAqGZ_UIgbJAgEQgIICT8cLli5eyz0k2YAMrpFstuy-0mwV_Vks42XezXSZd1gzXPXnEvJSK2AqiwCzJrJ2Kn-cdkVsjufqCktEhC89SKbZIfQmkfU8vIjSJRDoj5JGWmeu_R5xPr89ibQRr3LUcECbK9CHDbFMP4l2pkK-y3nKYJ_DlkMIlQ6TmwLG_KVuUSciiGApa4A9MMCX2TPk6owQkPyCjbVQpB5LSkIeFM1_tmJcle-nI4eZ-4jqv9dc2J-aRctSR2A4T6KtnvoSobAIIWXxKZufyreA4yywYqSzLIKjHRNjQ8BTGuhFF4hBtpHm0DdPJlKIq5ALk1PXwohmSdvomtHhDALznZXzuZLqHirpAtfCf-xwmkPm2nqqE9Eo0lYD7Qjo1Ld9AE1l72__QF1hH_tHIFVFFcs5izM9BZeMI0Na0jyR6yZJgtZzhXHTf8UmASbWvJLzSrfFI7JcoTA9WaGYCqtFQyff-Cs6FsR3bgU2eEIEi2fN-xJZ4P81NlHhd8AgZEt5mdH0QXpVEdgkaZ0EoBX2vlPuNaYGrNZ2vFP9IR-pNF5XXoarrFF2C3gLXAYxaUpN3JCnDAlK9O1u9ydZiPmPO5i1TDF1BMOOLbIZh-CJmxDynQN5v-rzRhMxk6Mc9HW9VuwI1RCt95Ghbbm0xVXUAUMkimdOH09c1d4PiCkb3XO9BUxzV28AZgKtypEl6B-VpJsB1RtzMrKdIs03h6q3AEdBNLPFJGrsVZSFpJioh8cMK11CtucQHuif9W6dZ69uVSMnlPyHRVO7tf6m_1HSw4KIvw

    I can see it being argued that this is not good data because it is a relatively small sample, but unfortunately it seems that at this time we only have data generated from small samples. I really don't know what the right answer to all of this is, but I'm doing my best to understand my biases and properly understand the data that is available to us. It is definitely important to look at and think critically about everything being thrown our way so thank you for opening up this important discussion (and sorry for the horribly long link).

    ReplyDelete
    Replies
    1. Kacy, have you seen the other posts examining each of the citations and the claims they are supposed to support?

      https://teachingmusicmusings.blogspot.com/search/label/DESE%20citations

      Delete
    2. Kacy, the paper's table 2 specifically says the data is New York State EXCLUDING New York City. Therefore, any claim about New York City isn't supported because the data isn't from New York City.

      Delete
    3. Thank you both for the helpful replies.

      Delete
  3. As a middle school teacher, I am torn between teaching from home and being in the classroom. I don't feel comfortable eating indoors at a restaurant, so I don't feel comfortable spending 8 hours in school. At the same time, the rates of infection in MA are WAY DOWN from April. So comparing MA infection rates to France or others using April data is, in my view, less important than using today's. To exaggerate, if August shows no infections or deaths (I can't imagine this will be true), does that mean students and teachers return? I would almost certainly say "yes". But where is the crossover point of arguing to stay home vs. go to school? I don't know.

    ReplyDelete
  4. I don't know if you saw this recent publication (CDC), study of a much-larger group, NYTimes headline: "Older children spread coronavirus just as much as adults, study finds" https://www.nytimes.com/2020/07/18/health/coronavirus-children-schools.html

    ReplyDelete

A Look at DESE's Cited Sources: Results of a Critical Look at the Initial Reopening Guidance References

Note: I've been doing a lot more work around education safety lately, but moved it away from this blog. I founded Massachusetts Educatio...