Use of immunology in news and YouTube videos in the context of COVID-19: politicisation and information bubbles

Article type: Research Article

Keywords: COVID-19, YouTube, news, science communication, scientific journalism, health information

Authors: Rachel Surrage George, Hannah Goodey, Maria Antonietta Russo, Rovena Tula, Pietro Ghezzi

Affiliations: Brighton and Sussex Medical School, Brighton, United Kingdom; Department of Biomolecular Sciences, University of Urbino, Urbino, Italy

License: Copyright © 2024 George, Goodey, Russo, Tula and Ghezzi. CC BY 4.0 This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

Article links: DOI: 10.3389/fpubh.2024.1327704  |  PubMed: 38435297  |  PMC: PMC10906096

Relevance: Moderate: mentioned 3+ times in text

Full text: PDF (1.5 MB)

Introduction

The COVID-19 pandemic engendered a significant amount of new media coverage. A study of online news sources reported that, in the period between January and October 2020, the pandemic represented roughly 25% of new articles in most countries including Italy, the United Kingdom and the United States (ref. 1). While communicating health-related matters is always challenging, it was particularly difficult to articulate the uncertainty around COVID-19 prevention and treatment, as well as the often changing guidelines from the WHO and local health authorities (ref. 2–5). This proved fertile ground for misinformation and disinformation, including the development of conspiracy theories, and many studies have addressed this so-called “infodemic,” analysing news, video content and social media (ref. 6).

Anxiety in general (ref. 7) and, more specifically, inability to cope with uncertainty, increases susceptibility to conspiratorial thinking and misinformation (ref. 8, ref. 9). This may have consequences, as harbouring conspiratorial beliefs decreases adherence to health authority guidelines, including the uptake of vaccines (ref. 10, ref. 11).

Most governments claimed that they “followed the science” when making public health decisions (ref. 12–14), and as such concepts like “herd immunity,” (ref. 13) often explained by experts (ref. 15) in the mass media, responded to the public “need for orientation”(ref. 16). The quality of scientific communication varied greatly: one study of German news reported that experts used by the media had higher reputations and expertise in the field (ref. 15), while others found a disconnect between the presence of experts in the news in multiple countries, including the United States, and their track record of publication (ref. 17); some even noting a “convergence of science journalism and self-communication of scientists” (ref. 18).

A well-studied characteristic of the media environment during the pandemic is the high degree of politicisation of various non-pharmacological measures adopted, such as lockdowns, social distancing and face masks, as well as of pharmacological interventions, both preventative (vaccines) and potentially therapeutic (ivermectin and hydroxychloroquine, in particular). This was associated with the spread of misinformation, even around vaccines that had undergone clinical trials according to standard evidenced-based procedures, that may have resulted in a decrease in vaccination rate (ref. 19, ref. 20). The politicisation of the COVID-19 pandemic affected the mass media and Leidecker-Sandmann reported that, in German news, political actors were mentioned more frequently than scientists, something that was not observed in previous pandemics (ref. 15). Science was itself not exempt from politicisation either, with Bozeman arguing that “hyper-politicization of science” affected use (and misuse) of scientific and technical information (ref. 12).

Polarisation of scientific issues in the media, such as in the case of biological evolution, can influence the choice of expert by news media (ref. 21). Journalists can use experts not only to help interpret or explain difficult scientific concepts but also to support their pre-constructed narrative; in the latter case experts are used to provide what Albaek defined “compensatory legitimation” (ref. 22) to increase the credibility of their content.

Likewise, scientific concepts could be twisted, mis-interpreted and “used” to support a particular view of a public health issue, such as the COVID-19 pandemic. The aim of this project was to study the use of nine scientific concepts, listed in Table 1, related to immunology or immunopathogenesis that were discussed in the media in the context of the COVID-19 pandemic.

To investigate whether these were used to support specific narratives around vaccines and non-pharmaceutical interventions, we studied whether their mention correlated with a negative stance towards these interventions and if they were associated with politicisation of the discourse.

The study used a sample of US and Italian news articles obtained from the database MediaCloud (*), and YouTube videos in English or Italian. The results suggest that while some concepts were “neutral,” others were more present in “information bubbles,” often with a high degree of politicisation.

Methods

Database search

Search queries are described in the supplementary material (Supplementary Table S1) and were limited to the period 11/09/2019 and 11/09/2022. News articles were searched and downloaded from MediaCloud¹ using the geographical collections “United States – National,” “Italy-National” and “Italy – State & Local.” The results were downloaded to a spreadsheet along with their metadata (e.g., date, URL, title, media name). Then, their order was randomised using the RAND function in Excel and 25 results (or fewer, when those were < 25) for each search term were combined into a single spreadsheet.

Video links from the platform YouTube were downloaded with the software Mozdeh² using an Application Programming Interface and the search queries described. Results were combined as described above, randomised, and a sample of 200 videos was obtained.

Videos and news articles were then analysed for the following features: (1) mention of the nine immunological concepts; (2) mention of vaccines or non-pharmacological interventions (NPIs: face masks, lockdown, social distancing) and stance (negative, positive or neutral), as well as a range of political and aesthetic signifiers.

Analysis of news and video

In coding news articles and videos for their stance on guidelines and vaccines, we considered a negative stance one which would go against the national guidelines. We decided to consider neutral those videos/news that had a negative view on mandatory vaccination but not a negative stance on vaccines, because making vaccinations mandatory or not is part of the implementation of national vaccination strategies and was followed only by some countries. We coded as “anergy/immunoparalysis” videos that stated that COVID-19 vaccination increased susceptibility to infection at later time points.

While Italian videos were all from Italy (none were from Switzerland) those in English were from different geographical locations (the main ones being: United States, 53%, United Kingdom, 9%; Canada, 9%; India, 8% South Africa, 3%; Pakistan, 3%). MediaCloud is a curated database and we specifically searched for news outlets from the United States or Italy.

Statistical analysis

Correlation of the mention of immunological concepts and a negative stance on different interventions was calculated using a two-tailed, nonparametric Spearman correlation using GraphPad Prism. Results are reported as a correlation matrix showing the Spearman r and interpreted as follows: r is near ±1, perfect correlation; r between ±0.50 and ± 1, strong correlation; r between ±0.30 and ± 0.49, medium correlation; r below ±0.29, low degree of correlation.

As the assessment on the stance (negative, positive or neutral) on vaccines and NPIs is subjective, a sample of news/videos was analysed by two raters to calculate the percentage agreement and weighted Cohen’s kappa using GraphPad prism. Inter-rater reliability was: US news (n = 29, raters HG, PG), 88% agreement, kappa = 0.814; Video in English (n = 30, raters RSG, HG) 79% agreement, kappa = 0.769; Italian news (n = 28, raters MAR, RT), 93% agreement, kappa = 0.880; Italian videos (n = 24, raters MAR, RT), 85% agreement, kappa = 0.821. An interpretation of Cohen’s kappa is: Kappa <0, no agreement; 0.00–0.20, slight agreement; 0.21–0.40, fair agreement; 0.41–0.60, moderate agreement; 0.61–0.80, substantial agreement; 0.81–1.00, almost perfect agreement (ref. 38).

Results

Immunological concepts in media

Table 2 shows the number of hits returned by a search for each of the immunological concepts using the search strategy described in the Methods section (Please note, Table 2 shows only number of hits returned by a search for the keywords as described in the methods and some of these videos or news may not actually mention that specific concept). In the whole MediaCloud database for US news there was a very high number of articles on “herd immunity,” followed by “cytokine storm,” while in the Italian news the distribution was more spread, with “ADE” being the second most frequent concept both in news articles and in videos. Of note, some concepts had few mentions, with some not reaching our target of 25 media for each search to include in the analysis. In the videos returned from a search on YouTube, “immunity debt” was almost absent in Italian, where “herd immunity” was the most frequent concept, while in English-language videos it reached a significant number. It should be noted that not all the articles returned from a search on a specific immunological concept actually mentioned it, and this was even more of an issue with video where it is possible that the search within YouTube returned a video where the search term was only present in some of the comments.

Prevalence of anti-guideline information

As shown in Table 3, there was a significantly higher prevalence of vaccine-negative information in video than in the news (8-fold in English-language, 6-fold in Italian), where videos negative about vaccines were more numerous than those negative about any NPIs considered. Videos in English had a significantly higher proportion of vaccine-negative information compared to US news (18% vs. 0.9%, p > 0.0001 by Chi-square test); Italian videos had a significantly higher proportion of vaccine-negative information compared to Italian news (25% vs. 4%, p < 0001 by Chi-square test) or to videos in English (25% vs. 8%, p < 0001 by Chi-square test).

This was not observed with the stance on various NPIs (a mask-negative stance was slightly more frequent in Italian videos than news but the difference, p = 0.02, was not statistically significant after correcting for multiple comparisons). Overall, the prevalence of vaccine-negative videos was three-times higher in Italian than in English.

Number of views had a large variability among the videos analysed and there was no significant difference between guideline-negative videos and the remaining ones. In English, video views were (mean ± SD): guideline-negative, 12,535 ± 32,165 (n = 24); other videos 38,573 ± 141,664 (n = 201). In Italian: guideline-negative 9,558 ± 20,151 (n = 44); other videos 13,303 ± 40,240 (n = 139).

Pattern of mention of anti-guideline information, immunological concepts and “information bubbles”

Another aspect of health misinformation is the “rabbit hole” effect, where interest in unconventional views/media leads to ever more extreme algorithmic recommendations, something which has been observed during COVID-19. We thus looked at whether a negative stance for one intervention was associated with a negative stance towards other interventions. As shown in Figure 1, although most sources had a negative stance for only one intervention, some of them had a negative stance for multiple interventions, and this was particularly evident in US news, where 55% had a negative stance on multiple interventions.

We then explored whether specific scientific concepts were preferentially associated with specific narratives against some interventions, and if a negative view on one intervention was associated with a negative view on another intervention, as suggested by the results shown in Figure 1.

To do this, we looked at the correlation between mention of immunological concepts and negative view of different intervention by calculating the Spearman’s correlation coefficient and visualising the data as a correlation matrix, as shown in Figure 2.

The analysis confirms what was discussed earlier: that in many news/videos, a negative stance for one health intervention was associated with a negative stance on other interventions (note the clusters of correlation on the bottom right of the correlation matrices).

When we look at the association between mention of specific immunological concepts and guideline-negative stances, we found the following (using a Spearman’s r arbitrary cut-off of 0.3): (1) Immunity debt was associated with negative views of social distancing (news-US); (2) Viral interference was associated with negative views of social distancing (video-Italian) and of masks (news-US, video-Italian); (3) Lymphocyte exhaustion/anergy was associated with negative views of vaccines (video-Italian); (4) Original antigenic sin was associated with negative views of vaccines (video-English).

Of the associations identified above, we analysed in depth those related to a vaccine-negative stance. As shown in Figure 3, frequent mentions of exhaustion in YouTube videos in Italian with a negative view on vaccines was 36% compared to 10% in the whole sample; in English, original antigenic sin was mentioned by 26% of the vaccine-negative video compared to 5% in the whole sample.

Political bias

Politics, either mention of a political view or a politician, was present in several of the media analysed. Figure 4 shows the proportion of news/video with at least one anti-guideline stance or with a vaccine-negative stance mentioning politics. Overall, there were no marked differences in the percentage of media mentioning politics (defined as mention of politics or politicians) among the various media, with Italian news being the least politicised (news IT, 7%; news US, 21%; video IT, 17%, video English, 16%). It is clear that, in all media and languages, politics comes up more frequently in anti-guideline and anti-vaccine media by a factor of 3 in video and of 3–5 in news. It should be noted, however, that, despite the difference being statistically significant, the amount of anti-guideline information in news was very low (with only two vaccine-negative news articles in both languages), which caution about drawing generalised conclusions.

We then performed a sub-analysis for the different immunological concepts. Figure 5 shows the political bias in the news mentioning different immunological concepts, where concepts that have an observed presence of politicisation higher than the expected one (their prevalence in the whole sample) lay on the right side of the chart. Of note, this figure also reports the number of news articles in each bar as, in many cases, bars represented very few articles and it is important to avoid over-interpretation of the differences shown.

In the Italian videos, “immunoparalysis/exhaustion/anergy” was significantly polarised while in English-language videos this was the case for “original antigenic sin.” While there was a trend for other concepts being polarised, such as “viral interference,” their small representation in our sample made it impossible to draw any conclusion due to lack of statistical power. “Herd immunity,” one of the most frequently mentioned immunological concepts, did not show any politicisation, except for US news where there was a significant association with politics (14 of 32 articles). Most of these articles (nine) mentioned herd immunity as being potentially achieved with vaccination or (five) describing negatively the initial approach in the United Kingdom and Sweden to achieve herd immunity through infection, at a time where vaccines were not yet available. None of these articles had a negative stance towards vaccination or any of the guidelines.

Further content analysis of videos in English show that within the anti-guideline videos there was a clear bias towards conspiratorial, right-wing ideology, including low government interference, Christian nationalism and evangelical values with 33% espousing those views. Selected quotes from these videos are shown in Supplementary Table S1. This was not observed within the rest of the videos, where 197 of 201 videos had no political bias.

In Italian, 11 of the 29 videos mentioning politics were associated with the political party “Italexit,” mostly by Dr. Frajese, a medical doctor and parliamentary candidate for the party in the 2022 national elections. Italexit advocates the exit of Italy from the European Union and obtained 1.9% of votes in 2022. Unlike videos in English, these video did not have a “libertarian” view but focus on the claim that COVID-19 vaccines are unsafe, and that even the influenza vaccine would increase COVID-19 infections by blocking viral interference, or that the excessive immune stimulation by vaccines would cause immune exhaustion. Transcripts of selected videos are provided in Supplementary Table S2.

Gender of video speakers

In the English language videos, the proportion of male speakers only was higher in the content with at least one anti-guideline stance (71%) than in the total sample (57%), although the difference was not statistically significant (p = 0.19 by a Chi-square test). A similar trend was observed in Italian video, with 67% of male speakers in anti-guideline video and 61% in the whole sample.

Citation of scientific studies

We also investigated whether news articles had a reference (in the form of a citation or a link) to a scientific publication. Not surprisingly, probably because most scientific publications are in English, only 13 news articles in Italian cited a scientific study. In US news, 64 (34%) cited a scientific study. One of the most cited (five times) was a 2020 study on viral interference between rhinovirus and influenza (ref. 39); this study was cited in the context of “viral interference” and only one of the citing news articles had a NPI-negative stance. The second most cited scientific paper (four times) was a study on the potentially negative effect of “immune imprinting” on infection by different SARS-CoV-2 strains (ref. 40); none of the citing news articles had an anti-guideline stance.

Table 4 shows how many of the US news articles mentioning each of the immunological concept cited a scientific study. Because often a news article was not focused on the specific immunological concept, we assessed how many citations were actually related to that immune concept. It can be seen that the concept of “viral interference” was associated with the highest number of on-topic citations (82% of the articles cited a scientific paper), followed by “oxidative stress” with 56%; one of these news described an industry-sponsored conference discussing the possible use of N-acetylcysteine,³ while a second article included a link to the antioxidant effects of cannabinol, although this was not mentioned in the context of COVID-19.⁴

Of the nine news articles with a negative stance on at least one NPI, four cited scientific publications, most of these supporting the concepts that hygiene is ineffective or even be associated with increased susceptibility to infections, including by preventing viral interference (ref. 39, ref. 41–43). One study claimed that fomites may not be important in SARS-CoV-2 transmission (ref. 44), while another study described the potential in vitro antiviral activity of ivermectin (ref. 45).

Only a small proportion of Italian news articles (9 of 190) or Italian videos provided a link or a citation to a scientific article: too few to analyse.

Discussion

Presence of anti-vaccine and anti-guideline information in news articles and videos

Our study indicates that negative views on vaccines and mitigation measures were far more frequent in YouTube videos than in newspaper articles, with the proportion of anti-guideline videos particularly high in Italian content. This is not surprising considering anyone can produce and upload a video – there are no “due impartiality” principles as there are for, for example, UK broadcasters (ref. 46). Despite this, the proportion of anti-guidelines videos in English (11%) found was less than half as many as in other similar studies on scientific misinformation: a 2010 study of 142 videos on H1N1 influenza found 23% misleading (ref. 47), a 2018 study of 101 videos on Zika virus found 23.8% misleading (ref. 48), and a 2015 study on 118 videos on Ebola found 26% misleading (ref. 49). This could be due to the lower numbers analysed by other studies (indicating a strength of our data), but it also points towards a growing understanding of the dangers of online misinformation, and the success (albeit limited) of YouTube’s guidelines over several years to address issues around child safety and various types of harmful or abusive content (ref. 50, ref. 51). Looking at the dates published more closely, however, it seems the most recent efforts, in September 2021, to reduce anti-vaccination content on the platform (ref. 52) has not achieved its goals, at least within our sample of videos (data not shown). Anti-vaccination views were the most prominent of the four anti-guideline criteria, with 12 of the 14 misinformation videos post-YouTube guideline introduction being classed as anti-vaccination, whereas only six of the preceding 10 shared those views. This implies that the September 2021 guidelines alone were not effective in their goal. With regards news articles, the proportion of those with an anti-vaccine stance is similar in English and in Italian, albeit slightly lower in English. This is interesting if we consider that the press in Italy is regulated by a professional board (journalists need to be licenced by the Ordine dei Giornalisti) as are UK journalists (by the Independent Press Standards Organisation). In the US journalism is largely unregulated, in accordance with the First Amendment to the US Constitution and after the Federal Communications Commission, under the Reagan administration, repealed the “Fairness Doctrine” in 1987 (ref. 53).

The higher proportion of anti-vaccine information in Italian (three times that of videos in English; four times in Italian news compared to the US) raises the question of their impact since, as of 14/9/2022 – end date in our search, the share of the population who were fully vaccinated was not lower in Italy (81%) compared to the United Kingdom (75%), Australia (83%) or the United States (68%) (ref. 54).⁵ It is thus possible that the impact of media on the uptake of COVID-19 vaccines is overestimated.

We should also acknowledge that there is an abundant literature on the cultural differences in health communication, reflecting a different traditional media market (ref. 55, ref. 56) and studies on communication of the COVID-19 pandemics have highlighted the different weight given to political actors across different countries (ref. 57). Additionally, there are cultural differences in the information seeking behaviour of the public (ref. 58) and in the susceptibility to misinformation, as shown in the case of COVID-19 (ref. 59). Therefore, the results presented here should be considered as only one of the aspects of the problems associated with health information and science communication in general.

Information bubbles and immunological concepts

The analysis of possible “information bubbles” confirmed, in all type of media analysed, that readers/viewers exposed to information with a negative stance on one public health measure are often exposed to negative stances on other measures, too, which may contribute to the polarisation of these issues – a phenomenon that has been reported by others. While social media and the Internet are often blamed for the formation of information bubbles (ref. 60), this also suggests a contagious transmission from one conspiracy theory to another (ref. 61), described by Meyer as “social spill-over” (ref. 62).

Looking at whether immunological concepts were used to bolster the authority of the anti-guideline videos, it is clear that during the pandemic the global community expanded its vocabulary significantly with new phrases about virology, vaccinology and epidemiology (ref. 63). Within the anti-guideline videos these concepts were used in different ways. Some did not seem to have caught the attention of the YouTubers producing this content: antibody-dependent enhancement, oxidative stress and anergy were not mentioned. Cytokine storm tended to be described and used in an accurate way. Herd immunity was decried as either impossible to achieve or antithetical to a free way of living – a desire not to be a member of a herd. Hygiene hypothesis and immunity debt similarly seemed to trigger culture war-like comments on children being affected long term by lack of natural immunity, or our sanitised, modern way of living (linked to masks, distancing, and especially lockdowns) damaging us far more than a Covid-19 infection would. Our analysis did show that some immunological concepts, particularly those of immune exhaustion/lymphocyte anergy and original antigenic sin/immune imprinting were mis-used in anti-vaccine discourse, however.

Exhaustion, anergy and activation-induced cell death are well-known concepts described in all immunology textbooks and represent mechanisms mainly aimed at preventing autoimmunity, known as central and peripheral tolerance (ref. 64). However, they can also occur when lymphocytes are stimulated over a prolonged period, such as in chronic infection (ref. 65, ref. 66). Promoters of anti-vaccine views often warn that repeated vaccination may cause immune exhaustion so that subsequent boosters would not provide additional protection and would dampen the immune response. This hypothesis is clearly refuted by many studies on the effectiveness of additional COVID-19 vaccine boosters (ref. 67–69), not to mention the efficacy of the many vaccines given to newborns in the first years of life.

Original antigenic sin (also immune imprinting or antigen imprinting) was first postulated in 1960 in relation to influenza (ref. 70) and describes the fact that the most efficient response mounted by the immune system against infections is that against the first variant of a pathogen already encountered in life. The evolutionary reason for this is that, often, conserved antigens are the ones most important for the pathogen (ref. 36). This concept has also been used in anti-vaccine information to minimise the effect of vaccines in the presence of a mutating virus or by claiming that vaccines would increase susceptibility to subsequent mutants. While the original antigenic sin described for COVID-19 and infection with SARS-Cov-2 elicit responses to coronaviruses encountered earlier in life, particularly the seasonal human coronaviruses (HCoVs) that cause common cold (ref. 37, ref. 71), this seems not to impact the efficacy of COVID-19 vaccines and boosters (ref. 72).

Another concept that we found associated with anti-guideline information is that of “immunity debt.” This has been used to support the hypothesis that COVID-19 mitigation measures such as lockdowns and social distancing or the use of face masks cause an increase in later respiratory infections. The popularity of this concept is likely due to the fact that it can be easily understood by the public; nevertheless, there is no mention of it in formal immunology textbooks. To date, it is mentioned in only 15 scientific publications found in PubMed, of which 13 are studies on reviews, editorials, letter, studies of health communication or mathematical models, and three are studies reporting a rise in the incidence of paediatric infections after the main pandemic peak, hypothesising immunity debt as a possible explanation.

Concepts like “oxidative stress” (ref. 25, ref. 73) and “cytokine storm” (ref. 74) are not controversial as they merely represent potential pathogenetic mechanisms, so were often negatively associated with politicisation. Of note, while the role of oxidative stress in COVID-19 remains largely hypothetical, the cytokine storm theory has been successfully applied to the field, with the approval of interleukin-6 inhibitors for COVID-19 (ref. 75).

The use of scientific papers was demonstrated in a similar way across all videos: the power of the phrase “studies have shown” (ref. 76) being used to reinforce points in anti-and pro-guideline content. This highlights the tricky nature of citing scientific research within communications to lay people (ref. 77). Most members of the public would not follow up a claim in a video by searching out and reading the paper cited, but they might feel the claim is more legitimate due to the mention. For example, on Sky News, Rita Panahi cited “a French study” on immunity debt. She was trying to use the research to imply that lockdowns were fundamentally dangerous and damaging to health, especially that of children. The study she was likely referring to [Cohen et al., although she did not mention it specifically (ref. 78)] was far more balanced than her portrayal, however, acknowledging the importance of not overloading the healthcare system, and couching their opinions about the future consequences of a lack of immune stimulation using phrases such as “could have negative consequences” or “greater the likelihood” (ref. 78). This illustrates a trend within misinformation videos to use the equivocal scientific language style as a reason to doubt, or to question scientific evidence (ref. 32). There are rarely absolutes in scientific theory: that is the nature of research, but this can be exploited by those willing to misinterpret data for their own aims (ref. 33).

Political and ideological issues

We found that politicisation (identified in this study as a mention of political issues or politicians) is higher in news/videos purporting anti-vaccine or anti-NPI views. Interestingly, politicisation is over-represented in videos mentioning the two immunological concepts exhaustion/anergy and original antigenic sin, that are also associated with anti-vaccine stances.

The qualitative analysis part of our study confirms the association between far-right political stances and anti-vaccine views that has been reported in many countries (ref. 79–85), although it in Italy an anti-vaccination stance may also be associated with some far-left activists (ref. 86, ref. 87).

In videos in English, it was clear how overtly right wing many of the anti-guideline videos were, compared to the rest. Right ideology including low government interference, small government, social conservatism, rejection of socialism in support of capitalism and neoliberalism, antipathy towards the media and anti-globalism were oft-cited.

There is also power in centring anecdotal evidence within a narrative of scientific language and right-wing ideology, such as seen by Dr. Robert Malone – he combines all three ideas within one sentence: “Talk to the people around you… it’s called immune imprinting…what the government has bought is the perfect vaccine combination to cause this to get even worse.”⁶ With regards to drugs, both approved and experimental, our theory was that ivermectin and hydroxychloroquine, both medications promoted by the far right as effective against Covid, would be regularly mentioned. This was not the case.

We also noted that videos had more often a male communicator than a female and this has also been observed by other studies of science communication on YouTube (ref. 88) Interestingly, we found that this gender difference was even more evident in videos negative about guidelines. Studies in the United States have reported that masculinity is a predictor of lower adherence to the Centers for Disease Control and Prevention (CDC) guidelines for the prevention of COVID-19 (ref. 89, ref. 90). However, the gender bias is not only found at the receiving end (the consumer of information). An experimental study on the gender of scientists mentioned in news articles on COVID-19 vaccines has shown that the presence of a female inventor, either by herself or together with a male inventor, had a negative effect on how safety and efficacy of the vaccine was perceived (ref. 91).

This reflects wider voting patterns between right and left wing choice – men tend to choose right wing politics, and tend to reject health advice (e.g., wearing sun protection, cycle helmets) (ref. 92–94). This even extends to families – having daughters results in parents voting for left wing parties, but having sons reverses this trend (ref. 95). It also highlights a growing antipathy towards feminist values within right wing ideology (ref. 26, ref. 96), with openly chauvinist groups growing in public prominence, and Christian fundamentalist nationalism emerging as a powerful wing of mainstream US politics (ref. 97). The language of religion is even combined with the immunological concepts in several videos, as the presenters mock the vaccination programme: “It’s called original antigenic sin, which is just kind of really, wow, yeah, the scientists aren’t, you know, completely illiterate about matters of faith.” (Vaccine Information for Catholics with Pam Acker, United States).⁷

Conclusion

This study shows it is clear that some YouTubers are using immunological concepts to further their anti-guideline agendas and make themselves appear more knowledgeable and authoritative, however these concepts are very selective and limited, dependent on their interpretability by lay viewers. The significance of this is that it shows the usefulness of certain immunological terms as a way to distinguish and remove dangerous content from online platforms, albeit in a limited way. It could be important that international and regional health authorities address this issue in their educational material, by explaining these concepts to the public and putting them in the correct scientific context. Our study also shows the importance of more widespread scientific literacy across the general public, such as an understanding of how to read and interpret a basic scientific paper; this type of education could disarm the use of studies as a way to bolster credibility. Our findings also reinforce the long-established gender bias within right wing media, while also illustrating the symbiosis of right wing, conspiracist and religious movements fuelling the Covid-19 infodemic.

However, although we used a sample size of nearly 800 videos/news articles, our study still lacks statistical power in analysing concepts only mentioned in a few videos. Additionally, the low proportion of anti-vaccine news articles was also a limitation. Clearly, studies on larger samples are needed and, because this may not be feasible for human raters, automated methods relying on natural language processing may be needed. Another limitation of this study is that restricting the analysis to news articles and YouTube ignores social media used by younger generations, such as Snapchat, Instagram or TikTok (ref. 98).

Data availability statement

Publicly available datasets were analysed in this study. This data can be found at: https://zenodo.org/doi/10.5281/zenodo.8382702.

Author contributions

RG: Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing. HG: Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing. MR: Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing. RT: Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing PG: Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing.

References

1. K Krawczyk, T Chelkowski, DJ Laydon, S Mishra, D Xifara, B Gibert. Quantifying online news media coverage of the COVID-19 pandemic: text mining study and resource.. J Med Internet Res. (, 2021. [DOI | PubMed]
2. G Capurro, CG Jardine, J Tustin, M Driedger. Communicating scientific uncertainty in a rapidly evolving situation: A framing analysis of Canadian coverage in early days of COVID-19.. BMC Public Health. (, 2021. [DOI | PubMed]
3. R Evans. SAGE advice and political decision-making: ‘following the science’ in times of Epistemic uncertainty.. Soc Stud Sci. (, 2022. [DOI | PubMed]
4. A Fleerackers, M Riedlinger, L Moorhead, R Ahmed, JP Alperin. Communicating scientific uncertainty in an age of COVID-19: an investigation into the use of preprints by digital media outlets.. Health Commun. (, 2022. [DOI | PubMed]
5. J Parviainen, A Koski, S Torkkola. Building a ship while sailing it. Epistemic humility and the temporality of non-knowledge in political decision-making on COVID-19.. Soc Epistemol. (, 2021. [DOI]
6. M Cinelli, W Quattrociocchi, A Galeazzi, CM Valensise, E Brugnoli, AL Schmidt. The COVID-19 social media Infodemic.. Sci Rep. (, 2020. [DOI | PubMed]
7. J Koffman, J Gross, SN Etkind, L Selman. Uncertainty and COVID-19: how are we to respond?. J R Soc Med. (, 2020. [DOI | PubMed]
8. EM Larsen, KR Donaldson, M Liew, A Mohanty. Conspiratorial thinking during COVID-19: the roles of paranoia, delusion-proneness, and intolerance of uncertainty.. Front Psych. (, 2021. [DOI | PubMed]
9. VM Valerie, LJ Pummerer, S Alper, H Bai, V Čavojová, J Farias. Antecedents and consequences of COVID-19 conspiracy beliefs: A systematic review.. Soc Sci Med. (, 2022. [DOI | PubMed]
10. P Bertin, K Nera, S Delouvée. Conspiracy beliefs, rejection of vaccination, and support for hydroxychloroquine: A conceptual replication-extension in the COVID-19 pandemic context.. Front Psychol. (, 2020. [DOI | PubMed]
11. LB Lazarević, D Purić, P Teovanović, P Lukić, Z Zupan, G Knežević. What drives us to be (Ir)responsible for our health during the COVID-19 pandemic? The role of personality, thinking styles, and conspiracy mentality.. Personal Individ Differ. (, 2021. [DOI | PubMed]
12. B Bozeman. Use of science in public policy: lessons from the COVID-19 pandemic efforts to ‘follow the science.. Sci Public Policy. (, 2022. [DOI]
13. P Cairney. The UK Government’s COVID-19 policy: what does ‘guided by the science’ mean in practice?. Front Political Sci. (, 2021. [DOI]
14. M MacAulay, P Fafard, A Cassola, M Palkovits. Analysing the ‘follow the science’ rhetoric of government responses to COVID-19.. Policy Polit. (, 2023. [DOI]
15. M Leidecker-Sandmann, P Attar, A Schütz, M Lehmkuhl. Selected by expertise? Scientific experts in German news coverage of COVID-19 compared to other pandemics.. Public Underst Sci. (, 2022. [DOI | PubMed]
16. V Aelst, FT Peter, L Castro, V Štětka, C de Vreese, T Aalberg. Does a crisis change news habits? A comparative study of the effects of COVID-19 on news media use in 17 European countries.. Digit Journal. (, 2021. [DOI]
17. JP Ioannidis, A Tezel, R Jagsi. Overall and COVID-19-specific citation impact of highly visible COVID-19 media experts: bibliometric analysis.. BMJ Open. (, 2021. [DOI | PubMed]
18. H Wormer. German media and coronavirus: exceptional communication—or just a catalyst for existing tendencies?. Media Commun. (, 2020. [DOI]
19. AJ Dolman, T Fraser, C Panagopoulos, DP Aldrich, D Kim. Opposing views: associations of political polarization, political party affiliation, and social trust with COVID-19 vaccination intent and receipt.. J Public Health. (, 2022. [DOI | PubMed]
20. M Pinna, L Picard, C Goessmann. Cable news and COVID-19 vaccine compliance., 2021
21. J Allgaier. Who is having a voice? Journalists’ selection of sources in a creationism controversy in the UK press.. Cult Stud Sci Educ. (, 2011. [DOI]
22. E Albæk. The interaction between experts and journalists in news journalism.. Aust Dent J. (, 2011. [DOI]
23. N Vaninov. In the eye of the COVID-19 cytokine storm.. Nat Rev Immunol. (, 2020. [DOI | PubMed]
24. N Mangalmurti, CA Hunter. Cytokine storms: understanding COVID-19.. Immunity. (, 2020. [DOI | PubMed]
25. H Sies, C Berndt, DP Jones. Oxidative stress.. Annu Rev Biochem. (, 2017. [DOI | PubMed]
26. P Ghezzi, V Jaquet, F Marcucci, HH Schmidt. The oxidative stress theory of disease: levels of evidence and epistemological aspects.. Br J Pharmacol. (, 2016. [DOI | PubMed]
27. R Cohen, M Pettoello-Mantovani, E Somekh, C Levy. European pediatric societies call for an implementation of regular vaccination programs to contrast the immunity debt associated to coronavirus Disease-2019 pandemic in children.. J Pediatr. (, 2022. [DOI | PubMed]
28. M Yazdanbakhsh, PG Kremsner, R van Ree. Allergy, parasites, and the hygiene hypothesis.. Science. (, 2002. [DOI | PubMed]
29. J-F Bach. The hygiene hypothesis in autoimmunity: the role of pathogens and commensals.. Nat Rev Immunol. (, 2018. [DOI | PubMed]
30. CJE Metcalf, M Ferrari, AL Graham, BT Grenfell. Understanding herd immunity.. Trends Immunol. (, 2015. [DOI | PubMed]
31. J Piret, G Boivin. Viral interference between respiratory viruses.. Emerg Infect Dis. (, 2022. [DOI | PubMed]
32. AM Arvin, K Fink, MA Schmid, A Cathcart, R Spreafico, C Havenar-Daughton. A perspective on potential antibody-dependent enhancement of SARS-CoV-2.. Nature. (, 2020. [DOI | PubMed]
33. EJ Wherry. T cell exhaustion | nature immunology.. Nat Immunol. (, 2011. [DOI | PubMed]
34. EJ Wherry, M Kurachi. Molecular and cellular insights into T cell exhaustion.. Nat Rev Immunol. (, 2015. [DOI | PubMed]
35. S Pillai. SARS-CoV-2 vaccination washes away original antigenic sin.. Trends Immunol. (, 2022. [DOI | PubMed]
36. A Zhang, HD Stacey, CE Mullarkey, MS Miller. Original Antigenic Sin: How First Exposure Shapes Lifelong Anti–Influenza Virus Immune Responses.. J Immunol. (, 2019. [DOI | PubMed]
37. M Aguilar-Bretones, RAM Fouchier, MPG Koopmans, GP van Nierop. Impact of antigenic evolution and original antigenic sin on SARS-CoV-2 immunity.. J Clin Invest. (, 2023. [DOI | PubMed]
38. JR Landis, GG Koch. The measurement of observer agreement for categorical data.. Biometrics. (, 1977. [DOI | PubMed]
39. A Wu, VT Mihaylova, ML Landry, EF Foxman. Interference between rhinovirus and influenza A virus: A clinical data analysis and experimental infection study.. Lancet Microbe. (, 2020. [DOI | PubMed]
40. CJ Reynolds, C Pade, JM Gibbons, AD Otter, K-M Lin, DM Sandoval. Immune boosting by B.1.1.529 (omicron) depends on previous SARS-CoV-2 exposure.. Science. (, 2022. [DOI | PubMed]
41. BB Finlay, KR Amato, M Azad, MJ Blaser, TCG Bosch, H Chu. The hygiene hypothesis, the COVID pandemic, and consequences for the human microbiome.. Proc Natl Acad Sci. (, 2021. [DOI | PubMed]
42. SJ Lynch, MR Sears, RJ Hancox. Thumb-sucking, nail-biting, and atopic sensitization, asthma, and Hay fever.. Pediatrics. (, 2016. [DOI | PubMed]
43. J Xiao, EYC Shiu, H Gao, JY Wong, MW Fong, S Ryu. Nonpharmaceutical measures for pandemic influenza in nonhealthcare settings—personal protective and environmental measures.. Emerg Infect Dis. (, 2020. [DOI | PubMed]
44. A Ben-Shmuel, T Brosh-Nissimov, I Glinert, E Bar-David, A Sittner, R Poni. Detection and infectivity potential of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) environmental contamination in isolation units and quarantine facilities.. Clin Microbiol Infect: Official Pub European Society of Clin Microbiol Infect Dis. (, 2020. [DOI | PubMed]
45. S Gupta, P Sarthi, S Biswal, SK Panda, AK Ray, MK Rana. Binding mechanism and structural insights into the identified protein target of COVID-19 and importin-α with in-vitro effective drug Ivermectin.. J Biomol Struct Dyn. (, 2022. [DOI | PubMed]
46. 46.Ofcom. (2021). Section five: Due impartiality and due accuracy. Section five: Due impartiality and due accuracy. January 5, 2021. Available at: https://www.ofcom.org.uk/tv-radio-and-on-demand/broadcast-codes/broadcast-code/section-five-due-impartiality-accuracy. Archived at https://web.archive.org/web/20230808113522/https://www.ofcom.org.uk/tv-radio-and-on-demand/broadcast-codes/broadcast-code/section-five-due-impartiality-accuracy.
47. A Pandey, N Patni, M Singh, A Sood, G Singh. YouTube as a source of information on the H1N1 influenza pandemic.. Am J Prev Med. (, 2010. [DOI | PubMed]
48. K Bora, D Das, B Barman, P Borah. Are internet videos useful sources of information during global public health emergencies? A case study of YouTube videos during the 2015-16 Zika virus pandemic.. Pathogens and Global Health. (, 2018. [DOI | PubMed]
49. R Pathak, DR Poudel, P Karmacharya, A Pathak, MR Aryal, M Mahmood. YouTube as a source of information on Ebola virus disease.. N Am J Med Sci. (, 2015. [DOI | PubMed]
50. M Yesilada, S Lewandowsky. Systematic review: YouTube recommendations and problematic content.. Internet Policy Rev. (, 2022. [DOI | PubMed]
51. 51.YouTube Progress on Responsibility. (2021). YouTube Progress on Responsibility – How YouTube Works. 2021. Available at: https://www.youtube.com/howyoutubeworks/progress-impact/responsibility/. Archived at https://web.archive.org/web/20230808115733/https://www.youtube.com/intl/ALL_uk/howyoutubeworks/progress-impact/responsibility/.
52. 52.YouTube Team. (2021). “Managing harmful vaccine content on YouTube.” Blog.Youtube. 2021. Available at: https://blog.youtube/news-and-events/managing-harmful-vaccine-content-youtube/ Archived at https://web.archive.org/web/20230711100633/https://blog.youtube/news-and-events/managing-harmful-vaccine-content-youtube/.
53. A Perlman. Whitewashing diversity: the conservative attack on the ‘stealth fairness doctrine.. Telev New Media. (, 2012. [DOI]
54. E Mathieu, H Ritchie, E Ortiz-Ospina, M Roser, J Hasell, C Appel. A global database of COVID-19 vaccinations.. Nat Hum Behav. (, 2021. [DOI | PubMed]
55. L Tang, W Peng. Culture and health reporting: A comparative content analysis of newspapers in the United States and China.. J Health Commun. (, 2015. [DOI | PubMed]
56. GL Vestergaard, KH Nielsen. Science news in a closed and an open media market: A comparative content analysis of print and online science news in Denmark and the United Kingdom.. Eur J Commun. (, 2016. [DOI]
57. W Zhang, YL Cheung. The hierarchy of news values – A Corpus-based diachronic and cross-cultural comparison of news reporting on epidemics.. J Lesbian Stud. (, 2022. [DOI]
58. L Lu, J Liu, Y Connie Yuan. Health information seeking behaviors and source preferences between Chinese and U.S. populations.. J Health Commun. (, 2020. [DOI | PubMed]
59. HK Kim, J Ahn, L Atkinson, LA Kahlor. Effects of COVID-19 misinformation on information seeking, avoidance, and processing: A multicountry comparative study.. Forensic Sci Commun. (, 2020. [DOI]
60. CT Nguyen. Echo chambers and epistemic bubbles.. Episteme. (, 2020. [DOI]
61. R Debnath, DM Reiner, BK Sovacool, F Müller-Hansen, R Tim Repke, M Alvarez. Conspiracy spillovers and geoengineering.. iScience. (, 2023. [DOI | PubMed]
62. DS Meyer, N Whittier. Social movement spillover.. Soc Probl. (, 1994. [DOI]
63. A Atabekova, L Lutskovskaia, E Kalashnikova. Axiology of Covid-19 as a linguistic phenomenon.. J Inf Sci. (, 2022. [DOI]
64. A Abbas, A Lichtman, S Pillai. Cellular and Molecular Immunology: Cellular and Molecular Immunology E-Book., 2021
65. CU Blank, W Nicholas Haining, W Held, PG Hogan, A Kallies, E Lugli. Defining ‘T cell exhaustion’.. Nat Rev Immunol. (, 2019. [DOI | PubMed]
66. SN Mueller, R Ahmed. High antigen levels are the cause of T cell exhaustion during chronic viral infection.. Proc Natl Acad Sci. (, 2009. [DOI | PubMed]
67. JJ Lau, SMS Cheng, K Leung, CK Lee, A Hachim, LCH Tsang. Real-world COVID-19 vaccine effectiveness against the omicron BA.2 variant in a SARS-CoV-2 infection-naive population.. Nat Med. (, 2023. [DOI | PubMed]
68. O Magen, JG Waxman, M Makov-Assif, R Vered, D Dicker, MA Hernán. Fourth dose of BNT162b2 mRNA Covid-19 vaccine in a Nationwide setting.. N Engl J Med. (, 2022. [DOI | PubMed]
69. APS Munro, S Feng, L Janani, V Cornelius, PK Aley, G Babbage. Safety, immunogenicity, and Reactogenicity of BNT162b2 and mRNA-1273 COVID-19 vaccines given as fourth-dose boosters following two doses of ChAdOx1 nCoV-19 or BNT162b2 and a third dose of BNT162b2 (COV-BOOST): A multicentre, blinded, phase 2, randomised trial.. Lancet Infect Dis. (, 2022. [DOI | PubMed]
70. T Francis. On the doctrine of original antigenic sin.. Proc Am Philos Soc. (, 1960
71. M Aguilar-Bretones, BM Westerhuis, MP Raadsen, E de Bruin, FD Chandler, MA Nisreen. Seasonal coronavirus-specific B-cells with limited SARS-CoV-2 cross-reactivity dominate the IgG response in severe COVID-19 patients.. American Society for Clin Invest. (, 2021. [DOI | PubMed]
72. H Azuma, Y Kawano, K Shitaoka, T Kawahara, A Ito, A Higashiura. Vaccination with the omicron spike RBD boosts broadly neutralizing antibody levels and confers sustained protection even after acquiring immunity to the original antigen.. Int Immunol. (, 2023. [DOI | PubMed]
73. H Sies, VV Belousov, NS Chandel, MJ Davies, DP Jones, GE Mann. Defining roles of specific reactive oxygen species (ROS) in cell biology and physiology.. Nat Rev Mol Cell Biol. (, 2022. [DOI | PubMed]
74. DC Fajgenbaum, CH June. Cytokine Storm.. N Engl J Med. (, 2020. [DOI | PubMed]
75. Tocilizumab in patients admitted to hospital with COVID-19 (RECOVERY): A randomised, controlled, open-label, platform trial.. Lancet (London, England). (, 2021. [DOI | PubMed]
76. D Gorski, G Yamey. Covid-19 and the new merchants of doubt.. BMJ. (, 2021
77. N Maani, MCI van Schalkwyk, FT Filippidis, C Knai, M Petticrew. Manufacturing doubt: assessing the effects of independent vs industry-sponsored messaging about the harms of fossil fuels, smoking, alcohol, and sugar sweetened beverages.. SSM – Population Heal. (, 2022. [DOI | PubMed]
78. R Cohen, M Ashman, M-K Taha, E Varon, F Angoulvant, C Levy. Pediatric infectious disease group (GPIP) position paper on the immune debt of the COVID-19 pandemic in childhood, how can we fill the immunity gap?. Infect Dis Now. (, 2021. [DOI | PubMed]
79. M Debus, J Tosun. Political ideology and vaccination willingness: implications for policy design.. Pol Sci. (, 2021. [DOI | PubMed]
80. PJ Hotez. Will anti-vaccine activism in the USA reverse global goals?. Nat Rev Immunol. (, 2022. [DOI | PubMed]
81. DP Donatella, A Lavizzari. Waves in cycle: the protests against anti-contagion measures and vaccination in Covid-19 times in Italy.. PARTECIPAZIONE E CONFLITTO. (, 2023. [DOI]
82. L Raffini, C Penalva-Verdú. The problematic relationship between science, politics and public opinion in late modernity: the case of the anti-vax movement in Spain and Italy In:. Populism and science in Europe, Palgrave Studies in European Political Sociology., 2022
83. A Santirocchi, P Spataro, F Alessi, C Rossi-Arnaud, V Cestari. Trust in Science and Belief in misinformation mediate the effects of political orientation on vaccine hesitancy and intention to be vaccinated.. Acta Psychol (Amst). (, 2023. [DOI | PubMed]
84. JK Ward, C Alleaume, P Peretti-Watel, P Peretti-Watel, V Seror, S Cortaredona. The French Public’s attitudes to a future COVID-19 vaccine: the politicization of a public health issue.. Soc Sci Med. (, 2020. [DOI | PubMed]
85. M Zehring, E Domahidi. German Corona protest mobilizers on telegram and their relations to the far right: A network and topic analysis.. Social Media + Society. (, 2023. [DOI]
86. F Brandmayr. Public epistemologies and intellectual interventions in contemporary Italy.. Int J Politics Cult Soc. (, 2021. [DOI | PubMed]
87. G Troiano, A Nardi. Vaccine hesitancy in the era of COVID-19.. Public Health. (, 2021. [DOI | PubMed]
88. I Amarasekara, WJ Grant. Exploring the YouTube science communication gender gap: A sentiment analysis.. Public Underst Sci. (, 2019. [DOI | PubMed]
89. RF Levant, RC McDermott, S Pryor, J Barinas. Masculinity and compliance with Centers for Disease Control and Prevention recommended health practices during the COVID-19 pandemic.. Health Psychol. (, 2022. [DOI | PubMed]
90. JR Mahalik, SM Burns, M Syzdek. Masculinity and perceived normative health behaviors as predictors of Men’s health behaviors.. Soc Sci Med. (, 2007. [DOI | PubMed]
91. İ Doğan, L Baruh, Z Cemalcilar, O Kuru, K Yıldırım, A Çarkoğlu. Biased perceptions against female scientists affect intentions to get vaccinated for COVID-19.. Public Understanding of Sci. (, 2022. [DOI | PubMed]
92. E Harteveld, W Van Der Brug, S Dahlberg, A Kokkonen. The gender gap in populist radical-right voting: examining the demand side in Western and Eastern Europe.. Patterns of Prejudice. (, 2015. [DOI]
93. J Rydgren. The Oxford handbook of the radical right., 2018
94. Arianne Shahvisi. 2020
95. A Oswald, N Powdthavee. Daughters and left-wing voting.. Rev Econ Stat. (, 2010. [DOI]
96. A Graff, R Kapur, SD Walters. Introduction: gender and the rise of the global right.. Signs J Women Cult Soc. (, 2019. [DOI]
97. AL Whitehead, SL Perry. Taking America Back for god: Christian nationalism in the United States., 2020
98. B. Auxier, M. Anderson. 2021