Alignment of Lived Experience Questions with the Medical Literature in Bipolar Disorder: A Topic Modelling Approach: Adéquation entre les questions relatives à l’expérience vécue et la littérature médicale concernant le trouble bipolaire : Une approche de modélisation de sujets
1Department of Psychiatry, University of California San Diego, San Diego, CA, USA
2Department of Psychiatry, University of British Columbia, Vancouver, BC, Canada
3Department of Biology, Mount Royal University, Calgary, AB, Canada
Abstract
Objective
The priorities of people with mental health challenges should be reflected in the research conducted on their behalf. Quantifying alignment of priorities with the unmet needs of people with lived experience is challenging, and to our knowledge, such alignment has not been extensively studied in bipolar disorder (BD). Natural language processing approaches comparing common topics derived from public forums to those of biomedical research could help in identifying topics that are underaddressed.
Methods
We contrasted 5 years of lived experience questions posed during a Collaborative RESearch Team to study psychosocial issues in Bipolar Disorder (CREST.BD) “Ask Me Anything” (AMA) event hosted via Reddit (2019–2023) with topics labelled from abstracts extracted from PubMed with the search term BD during the same period. We applied topic modelling using BERTopic to identify dominant themes within each corpus and compared their semantic similarity using vector-based cosine similarity analyses.
Results
The Reddit AMA data included 6159 comments, and the medical literature from this period included 9188 abstracts. Topic modelling and similarity analyses indicated that shared and frequent topics in both corpuses were sleep, BD medication safety in pregnancy, and lithium treatment. Topics with comparatively higher frequency in the Reddit forums than in medical research included BD misdiagnosis, marijuana and BD, and coping with daily challenges.
Discussion
Notwithstanding limitations, comparing a corpus of lived experience questions with contemporaneous medical literature revealed areas of overlap, but some lived experience queries were not well covered in the biomedical literature. Natural language processing of public forums may facilitate identifying unmet priorities in BD.
Untitled section
Keywords: bipolar disorder, topic modelling, natural language processing, social media, bibliometrics
Plain Language Summary Title:
Alignment of Lived Experience Questions with the Medical Literature in Bipolar Disorder
Plain Language Summary:
The priorities of people with mental health conditions should be reflected in the research conducted on their behalf. Natural language processing approaches comparing common topics derived from public forums to that of biomedical research could help identify topics that are under-addressed. Our project used natural language processing to compare topics from 5 years of an annual online question and answer forum focused on bipolar disorder to published research about bipolar disorder in the biomedical literature. There were areas where research and public questions aligned, particularly sleep, bipolar disorder medication safety in pregnancy, and lithium treatment, but other areas were less well covered in the biomedical literature. In particular, bipolar disorder misdiagnosis, marijuana and bipolar disorder, and coping with daily challenges appeared to be unmet needs not well addressed in the scientific literature. Artificial intelligence approaches to comparing and contrasting public forums to biomedical literature could help important unmet needs in psychiatric research.
Résumé
Objectif
Les priorités des personnes aux prises avec des problèmes de santé mentale devraient être reflétées dans la recherche effectuée en leur nom. Il est difficile de quantifier l’adéquation entre les priorités et les besoins non satisfaits des personnes ayant une expérience vécue, et à notre connaissance, cette adéquation n’a pas fait l’objet d’études approfondies dans le cas du trouble bipolaire. Des approches de traitement automatique du langage naturel comparant les sujets communs tirés de forums publics à ceux de la recherche biomédicale pourraient aider à déterminer les sujets qui ne sont pas suffisamment abordés.
Méthodes
Nous avons comparé les questions relatives à l’expérience vécue posées au cours d’un événement « Ask Me Anything – AMA » (Posez-moi n’importe quelle question) sur Reddit pendant 5 ans (de 2019 à 2023) organisé par le réseau Collaborative RESearch Team to Study psychosocial issues in Bipolar Disorder (CREST.BD) avec des sujets tirés de résumés extraits de PubMed à l’aide du terme de recherche « trouble bipolaire » au cours de la même période. Nous avons appliqué la modélisation de sujets à l’aide de la technique BERTopic pour identifier les thèmes dominants au sein de chaque corpus et comparé leur similarité sémantique à l’aide d’analyses de similarité cosinus fondées sur les vecteurs.
Résultats
Les données tirées de l’événement AMA sur Reddit comprenaient 6 159 commentaires et la littérature médicale de cette période comprenait 9 188 résumés. La modélisation de sujets et les analyses de similarité ont indiqué que les sujets courants et communs aux deux corpus étaient le sommeil, l’innocuité des médicaments pour le traitement du trouble bipolaire pendant la grossesse et le traitement par le lithium. Parmi les sujets dont la fréquence est plus élevée dans les forums de Reddit que dans la recherche médicale, mentionnons les diagnostics erronés de trouble bipolaire, la marijuana et le trouble bipolaire, et comment faire face aux défis quotidiens.
Discussion
Malgré les limites, la comparaison entre un corpus de questions relatives à l’expérience vécue et la littérature médicale contemporaine a révélé des chevauchements, mais certaines interrogations relatives à l’expérience vécue n’ont pas été suffisamment abordées dans la littérature biomédicale. Le traitement automatique du langage naturel des forums publics peut aider à déterminer les priorités non satisfaites concernant le trouble bipolaire.
Untitled section
Mots-clés: trouble bipolaire, modélisation de sujets, traitement automatique du langage naturel, médias sociaux, bibliométrie
Introduction
Incorporating the perspectives and experiences of people with lived experience into research agendas holds the potential to inform the relevance of these research endeavours to those individuals and their communities.1–4 The importance of lived experience perspectives in the development of research priorities is actively being studied.5,6 Research priorities identified by people with lived experience and researchers/care providers do not always align7,8; however, when there is alignment, individuals with lived experience can experience improved access to care, trust in research and overall well-being.9–11
Among existing studies that prioritize input from individuals with lived experience of various health conditions, relatively few focus on populations with mental health concerns. 12 There is some evidence that the priorities of people with lived experience of mental health concerns are not always aligned with research priorities. For example, one study applied the James Lind Alliance methodology in three groups of stakeholders to identify a “top 10 list” of research priorities on reducing and stopping psychiatric medication, in doing so, highlighting important uncertainties and gaps in the existing evidence base in this topic area.13,14 These studies and others 15 point to the importance of including people whose lives are most directly affected by mental health conditions in discourses around unmet needs in order to most effectively shape research agendas and, ultimately, health system improvements.
When input from individuals with mental health challenges is sought out, there is the opportunity for improved care and well-being for patients and their communities.10,16,17 Collective knowledge from the research and lived experience communities has been associated with transformative change within policy and institutional realms.18,19 Seeking out user data and reflections has allowed developers of digital mental health interventions to enhance the access and utility of these tools.20,21 Engaging populations of individuals with lived experience of mental health challenges has also led to global outreach and research collaborations,22,23 improving inclusion of populations internationally. Most importantly, including lived experience can increase the likelihood that the most relevant research is being translated into clinical practice.24–26
In bipolar disorder (BD), specifically, there are only a handful of publications comparing lived experience and research community priorities; prior work has primarily been qualitative and conducted in small samples.1,2,23,27 A scoping review of consensus-setting studies in BD 28 identified only nine studies that were highly heterogeneous in terms of methodology. These studies did not directly compare in a quantitative fashion the perspectives from lived experience to the focus of the research in the scientific community. Further research using diverse methods to capture BD community input and their correspondence (or lack thereof) with biomedical research should yield insights into research questions most likely to yield impactful, clinically relevant outcomes.
Social media-based methods offer an opportunity to gather insights from posts from individuals with diverse health conditions, 29 offering an intriguing additional route to explore the research priorities. 30 Reddit, a social media service combined of “subreddits” (topical communities where anonymous users discuss specific areas of interest) 31 represents one compelling option as it readily supports health communication.32,33 While these online “subreddit” communities are often considered anonymous peer to peer conversations,34,35 they also provide a valuable opportunity to ignite conversations between diverse stakeholders in health communities. 11 Social media events on Reddit, if used effectively, can provide dynamic “crowd sourcing” 36 opportunities for questions and conversations between researchers, those with lived experience, and their wider communities, 37 and can be used to determine concerns,10,38 inform clinical care, 34 and determine priorities for research.
The Collaborative RESearch Team to study psychosocial issues in Bipolar Disorder (CREST.BD), has over the past 8 years delivered an annual Reddit “Ask Me Anything” (AMA) discussion. Held in conjunction with World Bipolar Day, the AMA serves to connect the public with a large panel of BD experts, including researchers, clinicians, and people with lived experience of BD. CREST.BD's AMA is a purposefully created space that fosters a dialogue about BD through anonymously posted questions from the community. This large data set and the unique forum generated by CREST.BD's Reddit AMA will be used in this study to develop a clearer sense of the areas of discourse that are currently prominent in Reddit BD communities. To assist in identifying research priorities, computational modelling and natural language processing will be used to identify themes from within the AMA Reddit posts. Computational modelling of text-based mental health-related Reddit posts has been conducted previously, but focused primarily on textual analysis of users with self-reported mental health diagnoses 39 or looking at particular behavioural experiences in BD. 40
In a prior study, natural language processing was used to quantify the focus areas of questions in topic modelling (specifically, BERTopic), 41 a technique that was used to algorithmically extract key themes from 5 years of the AMA conversations. Common topics identified included BD misdiagnosis/differential diagnoses, coping with daily struggles, understanding hypomania, suicidal thoughts and behaviours, medication and use of substances such as psilocybin and ketamine, and supporting loved ones with BD.
Expanding on this prior project, 42 we sought here to evaluate the alignment of the topics raised by AMA participants with that of concurrent research on BD, again using natural language processing methods. We performed topic modelling to the body of published peer-reviewed biomedical literature on BD during the same period (2019 to 2023) and then evaluated the convergence between Reddit and biomedical literature-derived topics. While this work was exploratory, we expected a range of convergent and divergent themes in comparing the Reddit and biomedical databases.
Method
Reddit Ask Me Anything Methods
All AMA events were conducted on the r/IAmA subreddit, a Reddit-based community platform facilitating topic-oriented interviews (i.e., AMAs), where users from the general public pose questions to panelists. AMAs are public facing in nature, allowing viewing of questions and responses, although only registered Reddit users may submit questions. The AMAs began each year on 30 March, World Bipolar Day, as a part of global awareness efforts for BD, and lasted 48 h. The dataset for the present study represents the AMAs held between 2019 and 2023, which engaged 159 expert panelists from 14 countries who had academic/clinical expertise in mood disorders and/or lived experience expertise in BD. Two-thirds of the panelists were existing CREST.BD members, while others joined from other mood disorder research or support networks. Taken together, the AMA events generated substantial international participation and engagement, representing the largest online BD-specific AMAs to date. Cumulatively, the five AMAs garnered 11,346 upvotes and 6,159 comments. Full details of the CREST.BD AMA methods and description of ethical considerations are provided in. 42 Briefly, since Reddit users’ profiles are anonymous and comments are shared in a public forum, this research is not governed by informed consent; ethical considerations pertaining to research on Reddit are explored in. 42
Biomedical Research Data
We performed topic modelling from the abstracts published literature available in PubMed [https://pubmed.ncbi.nlm.nih.gov]. PubMed was queried using Entrez [https://www.ncbi.nlm.nih.gov/books/NBK25501/] eSearch using an appropriate query limiting dates to the years when the CREST.BD AMA were conducted. We used the National Center for Biotechnology Information (NCBI) search term: “Bipolar Disorder,” and all data was accessed 30 April 2025, field set to “MeSH” OR “title” OR “abstract” and mindate set to 2019, maxdate set to 2023. The abstracts matching the PubMed identifiers (PMIDs) were then fetched using Entrez eFetch interface. The title, abstract content, PMID, and the date of publication were extracted. Entries which corresponded to correction, redaction, etc. that did not contain abstract text were removed from further analysis. A total of 9188 abstracts were extracted.
Topic Modelling Using BERTopic
Abstracts were treated as documents for topic modelling using BERTopic. 41 Some of the parameters for dimension reduction in Uniform Manifold Approximation and Projection (UMAP) 43 and Density-Based Spatial Clustering of Applications with Noise (DBSCAN) clustering 44 had to be modified to accommodate a larger document set. By altering some hyper-parameters (See Supplementary Material), and using frequently used words such as patient, bipolar, disorder, treatment as stop words (words to be filtered before topic modelling is performed), we achieved good clustering results with some non-cohesiveness in two large topics. The choice of hyper-parameters (Supplemental material, Table S1) was to additionally ensure 20 clusters were created with similar size and having similar distribution as our previous study. 42 For UMAP, setting metric = 'Euclidean’ and min_dist = 0.01 ensured linearity in embedding space was preserved, and points could be brought very close in the dimension reduction step. For HDBSCAN clustering, min_cluster_size = 80 ensures we had a minimum topic containing about 1% of the data; metric = 'Euclidean’ ensured linear interpretation in embedding space; cluster_selection_method = ’leaf’ was used to ensure large, diffused clusters were not created. Topic models were represented by 10 descriptive words, three exemplar documents, as well as KeyBERT 45 and ChatGPT-3.5-turbo description.
Constructing Topic Vectors for Matching
The focus of this article is to evaluate the extent of alignment between biomedical research with topics identified by people with lived experience, and we selected GloVe as a “common ground” between general domain lived experiences and technical biomedical perspectives in comparison to biomedical embeddings (e.g., PubMedBert). The 10 descriptive words of each topic are aggregated by summing their 300-dimensional GloVe vector. 46 Using the highest dimensional vectors available when aggregating GloVe vectors offers some advantages. Specifically, higher dimensions allow for the capture of more nuanced and complex semantic relationships between words, potentially improving the performance of downstream tasks like sentiment analysis and text classification.
where is the topic vector constructed by adding GloVe vectors of 10 descriptive words.
Similarity Match Between Topics
Having constructed vectors to represent each of the model topics, similarity between two topics was computed using cosine similarity:
Similarity Si,j between research topics j and Reddit topic i was computed by summing respective dimensional components in the word vectors. Similarity measures and their cut-offs for titles and short texts substitutability lack a clear consensus. 47 Cosine similarity ranges from 0 to 1, and we interpreted for ease of understanding a similarity score of >0.6 as reflecting higher overlap, between 0.4 and 0.6 as modest, and <0.4 as low overlap. Although there is no widely accepted standard for cosine similarity thresholds in embedding-based topic matching, our choice was based on observation and in accordance with the few studies that explored cosine similarity in the context of embeddings. 48
Results
PubMed Topics: The results of topic modelling using BERTopic and topic representation generated by ChatGPT 3.5 Turbo are shown in Table 1. The table is sorted by the counts of abstracts belonging to the topic followed by a topical phrase generated using ChatGPT 3.5-torbo and the top defining words. In addition, we have provided the representative abstract's title and the PMID. Clustering visualization (Figure 1) shows the spatial distribution among clusters. The proximity of similar topics is apparent where clusters related to brain/cognition/ADHD occupy one region (orange/brown) next to metabolic-related (yellow/green), pharma-related ones (greens), and circadian/sleep related (blue/teal). As seen in the figure, the resultant topics cover a wide range of BD-related themes, with the most common topic “Genetic Architecture of Psychiatric Disorders,” a theme containing 728 PubMed articles, and the second most common topic was “Brain Network Alterations in Depression.” All clusters were localized and well-defined in the reduced-dimensional space (Figure 1).
| Topic | Count | OpenAI Topic Representation a | Top 10 Words in Topic b | Representative Article Title c | PMID d |
|---|---|---|---|---|---|
| 0 | 728 | Genetic Architecture of Psychiatric Disorders | [‘gene’, ‘genetic’, ‘disorder’, ‘variant’, ‘psychiatric’, ‘schizophrenia’, ‘association’, ‘risk’, ‘expression’, ‘psychiatric disorder’] | Transcriptomic Insight Into the Polygenic Mechanisms Underlying Psychiatric Disorders. | 32792264 |
| 1 | 650 | Brain Network Alterations in Depression | [‘brain’, ‘network’, ‘patient’, ‘connectivity’, ‘functional’, ‘left’, ‘gyrus’, ‘healthy’, ‘volume’, ‘control’] | Fractional amplitude of low-frequency fluctuations and gray matter volume alterations in patients with bipolar depression. | 32389612 |
| 2 | 601 | Pharmacological Treatment of Acute Mania | [‘treatment’, ‘antipsychotic’, ‘patient’, ‘effect’, ‘drug’, ‘depression’, ‘quetiapine’, ‘efficacy’, ‘trial’, ‘lurasidone’] | Valproate for acute mania. | 31621892 |
| 3 | 318 | Long-Term Lithium Safety and Use | [‘lithium’, ‘treatment’, ‘effect’, ‘li’, ‘patient’, ‘lithium treatment’, ‘level’, ‘therapeutic’, ‘renal’, ‘concentration’] | Long-term lithium therapy and risk of chronic kidney disease, hyperparathyroidism and hypercalcemia: a cohort study. | 36709463 |
| 4 | 289 | Access and Delivery of Mental Health Services | [‘health’, ‘care’, ‘mental’, ‘mental health’, ‘service’, ‘intervention’, ‘patient’, ‘participant’, ‘outcome’, ‘support’] | Exploring Access to Mental Health and Primary Care Services for People With Severe Mental Illness During the COVID-19 Restrictions. | 35126210 |
| 5 | 270 | Cognitive Impairment Profiles in Euthymia | [‘cognitive’, ‘patient’, ‘impairment’, ‘functioning’, ‘memory’, ‘performance’, ‘cognition’, ‘function’, ‘executive’, ‘cognitive impairment’] | Role of cognitive reserve in cognitive variability in euthymic individuals with bipolar disorder: cross-sectional cluster analysis. | 33121561 |
| 6 | 265 | Physical Comorbidity and Cardiovascular Risk in SMI | [‘risk’, ‘patient’, ‘mental’, ‘smi’, ‘mortality’, ‘disease’, ‘cardiovascular’, ‘year’, ‘ci’, ‘health’] | Cardiovascular Risk for Patients With and Without Schizophrenia, Schizoaffective Disorder, or Bipolar Disorder. | 35261265 |
| 7 | 261 | Childhood Trauma, HPA Axis and Mood Disorders | [‘childhood’, ‘trauma’, ‘childhood trauma’, ‘child’, ‘youth’, ‘disorder’, ‘risk’, ‘adolescent’, ‘parent’, ‘symptom’] | Clinical and neuroendocrine correlates of childhood maltreatment history in adults with bipolar disorder. | 32365252 |
| 8 | 253 | Risk Factors for Suicide Attempts | ['suicide’, ‘suicidal’, ‘attempt’, ‘suicide attempt’, ‘risk’, ‘ideation’, ‘sa’, ‘patient’, ‘suicidal ideation’, ‘suicide risk’] | Correlates of violent suicide attempts in patients with bipolar disorder. | 31734642 |
| 9 | 224 | Assessment of Mixed Depression Symptoms | ['symptom’, ‘patient’, ‘depression’, ‘depressive’, ‘scale’, ‘clinical’, ‘mood’, ‘episode’, ‘mixed’, ‘score’] | Psychometric properties of the Clinically Useful Depression Outcome Scale supplemented with DSM-5 Mixed subtype questionnaire in Chinese patients with mood disorders. | 33038700 |
| 10 | 184 | Inflammatory Cytokine Profiles in Depression | [‘il’, ‘level’, ‘inflammation’, ‘cytokine’, ‘inflammatory’, ‘crp’, ‘patient’, ‘immune’, ‘marker’, ‘tnfalpha’] | Are serum levels of inflammatory markers associated with the severity of symptoms of bipolar disorder? | 36741577 |
| 11 | 172 | Postpartum Psychiatric Risk Factors | [‘woman’, ‘postpartum’, ‘pregnancy’, ‘perinatal’, ‘risk’, ‘pregnant’, ‘period’, ‘depression’, ‘postpartum psychosis’, ‘birth’] | Past Psychiatric Conditions as Risk Factors for Postpartum Depression: A Nationwide Cohort Study. | 31967747 |
| 12 | 124 | Ketamine Treatment-Resistant Depression | [‘ketamine’, ‘infusion’, ‘depression’, ‘effect’, ‘treatment’, ‘antidepressant’, ‘trd’, ‘iv ketamine’, ‘iv’, ‘treatmentresistant’] | Strategies to Prolong Ketamine's Efficacy in Adults with Treatment-Resistant Depression. | 33929660 |
| 13 | 111 | COVID-19 Pandemic Mental Health | [‘covid’, ‘pandemic’, ‘infection’, ‘mental’, ‘covid pandemic’, ‘health’, ‘patient’, ‘psychiatric’, ‘sarscov’, ‘coronavirus’] | Changes in the Mean of Medical Visits Due to Psychiatric Disease in Korean Children and Adolescents before and during the COVID-19 Pandemic. | 35455091 |
| 14 | 110 | Sleep Disturbance and Quality | ['sleep’, ‘insomnia’, ‘sleep disturbance’, ‘disturbance’, ‘sleep quality’, ‘disorder’, ‘quality’, ‘patient’, ‘symptom’, ‘sleep problem’] | Independent and combined associations of sleep duration and sleep quality with common physical and mental disorders: Results from a multi-ethnic population-based study. | 32673344 |
| 15 | 109 | Oxidative Stress in Neuropsychiatry | [‘oxidative’, ‘mitochondrial’, ‘oxidative stress’, ‘stress’, ‘level’, ‘damage’, ‘antioxidant’, ‘disorder’, ‘effect’, ‘disease’] | Associations between oxidative stress and perceived stress in patients with bipolar disorder and healthy control individuals. | 33781161 |
| 16 | 91 | Adult ADHD Prevalence Comorbidity | [‘adhd’, ‘adult’, ‘adult adhd’, ‘ci’, ‘disorder’, ‘risk’, ‘symptom’, ‘adhd symptom’, ‘comorbid’, ‘attention’] | Trends in the Prevalence and Incidence of Attention-Deficit/Hyperactivity Disorder Among Adults and Children of Different Racial and Ethnic Groups. | 31675080 |
| 17 | 84 | Circadian Rhythm Mood Disorders | [‘circadian’, ‘rhythm’, ‘circadian rhythm’, ‘melatonin’, ‘clock’, ‘chronotype’, ‘sleep’, ‘mood’, ‘gene’, ‘disorder’] | Disrupted circadian rhythms and mental health. | 34225967 |
| 18 | 83 | Repetitive Transcranial Magnetic Stimulation | ['stimulation’, ‘rtms’, ‘treatment’, ‘tdcs’, ‘transcranial’, ‘depression’, ‘patient’, ‘tm’, ‘response’, ‘db’] | An update on the clinical use of repetitive transcranial magnetic stimulation in the treatment of depression. | 32697721 |
| 19 | 81 | Gut Microbiota Mental Health | [‘gut’, ‘microbiota’, ‘gut microbiota’, ‘microbiome’, ‘axis’, ‘microbial’, ‘probiotic’, ‘gut microbiome’, ‘disorder’, ‘composition’] | Fecal Microbiota Transplantation: A New Therapeutic Attempt from the Gut to the Brain. | 33510784 |
Validation of Topic Modelling:
Topic Coherence: To assess the quality of modelled topics that correlates with human judgement, several coherence measures were calculated, each being associated with slightly different statistical and semantic properties.49–51
- UMass coherence (CUMass) was −1.6; it is a word-order asymmetric corpus-based measure using document co-occurrence counts from the training corpus. The values are negative, and less negative values are better.
- UCI coherence (CUCI) was 1.1; it is similar to CUMass, but it uses an external corpus for co-occurrence counts, and positive values are better.
- Pointwise mutual information (CNPMI) was 0.142; it is a corpus-unaware measure of coherence that uses mutual information between topic word pairs, and positive values are better.
- Contextual vector coherence (CV) is a generally preferred metric that lies in the range [0–1] and was shown to have the strongest correlation to human ratings 50 ; it was 0.67. It is a composite measure that combines sliding-window co-occurrence counts with CNPMI scores integrating direct co-occurrence with a topic-space representation to capture both local and global semantic relatedness. A higher score indicates a more coherent, meaningful topic. Scores around 0.7 are considered strong, while 0.3–0.4 indicates low coherence.
Topic Diversity: a measure of how distinct the generated topics are, was 0.77. It was computed as a fraction of all top words (across the topics) that were unique.
Model Stability: This was found to be 0.87. Rank-Biased Overlap (RBO extended), which gives greater weight to higher frequency terms, was used over five (randomly seeded) runs to compute it.
Convergence of Reddit and PubMed Topics: Our measure of convergence, cosine similarity, was interpreted as >0.6 as reflecting higher overlap, between 0.4 and 0.6 as modest, and <0.4 as low overlap. Using this metric, a third (35%) of the top 20 topics of people with lived experience exceed 0.6 (n = 6 of the topics identified through Reddit AMA topic analysis). These included Lithium therapeutic index monitoring, Bipolar Pregnancy Medication Safety, Understanding Cyclothymia, Bipolar Sleep Cycling Disorder, Marijuana and Bipolar Disorder, Bipolar Suicide Rates, and Bipolar Disorder Misdiagnosis (Figure 2 and Tables 2–3).
| Tag | Topics | Count | PubMed Overlap |
|---|---|---|---|
| T5 | Lithium therapeutic index monitoring | 85 | 0.81 |
| T14 | Bipolar pregnancy medication safety | 25 | 0.75 |
| T15 | Understanding cyclothymia | 23 | 0.74 |
| T1 | Bipolar disorder misdiagnosis | 575 | 0.73 |
| T9 | Bipolar sleep cycling disorder | 49 | 0.71 |
| T3 | Marijuana and bipolar disorder | 130 | 0.65 |
| T19 | Bipolar suicide rates | 14 | 0.65 |
| T7 | Mood effects of BD treatment | 73 | 0.6 |
| T4 | Supporting bipolar family member | 91 | 0.6 |
| T17 | Alcohol use in bipolar disorder | 15 | 0.59 |
| T11 | Managing sleep with seroquel | 29 | 0.56 |
| T6 | Understanding hypomania | 76 | 0.55 |
| T13 | Lamictal lamotrigine interactions | 28 | 0.52 |
| T12 | Depictions of bipolar disorder | 28 | 0.45 |
| T20 | Managing bipolar disorder diagnosis | 11 | 0.41 |
| T2 | Expressing gratitude and struggles | 157 | 0.39 |
| T16 | Keto diet and bipolar disorder | 16 | 0.35 |
| T10 | Gratitude and hope | 31 | 0.33 |
| T8 | Coping with daily challenges | 68 | 0.3 |
| T18 | Thomas Szasz book review | 15 | 0.28 |
| Tag | Topics | Count | Reddit Overlap |
|---|---|---|---|
| P4 | Long-term lithium safety and use | 318 | 0.81 |
| P3 | Pharmacological treatment of acute mania | 601 | 0.75 |
| P10 | Assessment of mixed depression symptoms | 224 | 0.74 |
| P15 | Sleep disturbance and quality | 110 | 0.73 |
| P12 | Postpartum psychiatric risk factors | 172 | 0.73 |
| P17 | Adult ADHD prevalence comorbidity | 91 | 0.73 |
| P18 | Circadian rhythm mood disorders | 84 | 0.71 |
| P13 | Ketamine treatment-resistant depression | 124 | 0.66 |
| P9 | Risk factors for suicide attempts | 253 | 0.65 |
| P1 | Genetic architecture of psychiatric disorders | 728 | 0.64 |
| P8 | Childhood trauma, HPA axis and mood disorders | 261 | 0.62 |
| P7 | Physical comorbidity and cardiovascular risk in SMI | 265 | 0.62 |
| P5 | Access and delivery of mental health services | 289 | 0.6 |
| P14 | COVID-19 pandemic mental health | 111 | 0.59 |
| P2 | Brain network alterations in depression | 650 | 0.56 |
| P6 | Cognitive impairment profiles in euthymia | 270 | 0.54 |
| P16 | Oxidative stress in neuropsychiatry | 109 | 0.5 |
| P11 | Inflammatory cytokine profiles in depression | 184 | 0.5 |
| P19 | Repetitive transcranial magnetic stimulation | 83 | 0.45 |
| P20 | Gut microbiota mental health | 81 | 0.24 |
The remaining 65% of the Reddit topics (cosine similarity in the range .28−.60) cover 42% of the Reddit responses/comments that were linked with moderate (n = 8) or low overlap (n = 5) with the biomedical literature. These topics include side effects and experiences of medications (e.g., Lamictal Lamotrigine Interactions), self-management (e.g., coping with daily challenges), and family members/caregiving.
Turning to the convergence of PubMed topics appearing in Reddit, 45% of topics evidenced higher overlap. These included Long-Term Lithium Safety and Use, Pharmacological Treatment of Acute Mania, Assessment of Mixed Depression Symptoms, Sleep Disturbance and Quality, and Postpartum Psychiatric Risk Factors. PubMed topics with very low coverage (cosine similarity <0.4) included basic biological mechanism—Gut Microbiota Health.
Finally, in Figure 2, a Sankey plot 52 visualize the match between the Reddit user topics and the PubMed topics.
To ensure we arrived at consistent topical phrases, the generated topics were reviewed by experts along with the representative words and the corresponding abstracts; results were supplemented with suggested alterations. Human review of the topic matches indicated that the thematic alignment between Reddit and PubMed topics was generally consistent with the cosine similarity values. Topic pairs with cosine similarity values greater than 0.6 typically reflected clear conceptual correspondence (e.g., lithium safety, sleep disturbance, and suicide risk), while those in the moderate range (0.4–0.6) represented broader but related themes. One partial exception was the pairing of the Reddit topic “Marijuana and Bipolar Disorder” with the PubMed topic “Pharmacological Treatment of Acute Mania” (cosine similarity = 0.65). Although these topics appear distinct, the Reddit discussions focus on recreational substances and their potential to precipitate mania, whereas the PubMed literature addresses pharmacological agents used to treat acute mania; both therefore relate to the role of psychoactive substances in manic states.
Discussion
In this study, we applied a computational approach to examine the alignment between research topics reflected in PubMed abstracts concerning BD and questions posed by individuals with lived experience during a series of large-scale Reddit AMA events focused on BD. By using natural language processing and topic modelling on both corpora, we compared the thematic focus of lived experience discourse and biomedical literature in a reproducible manner. There was some evidence for overlap, with 35% of topics in the Reddit AMA appearing in the biomedical literature and 60% of biomedical topics appearing in the Reddit forums. For areas of strong overlap, this may support the potential use of social media forums for the dissemination of scientific literature and engagement with the public. Topics with low representation in the biomedical literature but high frequency in Reddit forums included self-management and caregiving for family members. These topics could be viewed as areas of high priority for people with lived experience of BD, and unmet needs for research.
Several themes identified in the AMA questions showed considerable overlap with those prevalent in PubMed abstracts. These included topics related to diagnosis, medication use, and treatment outcomes, which have traditionally represented central foci of biomedical research and clinical management. Such convergence may reflect the ongoing emphasis on symptom management and pharmacotherapy within both professional and lived experience perspectives on BD. Sleep and circadian rhythm were also highly overlapping topics, underscoring their recognized importance as both clinical features and self-management challenges for people with BD. Taken together, these findings suggest that online communities such as Reddit could serve as useful venues for disseminating research findings on these topics in BD. Moreover, forums could provide opportunities to obtain feedback on research aims, outcomes, and or procedures in planning stages of research, as well as offer opportunities for engagement with research studies.
The areas with less overlap may also be informative for the BD research community. Firstly, it is perhaps not surprising that lived experience queries did not reflect topics in current basic science research. That said, online community forums maybe avenues for research dissemination so as to increase public awareness and potentially in discovery-oriented science. Secondly, several topics raised by AMA participants, such as self-management strategies, the experience of hypomania, and supporting family members or caregivers, appeared underrepresented in biomedical research abstracts. These domains are central to the day-to-day experience of living with BD, yet they receive comparatively less research attention.53–55 It is not quite clear why self-management, family care, or lived experience of hypomania are limited as a research focus in BD compared to public interest. One possibility is that these topics are considerations for secondary (early intervention) or tertiary (recovery) prevention, and there is some evidence that secondary and tertiary prevention research has declined in proportion of funding. 56 It may be that greater inclusion of people with lived experience in all phases of research, including priority setting and grant review, could ameliorate these gaps, and recent review has detailed the promise and challenges therein. 57 It does appear that natural language processing could be a useful tool in determining areas of unmet need, and potentially whether policy or research practice changes, such as inclusion of lived experience in research processes, mitigate these gaps over time.
Although these findings provide a preliminary perspective on how research priorities align with the lived experience of BD, several limitations should be considered. Topic modelling algorithms are imperfect, and the clusters they generate may not always represent cohesive or distinct themes. The labelling of topics therefore contains some degree of error, and our findings are best interpreted as offering a broad, “10,000-foot” overview of both data sources rather than a precise mapping of content. As with all natural language processing methods, results also depend on the linguistic patterns captured by the model and may differ from how humans would interpret meaning. The Reddit discourse data reflects questions posed by individuals rather than explicit research recommendations and therefore represent topics of curiosity or concern rather than prioritized areas for study per se. AMA questions may be shaped by the presence of experts and may differ from more spontaneous questions asked in different forums or on social media. In addition, the AMA participants may not be representative of all individuals with BD or of Reddit users more broadly, as demographic and diagnostic information were not available due to the platform's anonymity. The data were also aggregated across 5 years, and we did not have sufficient data to evaluate temporal changes in priorities among Reddit forum participants. The bioethics of social media research is a developing area with emerging frameworks for best practices. 58 Finally, some differences in results are to be expected if specialized domain-specific embeddings were used instead of GloVe embeddings for topic matching, which may be of interest from a different perspective.
We believe this study provides a foundation for integrating social media and biomedical research, more broadly, for exploring how natural language processing can be used to study the perspectives of people with lived experience and the research community at scale. Additional computational approaches, including alternative embedding methods or supervised topic models, could be examined to enhance the precision and interpretability of these analyses. Future work might also explore hybrid approaches, such as co-designing topic frameworks with lived experience partners and then applying computational methods to compare overlap with the scientific literature. Beyond BD, this approach could be adapted to other areas of mental health and chronic illness, as well as to other text sources such as patient forums, clinical documentation, or grant databases. Overall, this line of work suggests that systematic, data-driven methods may serve as useful complements to established participatory approaches, supporting efforts to ensure that research priorities remain informed by the lived experiences of the people most affected by illness.
Supplemental Material
Footnotes
Footnote Group
References
Untitled section
References
- 1.Maassen EF, Regeer BJ, Bunders JF, Regeer EJ, Kupka RW. A research agenda for bipolar disorder developed from a patients’ perspective. J Affect Disord. 2018;239:11–17. doi: 10.1016/j.jad.2018.05.061.
- 2.Maassen EF, Regeer BJ, Regeer EJ, Bunders JF, Kupka RW. The challenges of living with bipolar disorder: a qualitative study of the implications for health care and research. Int J Bipolar Disord. 2018;6(1):23. doi: 10.1186/s40345-018-0131-y.
- 3.Morton E, Foxworth P, Dardess P, et al. “Supporting Wellness”: a depression and bipolar support alliance mixed-methods investigation of lived experience perspectives and priorities for mood disorder treatment. J Affect Disord. 2022;299:575–584. doi: 10.1016/j.jad.2021.12.032.
- 4.Speirs B, Hanstock TL, Kay-Lambkin FJ. The lived experience of caring for someone with bipolar disorder: a qualitative study. PLoS One. 2023;18(1):e0280059. doi: 10.1371/journal.pone.0280059.
- 5.Grant A, Stage E, Blane D, et al. Four years in, what are the research priorities for long COVID? A research priority-setting partnership between people with lived experience, carers, clinicians and researchers. Health Expect. 2024;27(5):e70072. doi: 10.1111/hex.70072.
- 6.Younan E, McIntyre S, Garrity N, et al. Involving people with lived experience when setting cerebral palsy research priorities: a scoping review. Dev Med Child Neurol. 2025;67(6):725–733. doi: 10.1111/dmcn.16219.
- 7.Crowe S, Fenton M, Hall M, Cowan K, Chalmers I. Patients’, clinicians’ and the research communities’ priorities for treatment research: there is an important mismatch. Res Involv Engagem. 2015;1(2).
- 8.Tallon D, Chard J, Dieppe P. Relation between agendas of the research community and the research consumer. Lancet. 2000;355(9220):2037–2040. doi: 10.1016/S0140-6736(00)02351-5.
- 9.Alford K, Vera JH, Hammond J, Daley S. Understanding the lived experience research priorities for improving health-related quality of life in people living with HIV with cognitive impairment. HIV Res Clin Pract. 2024;25(1):2358724. doi: 10.1080/25787489.2024.2358724.
- 10.Fennig U, Yom-Tov E, Savitzky L, et al. Bridging the conversational gap in epilepsy: using large language models to reveal insights into patient behavior and concerns from online discussions. Epilepsia. 2025;66(3):686–699. doi: 10.1111/epi.18226.
- 11.Hara N, Abbazio J, Perkins K. An emerging form of public engagement with science: ask me anything (AMA) sessions on Reddit r/science. PLoS One. 2019;14(5):e0216789. doi: 10.1371/journal.pone.0216789.
- 12.Güell E, Benito-Amat C, Molas-Gallart J. Priority setting in mental health research: a scoping review of participatory methods. Ment Health Prev. 2023;30:200279. doi: 10.1016/j.mhp.2023.200279.
- 13.Boland M, Higgins A, Beecher C, et al. Identifying priorities for future research on reducing and stopping psychiatric medication: results of a James Lind Alliance priority-setting partnership. BMJ Open. 2024;14(11):e088266. doi: 10.1136/bmjopen-2024-088266.
- 14.Keller J, Herle M, Mandy W, Leno VC. The overlap of disordered eating, autism and ADHD: future research priorities as identified by adults with lived experience. Lancet Psychiatry. 2024;11(12):1030–1036. doi: 10.1016/S2215-0366(24)00186-X.
- 15.Doane MJ, Raymond K, Saucier C, et al. Unmet needs with antipsychotic treatment in schizophrenia and bipolar I disorder: patient perspectives from qualitative focus groups. BMC Psychiatry. 2023;23(1):245. doi: 10.1186/s12888-023-04746-4.
- 16.Bernhard B, Schaub A, Kümmler P, et al. Impact of cognitive-psychoeducational interventions in bipolar patients and their relatives. Eur Psychiatry. 2006;21(2):81–86. doi: 10.1016/j.eurpsy.2005.09.007.
- 17.Michalak EE, McBride S, Barnes SJ, et al. Bipolar disorder research 2.0: web technologies for research capacity and knowledge translation. J Eval Clin Pract. 2017;23(6):1144–1152. doi: 10.1111/jep.12736.
- 18.Loughhead M, Hodges E, McIntyre H, et al. Pathways for strengthening lived experience leadership for transformative systems change: reflections on research and collective change strategies. Health Expect. 2024;27(5):e70048. doi: 10.1111/hex.70048.
- 19.Manley GT, Dams-O’Connor K, Alosco ML, et al. A new characterisation of acute traumatic brain injury: the NIH-NINDS TBI classification and nomenclature initiative. Lancet Neurol. 2025;24(6):512–523. doi: 10.1016/S1474-4422(25)00154-1.
- 20.Morton E, Hole R, O’Brien H, Li L, Barnes SJ, Michalak EE. What influences engagement with a bipolar disorder self-management app? A qualitative investigation of use of the PolarUs app. PLOS Digit Health. 2025;4(10):e0001017. doi: 10.1371/journal.pdig.0001017.
- 21.Wright LA, Moore M, Reeves S, Vallejos EP, Morriss R. Improving the utility, safety, and ethical use of a passive mood-tracking app for people with bipolar disorder using coproduction: qualitative focus group study. JMIR Form Res. 2025;9(1):e65140. doi: 10.2196/65140.
- 22.Mensa-Kwao A, Neelakantan L, Velloza J, et al. An application of evidence-based approaches to engage young people in the design of a global mental health databank. Health Expect. 2024;27(5):e14172. doi: 10.1111/hex.14172.
- 23.Michalak EE, Jones S, Lobban F, et al. Harnessing the potential of community-based participatory research approaches in bipolar disorder. Int J Bipolar Disord. 2016;4(1):4. doi: 10.1186/s40345-016-0045-5.
- 24.Henson P, Barnett I, Keshavan M, Torous J. Towards clinically actionable digital phenotyping targets in schizophrenia. NPJ Schizophr. 2020;6(1):13. doi: 10.1038/s41537-020-0100-1.
- 25.Rosenblat JD, Simon GE, Sachs GS, et al. Treatment effectiveness and tolerability outcomes that are most important to individuals with bipolar and unipolar depression. J Affect Disord. 2019;243:116–120. doi: 10.1016/j.jad.2018.09.027.
- 26.Savitz ST, Lipschitz JM, Burdick KE, et al. BD2: a roadmap for learning health networks driving care improvement in bipolar disorder. J Affect Disord. 2025;385:119376. doi: 10.1016/j.jad.2025.05.036.
- 27.Todd NJ, Jones SH, Lobban FA. What do service users with bipolar disorder want from a web-based self-management intervention? A qualitative focus group study. Clin Psychol Psychother. 2013;20(6):531–543. doi: 10.1002/cpp.1804.
- 28.O’Donnell L, Johal PK, Mauer-Vakil D, et al. Consensus building in bipolar disorder: a scoping review of consensus methods. J Affect Disord. 2025;385:119339. doi: 10.1016/j.jad.2025.04.170.
- 29.Harvey D, Rayson P, Lobban F, Palmier-Claus J, Dolman C, Jones S. Navigating hypersexuality in bipolar: insights from a corpus-assisted discourse analysis of Reddit posts. INQUIRY. 2025;62:00469580251338565. doi: 10.1177/00469580251338565.
- 30.Pei Y, O'Brien KH. Use of social media data mining to examine needs, concerns, and experiences of people with traumatic brain injury. Am J Speech Lang Pathol. 2024;33(2):831–847. doi: 10.1044/2023_AJSLP-23-00297.
- 31.Sivaratnam S, Hwang K, Chee-A-Tow A, Ren L, Fang G, Jibb L. Using social media to engage knowledge users in health research priority setting: scoping review. J Med Internet Res. 2022;24(2):e29821. doi: 10.2196/29821.
- 32.Rohde JA, Liu J, Rees VW. Community and opinion leadership effects on vaping discourse: a network analysis of online Reddit threads. J Health Commun. 2023;28(2):487–497. doi: 10.1080/10810730.2023.2225447.
- 33.Sharp KJ, Vitagliano JA, Weitzman ER, Fitzgerald S, Dahlberg SE, Austin SB. Peer-to-peer social media communication about dietary supplements used for weight loss and sports performance among military personnel: pilot content analysis of 11 years of posts on Reddit. JMIR Form Res. 2021;5(10):e28957. doi: 10.2196/28957.
- 34.Basak M, Sharif O, Lord SE, et al. Information needs for opioid use disorder treatment using buprenorphine product: qualitative analysis of suboxone-focused Reddit data. J Med Internet Res. 2025;27(Suppl 3):e68886. doi: 10.2196/68886.
- 35.Bostock EC, Nevarez-Flores AG, Neil AL, Pontes HM, Kirkby KC. Self-induced mania methods and motivations reported in online forums: observational qualitative study. J Particip Med. 2024;16(1):e56970. doi: 10.2196/56970.
- 36.Nobles A, Dreisbach C, Keim-Malpass J, Barnes L. “Is this an STD? Please help!": Online information seeking for sexually transmitted diseases on Reddit. Proceedings of the International AAAI Conference on Web and Social Media; 2018.
- 37.Latack KR, Yuen F, Wang C, Nguyen BT. Online community queries on hormonal male contraception: an analysis of the Reddit “Ask Me Anything” experience. Contraception. 2021;104(2):159–164. doi: 10.1016/j.contraception.2021.02.009.
- 38.Lai D, Wang D, Calvano J, Raja AS, He S. Addressing immediate public coronavirus (COVID-19) concerns through social media: utilizing Reddit’s AMA as a framework for public engagement with science. PLoS One. 2020;15(10):e0240326. doi: 10.1371/journal.pone.0240326.
- 39.Kim S, Cha J, Kim D, Park E. Understanding mental health issues in different subdomains of social networking services: computational analysis of text-based Reddit posts. J Med Internet Res. 2023;25(1):e49074. doi: 10.2196/49074.
- 40.Harvey D, Rayson P, Lobban F, et al. Using natural language processing methods to build the hypersexuality in bipolar Reddit Corpus: infodemiology study of Reddit. JMIR Infodemiol. 2025;5(1):e65632. doi: 10.2196/65632.
- 41.Grootendorst M. BERTopic: Neural topic modeling with a class-based TF-IDF procedure. arXiv preprint arXiv:2203.05794. 2022.
- 42.Poh C, Head C, Nunez JJ, Lapadat L, Morton E, Michalak EE. 5 Years of bipolar disorder conversations on Reddit: methods, key topics and future directions. PLoS One. 2026;21(3):e0338622. doi: 10.1371/journal.pone.0338622.
- 43.McInnes L, Healy J, Melville J. Umap: uniform manifold approximation and projection for dimension reduction. arXiv preprint arXiv:1802.03426. 2018.
- 44.Simoudis E, Han J, Fayyad UM. A density-based algorithm for discovering clusters in large spatial databases with noise. Proceedings of the Second International Conference on Knowledge Discovery and Data Mining. AAAI Press; 1996.
- 45.Grootendorst M. KeyBERT: Minimal keyword extraction with BERT. 2020.
- 46.Pennington J, Socher R, Manning C. Glove: global vectors for word representation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP); 2014:1532–1543.
- 47.Gali N, Mariescu-Istodor R, Fränti P. Similarity measures for title matching. 2016 23rd International Conference on Pattern Recognition (ICPR). IEEE; 2016:1548–1553.
- 48.Brglez M. Dispersing the clouds of doubt: can cosine similarity of word embeddings help identify relation-level metaphors in Slovene? Proceedings of the 9th Workshop on Slavic Natural Language Processing 2023 (SlavicNLP 2023); 2023:61–69.
- 49.Rosner F, Hinneburg A, Röder M, Nettling M, Both A. Evaluating topic coherence measures. arXiv preprint arXiv:1403.6397. 2014.
- 50.Röder M, Both A, Hinneburg A. Exploring the space of topic coherence measures. Proceedings of the Eighth ACM International Conference on Web Search and Data Mining; 2015:399–408.
- 51.Stevens K, Kegelmeyer P, Andrzejewski D, Buttler D. Exploring topic coherence over many models and many topics. Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning; 2012:952–961.
- 52.Otto E, Culakova E, Meng S, et al. Overview of Sankey flow diagrams: focusing on symptom trajectories in older adults with advanced cancer. J Geriatr Oncol. 2022;13(5):742–746. doi: 10.1016/j.jgo.2021.12.017.
- 53.Aksoy C, Gökalp K. Self-management in bipolar disorder: a meta-synthesis of qualitative evidence. J Am Psychiatr Nurses Assoc. 2025;31(6):10783903251338450.
- 54.Michalak EE, Morton E, Barnes SJ, Hole R, BD C, Murray G. Supporting self-management in bipolar disorder: mixed-methods knowledge translation study. JMIR Ment Health. 2019;6(4):e13493. doi: 10.2196/13493.
- 55.Michalak EE, Suto MJ, Barnes SJ, et al. Effective self-management strategies for bipolar disorder: a community-engaged Delphi Consensus Consultation study. J Affect Disord. 2016;206:77–86. doi: 10.1016/j.jad.2016.06.057.
- 56.Pistollato F, Furtmann F, Gastaldello A, et al. Bridging the prevention gap: funding distribution and methodological shifts in prevention-focused biomedical research under EU framework programmes. J Transl Med. 2025;23(1):1006. doi: 10.1186/s12967-025-07019-8.
- 57.Mah H, Dobson R, Thomson A. The importance of lived experience: a scoping review on the value of patient and public involvement in health research. Health Expect. 2025;28(2):e70205. doi: 10.1111/hex.70205.
- 58.Gliniecka M. The ethics of publicly available data research: a situated ethics framework for Reddit. Social Media+ Society. 2023;9(3):20563051231192021. doi: 10.1177/20563051231192021.