REVIEWER 2 - CRITICAL REVIEW
================================================================================

**Reviewer 2 Report**
**Manuscript ID:** [Withheld]
**Title:** WHEN SEEING IS BELIEVING: PERSONAL OBSERVATION VERSUS SCIENTIFIC CONSENSUS IN FLAT EARTH DISCOURSE
**Venue:** Tier-1 Interdisciplinary Journal (e.g., Nature Human Behaviour, PNAS)

---

### **1. Overall Impression**

My immediate reaction is one of significant skepticism regarding the paper's novelty and methodological rigor. The manuscript presents a well-written, multidisciplinary synthesis of existing literature on science denial, conspiracy beliefs, and digital media, using Flat Earth belief as a case study. It introduces the potentially useful concepts of "epistemic prioritization" and "communicative double bind."

However, the core feeling is that this is **an incremental synthesis paper masquerading as a novel empirical or theoretical contribution.** The work reads more like a comprehensive literature review or a position paper than a primary research article suitable for a Tier-1 venue. The central weakness is the complete lack of new data. The authors' "method" is a literature synthesis, but they fail to conduct a systematic review or meta-analysis, instead offering a curated, narrative summary. The claims, while interesting, are largely extrapolations from studies on *other* topics (e.g., climate change, vaccines) applied to the Flat Earth context, with limited direct evidence presented from the Flat Earth domain itself.

**First Impression Strengths:**
*   Clearly written and logically structured.
*   Identifies a socially relevant and intellectually interesting epistemic problem.
*   Attempts to integrate concepts from cognitive psychology, science communication, and media studies.

**First Impression Concerns:**
*   **Lack of Original Data/Evidence:** No new experiments, surveys, or content analyses. The "results" are a repackaging of others' findings.
*   **Overstated Novelty:** The concepts of "epistemic prioritization" and "double bind," while nicely framed, are not fundamentally new. They are refinements of well-established ideas like motivated reasoning, source credibility, and identity-protective cognition.
*   **Methodological Vagueness:** The "synthesis" methodology is inadequately described and lacks the rigor of a formal systematic review (no PRISMA flow diagram, no quality assessment of included studies, no quantitative synthesis).
*   **Questionable Generalizability:** The paper heavily relies on the Flat Earth case, a fringe belief with potentially unique dynamics, to make grand claims about "broader crises of epistemic authority."

---

### **2. Technical & Scientific Assessment**

**A. Problem Definition (Score: 3/5)**
The research question is clearly motivated and non-trivial. The conflict between lived experience and expert consensus is a genuine issue in science communication. However, the motivation for *another* paper on this, using a literature review method without novel data, is not convincingly argued for a top-tier journal.

**B. Methodological Soundness (Score: 1/5)**
**Unacceptable for a primary research article.** The chosen method—a narrative synthesis of existing literature—is appropriate for a review paper but not for claiming new research findings. The description in Section 4 is critically flawed:
*   **No Systematic Protocol:** Search terms, databases, date ranges are mentioned but without the detail needed for replication. Where is the full search string?
*   **No Inclusion/Exclusion Justification:** Why 2000-2024? What specific databases? How was study quality assessed?
*   **No Transparency:** The "structured spreadsheet" and "thematic synthesis tables" are not provided in the supplement. The reader cannot evaluate the selection or interpretation of sources.
*   **Cherry-picking Risk:** With 13 RQs, the authors could easily have selected studies that fit their proposed framework without acknowledging contradictory evidence. The claim to include "both studies that support and contradict common assumptions" is not demonstrable without a full list of analyzed studies.
*   **"Breadth over Depth" Justification is Weak:** Arguing that 13 RQs necessitate a synthesis is a confession that the paper is overly broad and superficial. A focused, original experiment on 1-2 key RQs would be more impactful.

**C. Results & Evidence (Score: 2/5)**
The "results" are not the authors' results; they are summaries of prior work. Tables 1-4 present claims (e.g., "Personal-observation arguments are more persuasive...") but cite broad categories ("Studies testing YouTube Flat-Earth arguments") or classic psychology papers (Hasher et al., 1977) rather than specific, recent empirical tests *within the Flat Earth domain*. The link between cited evidence (e.g., Kahan et al. on climate change) and the Flat Earth case is asserted, not demonstrated. There is a significant **exaggeration** in presenting this synthesis as a set of new findings.

**D. Contribution to the Field (Score: 2/5)**
The contribution is primarily **integrative and conceptual**, not empirical. Framing the issue through "epistemic prioritization" is a modest theoretical advance. However, for a Tier-1 journal, a conceptual contribution must be groundbreaking, which this is not. It is unlikely this paper would be cited for a new discovery; it would be cited as a useful review. The claim that it provides "a model for analyzing other contested knowledge domains" is overstated without validation.

**E. Writing & Presentation (Score: 4/5)**
The paper is generally well-written, organized, and clear. Figures/Tables are helpful but simplistic, summarizing text rather than presenting complex data.

**F. Ethical & Transparency Standards (Score: 1/5)**
**Major transparency failure.** For a synthesis paper, ethical practice mandates public availability of the systematic review data: the full list of included/excluded studies, the data extraction spreadsheet, and the synthesis protocol. None are provided. This makes the work irreproducible. There is no evidence of misconduct, but the lack of transparency is a fatal flaw for a research publication claiming these synthesized results.

---

### **3. Strengths**
*   Clear articulation of a complex, interdisciplinary problem.
*   Effective framing using the Flat Earth case as a vivid illustration.
*   Good integration of terminology from multiple fields (conspiracy mentality, cultural cognition, illusory truth effect).
*   The discussion sections are thoughtful and highlight important implications for science communication.

---

### **4. Weaknesses**

**Major Flaws:**
1.  **No Original Research:** The paper presents zero new empirical evidence. It is a review, not a research article.
2.  **Non-Systematic, Non-Transparent Methodology:** The synthesis method is described with insufficient rigor to be evaluated or replicated. Key materials are not shared.
3.  **Overstated Claims of Novelty and Generality:** The paper sells itself as uncovering new mechanisms and providing a general model, but its conclusions are extrapolations from indirect evidence.
4.  **"Kitchen Sink" Approach with 13 RQs:** Leads to superficial treatment of each. Depth is sacrificed for breadth.

**Minor Flaws:**
*   References are cut off (Trench, 2008 is incomplete).
*   Some phrasing is repetitive (e.g., constant re-use of "epistemic prioritization and communicative double bind").
*   Table evidence is vague (e.g., "Survey and ethnographic data show..." without specific citations in the table).

---

### **5. Recommendations for Improvement**

**To be acceptable as a *Research Article* in a future submission, the authors must:**
1.  **Conduct Original Empirical Work:** Design and execute at least one rigorous experiment or substantial content analysis that **directly tests** a key hypothesis derived from their framework (e.g., RQ1 or RQ10). For example, an experiment manipulating message frame (personal observation vs. consensus vs. hybrid) and measuring belief change and reactance among participants stratified by conspiracy mentality.
2.  **Or, Reformulate as a Proper Systematic Review/Meta-Analysis:** If they wish to keep the synthesis approach, they must:
    *   Adhere to PRISMA guidelines.
    *   Publish a detailed protocol.
    *   Conduct a comprehensive, reproducible search.
    *   Perform a formal quality assessment of included studies.
    *   If possible, conduct a meta-analysis to quantify effects.
    *   **Make all data (study lists, extraction sheets) publicly available.**
    *   Submit to a journal specializing in review articles.

**Specific Revisions Required for Resubmission Here:**
*   Drastically reduce the scope from 13 RQs to 2-3 core, testable hypotheses.
*   Replace Section 4 with a standard Methods section for an original experiment/survey/content analysis.
*   Replace Section 5 with original results, including appropriate inferential statistics.
*   Scale back the discussion and conclusions to match the new, narrower empirical findings.
*   Ensure all references are complete.

---

### **6. Verdict**

**Overall Score: 1.5/5**
**Categorical Recommendation: WEAK REJECT (leaning towards Strong Reject due to fundamental methodological mismatch).**

**Justification:**
This manuscript is **fundamentally flawed in its current form for publication as a research article** in a Tier-1 journal. Its core weakness is the absence of novel empirical evidence and the use of an inadequately documented, non-transparent literature synthesis as a substitute for primary research. The authors have identified an interesting framework, but they have not *tested* it. The burden of proof for claims about how Flat Earth belief operates requires direct investigation, not just the application of theories from adjacent domains.

The paper's potential lies in its conceptual framing. However, in its present state, it is a well-written review paper submitted to the wrong type of venue. I recommend **rejection**, but with the clear feedback that the authors could develop a strong, publishable study by using their framework to generate and test specific hypotheses with original data. The path to acceptance requires a fundamental shift from synthesis to primary empirical research.