Pre-Submission Review for Psychology Papers

Psychology reviewers often ask:

• does the design actually test the psychological claim?
• are participants, sampling, exclusions, and attrition described clearly?
• are measures valid for the construct being argued?
• is the analysis plan transparent enough to limit researcher degrees of freedom?
• are power, effect size, uncertainty, and multiple comparisons handled honestly?
• are data, materials, preregistration, and scripts available or properly constrained?
• do the conclusions match the results rather than the hoped-for theory?
• does the paper fit Psychological Science, an APA journal, a specialty journal, or a broader behavioral-science venue?

The manuscript has to make the inference believable.

In our pre-submission review work, psychology papers most often fail when the theoretical claim is cleaner than the empirical design.

Construct-measure gap: the manuscript argues about anxiety, identity, attention, bias, motivation, learning, or decision-making, but the measure captures only a narrow proxy.

Flexibility signal: exclusions, transformations, covariates, subgroup analyses, or exploratory models appear after the fact without enough transparency.

Power overconfidence: a small or noisy study is written as if it provides a stable effect estimate.

Conclusion inflation: statistically fragile results are used to make broad claims about people, institutions, cultures, or interventions.

Transparency gap: data, materials, preregistration, or analysis scripts are missing, inaccessible, or too poorly documented for review.

A useful review should identify the first psychology-specific objection that would make reviewers distrust the inference.

Psychological Science lists desk-rejection reasons that include narrow scope, poor writing, insufficient methodological rigor, insufficient transparency, overclaiming, mismatch between aims and design, mismatch between results and conclusions, signs of flexibility in data collection or analysis, and high risk of statistical inference error. It also requires empirical manuscripts to include a research transparency statement covering preregistration, materials, data, analysis scripts, AI use, conflicts, and funding.

APA Journal Article Reporting Standards give psychology authors a reporting framework for quantitative, qualitative, meta-analytic, and mixed-methods research. EQUATOR also indexes psychology reporting standards, including JARS-Qual and mixed-methods reporting material.

These policies turn transparency into a submission-readiness issue, not a cosmetic one.

Send the manuscript, target journal, study protocol, preregistration link if any, participant and exclusion flow, measure documentation, materials, manipulation checks, analysis script, data dictionary, power analysis, model outputs, qualitative coding materials if applicable, transparency statement draft, figures, supplement, and prior reviewer comments.

For multi-study papers, include a map of which study supports which claim. For qualitative psychology papers, include sampling logic, reflexivity, coding process, and evidence table. For meta-analyses, include search strategy, inclusion criteria, coding sheet, and risk-of-bias approach.

A useful psychology pre-submission review should include:

• design-to-claim verdict
• construct and measure critique
• participant, exclusion, and sampling review
• statistical inference and transparency check
• APA JARS or journal-reporting readiness note
• overclaiming and discussion-risk review
• journal-lane recommendation
• submit, revise, retarget, or diagnose deeper call

The review should not only say "add limitations." It should identify the exact inference reviewers will not buy.

Before submission, authors often need to:

• tighten the theory claim to match the design
• clarify participant sampling, exclusions, and attrition
• add measure validity and reliability detail
• label exploratory analyses honestly
• document data, materials, scripts, and preregistration
• reduce causal language in observational studies
• explain null results and uncertainty without spin
• retarget from a general psychology journal to a specialty, clinical, developmental, cognitive, social, or methods venue

These fixes make the psychology claim easier to evaluate.

An experimental psychology paper needs design control, manipulation validity, and inference restraint. A survey paper needs construct clarity, sampling logic, and model transparency. A developmental paper needs age, context, consent, and measurement fit. A clinical psychology paper needs participant characterization, intervention or assessment logic, and ethical framing. A qualitative psychology paper needs sampling, reflexivity, coding, and evidence traceability. A replication paper needs fidelity to the original design and a clear statement of what the replication can and cannot decide.

The AI manuscript review can flag whether the blocking risk is construct fit, statistical inference, transparency, reporting, or journal fit.

Use this page when the manuscript's submission risk depends on psychological theory, behavior, cognition, emotion, perception, personality, development, social processes, measurement, or psychology-journal transparency. Use psychiatry review when diagnosis, treatment, clinical symptoms, medications, patient outcomes, or medical psychiatry journals dominate. Use education research review when schools, learning systems, curriculum, or policy are the core setting.

That distinction keeps the page focused on the psychology buyer's actual problem.

Do not submit a psychology paper if the study design cannot support the psychological claim. A clever idea will not survive if the measure, sample, or analysis only tests a weaker version of the theory.

Also pause if transparency materials are not ready. Data, code, materials, preregistration, and a README can change how editors and reviewers judge credibility.

For multi-study papers, pause if the studies do not build a coherent evidence chain. Three studies with different samples and measures can look like breadth, but reviewers may see a moving target.

For observational papers, pause if causal language appears before the design earns it. Reviewers will often forgive modest claims faster than inflated ones.