RESEARCH DISCIPLINE
Statistical Analysis for Cognitive Psychology Research
Consulting for Experimental & Behavioral Studies
Cognitive psychology statistical analysis for reaction-time, accuracy and memory experiments, with trials, stimuli and participants modeled in the structure the design creates, outlier rules set in advance and results prepared to the standard your journal expects.
No Commitment Required
Strictly Confidential
In-House PhD-Level Statisticians
Fixed Project Fee
Same-Day Response
Statistical Analysis for Cognitive Psychology Research
Cognitive psychology statistical analysis is the statistical design, analysis and reporting of experiments on attention, memory, language and decision making, in which each participant responds to many stimuli, each stimulus is seen by many participants, and outcomes such as reaction times are skewed and cannot fall below zero. Every row of trial-level data therefore belongs to a participant and to an item, so a workflow that averages the trials without checking what is lost, or treats every trial as an independent observation, gives either wasted information or an inflated sample. OnlineSPSS, a specialist statistical consultancy for academic, clinical and professional research, provides cognitive data analysis through in-house PhD-level statisticians, who settle the unit of analysis, the random-effects structure and the exclusion rules with you before the models are fitted.
WHEN TO ENGAGE
Statistical Support at Different Stages of Cognitive Psychology Research
Researchers usually contact us at a recognizable point in an experimental project, from the first design questions to a reviewer's request for a different model.
Planning a Within-Subject Experiment You are designing a task and need the number of trials, items and participants, the planned contrasts and the exclusion rules decided, with power examined for the model you will fit.
Analyzing Trial-Level Data Your trial-by-trial responses are collected, and the treatment of skewed reaction times, errors and the participant and item structure must be chosen, run and checked.
Preparing an Experimental Manuscript The results need effect estimates with intervals, a clear account of exclusions and a methods paragraph prepared to the APA reporting standards and the open-science policy of your target journal.
Reanalyzing After Reviewer Feedback A reviewer has asked for item effects, a different treatment of outliers or a mixed-effects model in place of by-participant averages, and the analysis must be redone and reported.
RESEARCH CONTEXT
Research Designs and Data We Work With in Cognitive Psychology
These are the datasets that cognitive experiments produce, and nearly all of them hold many observations for each participant and each stimulus.
01
Reaction-Time Experiments
Trial-by-trial latencies from lexical decision, priming, Stroop or similar tasks, where each participant contributes hundreds of trials across a set of items.
02
Accuracy and Detection Data
Correct and incorrect responses, or hits and false alarms from recognition and detection tasks, from which sensitivity and response bias can be derived.
03
Memory and Learning Studies
Recall or recognition measured across blocks, delays or learning trials, with performance that changes systematically over the session.
04
Eye-Movement and Time-Course Data
Fixations, pupil size or other samples recorded continuously within each trial, where neighboring time points are strongly autocorrelated.
05
Individual-Differences Task Batteries
Several tasks completed by the same participants to relate performance across tasks, where the reliability of each task score limits what can be learned.
06
Online and Crowdsourced Experiments
Browser-based tasks run on large samples, with attention checks, device differences in timing and exclusion decisions that must be justified.
METHODOLOGICAL CONSIDERATIONS
Statistical Issues We Consider in Cognitive Psychology Research
These are the checks made in cognitive experiment statistics before any effect is reported, because the treatment of items, outliers and skew can change a conclusion more than the test chosen.
Participants and Items Together Where the stimuli are a sample of a wider set, both participants and items are treated as random, otherwise the conclusion holds only for the items used.
Skewed Response Times Reaction times are right-skewed with a positive lower bound. A model for skewed data or a transformation is chosen and justified, because the scale on which an effect is measured changes its meaning.
Exclusion Rules in Advance Cutoffs for anticipations, lapses and inaccurate participants can alter results materially. They are fixed before the data are seen, applied to every condition alike and tested by showing results without them.
Averaging or Trial-Level Models Averaging trials into cell means discards variability and item effects, while treating every trial as independent inflates the apparent sample. The model is matched to the question and the design.
Random-Effects Structure A model with all the random slopes the design suggests can fail to converge in a small experiment. The simplification is documented, and singular fits are reported, not quietly dropped.
Reliability of Task Scores A task can show a robust group effect yet measure individuals poorly, so correlations between task scores are read against their estimated reliability, and a difference score is used with caution.
STATISTICAL METHODS
Methods Selected for the Research Question and Study Design
Each method family follows the outcome and the data structure of your experiment, and the line under each title explains why it suits cognitive data.
Longitudinal & Multilevel Analysis
Trials nested within participants and items are modeled with random effects for each, and binary accuracy is modeled on the logit scale at trial level, not averaged into percentages.
Comparative & Hypothesis Testing
A simple, balanced within-subject design can be analyzed with participant means, reported with the difference, its interval and an effect size, and with an item analysis alongside.
Regression & Predictive Modeling
Intrusions in free recall have no fixed maximum, so they are modeled as counts, and curves that change over a trial or a session are fitted flexibly, not assumed linear.
Bayesian & Computational Methods
Power for a mixed-effects design is examined by simulation, and Bayesian estimation can stabilize a model that fails to converge with the full random-effects structure.
Multivariate, Scale & Reliability
The reliability of a task score is estimated, for example by split-half or intraclass correlation, before scores from different tasks are correlated.
Structural & Latent Variable Modeling
Several tasks that tap the same ability can be combined into a latent variable, which removes part of the task-specific noise from the relation with other measures.
DELIVERABLES
Statistical Outputs Prepared for Your Research
The outputs follow the structure of a cognitive experiment, from the review of the trial file to the scripts that regenerate every reported value.
Data & Study Review The trial-level file, the coding of conditions, items and participants, the exclusion rules and the distribution of responses are reviewed before any model is fitted.
Statistical Analysis The agreed mixed-effects or participant-level models with residual and convergence diagnostics, the planned contrasts and the analyses with and without the exclusion rules.
Effect Estimates & Uncertainty Condition differences on an interpretable scale, such as milliseconds or log-odds, with confidence intervals, effect sizes and the variance components of participants and items.
Tables & Figures Model summary tables, condition means with intervals, accuracy and latency plots and time-course curves, formatted to the target journal.
Statistical Interpretation Each effect is explained in cognitive terms within what the design supports, with the generalization to new participants and new items stated as the model allows.
Analysis Files R or Python scripts, SPSS syntax or Stata do-files with the exclusion rules and model formulas documented, so that every figure and table can be regenerated.
REPORTING
Reporting Cognitive Psychology Research
Experimental psychology journals care about transparency, so the reporting covers the analysis decisions as well as the estimates.
Manuscripts follow APA 7 and the JARS-Quant standard, which ask for the sample, the exclusions, the design and the analysis to be described in full. The number of trials and items, the exclusion rules and how many observations each removed are stated, the model formula and random-effects structure are given, and any simplification for convergence is reported. Where a journal applies the TOP Guidelines, preregistration, data and code availability are described to its level, and deviations from a preregistered plan are listed. Condition effects are reported with confidence intervals on a stated scale, so the manuscript and the output agree.
ILLUSTRATIVE EXAMPLE
How the Analysis May Look in Practice
An illustration of how a within-subject experiment moves from raw trials to a defensible, reportable result.
ILLUSTRATIVE EXAMPLE · READING AND LANGUAGE RESEARCH · UNITED STATES
A language research group ran a lexical decision experiment in which every participant saw words in two priming conditions, and the group had planned a paired comparison of participant means.
Different words appeared in the two conditions, and reaction times were skewed. Before the outcomes were examined, we set the analysis in writing: a mixed model of trial-level log reaction times with random intercepts for participants and words and a by-participant random slope for condition, simplified in a stated order if the fit became singular. Accuracy was modeled with a logistic mixed model. The cutoffs for very short and very long responses were fixed first, and the results were also shown without them. The effect was reported as a ratio of geometric mean reaction times with its interval, and translated into milliseconds at the average latency for readers.
Outcome: The group received the condition effect as a ratio of reaction times with its 95% confidence interval and its size in milliseconds, the accuracy effect as an odds ratio with its interval, variance components, exclusion counts, a methods paragraph and the scripts.
This example does not describe a real client or project. We never share details of actual client work, in line with the confidentiality we promise every researcher. This illustrative example is included to show the type, scope, and standard of work involved in this kind of analysis.
RESEARCHER VOICE
What Researchers Say
Feedback from a cognitive psychology researcher on the clustered structure of experimental data, and on tables and interpretation written for the research context.
“Our project had a very field-specific problem around the clustered structure of the data rather than treating every row as independent. The team understood why it mattered in Cognitive Psychology and chose the analysis accordingly. The final tables and interpretation felt written for our research context rather than copied from a generic statistics template.”
HOW WE ASSESS YOUR PROJECT
We Review Your Actual Research
Your assessment is based on a review of your actual research materials and analytical requirements, not a generic project category.
You Submit Your Project Details
Share whatever is available at the current stage, such as the research aim, protocol or proposal, dataset, variable list, manuscript or statistical requirements.
We Review Your Research and Define the Scope
Your statistically trained Research Coordinator reviews the materials to understand the study design, research questions, data structure, analytical requirements and expected deliverables. If clarification is needed, additional documents or information can be requested before the assessment is finalized.
Your Analysis Is Completed and Delivered
Once the scope and fixed project fee are agreed, the in-house statistician completes the work and the Research Coordinator remains the communication point through delivery, with the analysis, deliverables and timeline as agreed.
SOFTWARE
Statistical Software for Cognitive Psychology Research
Cognitive experiments are analyzed in the software your laboratory already uses, with scripts provided where applicable.
Statistical Support Within Your Research OnlineSPSS provides the agreed methodological, analytical, and statistical reporting support. The researcher or research team retains the scientific question, substantive interpretation, conclusions, and overall responsibility for the research.
FREQUENTLY ASKED QUESTIONS
Questions About Statistical Analysis for Cognitive Psychology
Short answers to what experimental researchers ask before sharing a project, from reaction-time models and exclusions to power, review and confidentiality.
What statistical methods are used in cognitive psychology research?
Cognitive experiments most often use linear and generalized linear mixed-effects models for trial-level latencies and accuracy, repeated-measures comparisons of participant means, and signal detection measures for recognition tasks, chosen by the design and the outcome. Our Statistical Methods pages show how each family is applied.
Should I average my trials or analyze every trial?
Averaging trials is defensible when the design is simple and balanced, but it discards variability and cannot represent differences between items. A trial-level mixed model uses all the data and treats participants and items as random where both are samples. Where the two approaches agree, that is reported, and where they differ, the reason is explained.
Do I need to transform or trim my reaction times?
Reaction time analysis usually starts from the fact that latencies are skewed, so a transformation or a model for skewed data is considered, and the choice is justified because it changes the scale of the effect. Trimming and a skewed-data model are both reported where they could matter: if they agree, the result does not depend on the rule, and if they differ, the difference is shown and explained.
How many participants and trials does my experiment need?
For a mixed-effects design, power depends on the number of participants, the number of items, the trials per condition and the variance of the effect across participants. We examine it by simulation from pilot or published estimates, and report the assumptions, so the sample is justified for the model you will fit.
How is confidential research data handled?
Study datasets, protocols and analysis files are handled confidentially, and project information is not published. An NDA is available where required and can be arranged before sensitive materials are shared. Read more about confidentiality and data security.
What happens when I request an assessment, and how long does it take?
You share your research question, design and relevant materials, and a statistically trained Research Coordinator reviews the request and responds the same day. The analysis, deliverables, timeline and one fixed project fee are then confirmed before any work begins, so the timeline follows from the agreed scope.
Still have a question? Find more answers in our full FAQ.
NEXT STEP
Discuss Your
Cognitive Psychology Research With Us
Share your research question, design and available data, even if only a task description or pilot data exist. We review the trial structure and confirm the approach before any work begins.
No Commitment Required
Strictly Confidential
Fixed Project Fee
In-House PhD-Level Statisticians
Same-Day Response
Serving Researchers Since 2014