跳至正文
OpenAgentSkill
浏览已开放 · 目录记录日期 2026-11-21 · 自动更新和账户服务暂时关闭。
开发与测试

statistical-analysis

Guided statistical analysis: test choice, assumption checks, effect sizes, power, APA reporting. Pick tests, verify assumptions, or format results for publication. Covers frequentist (t-test, ANOVA, chi-square, regression, correlation, survival, count, reliability) and Bayesian. Use statsmodels or pymc-bayesian-modeling to fit.

jaechang-hits · 已有 AI 审核记录

安装与使用

运行命令前先阅读来源与依赖说明。复制命令不会自动安装或执行。

npx skills add jaechang-hits/SciAgent-Skills --skill statistical-analysis

技能说明


name: statistical-analysis description: >- Guided statistical analysis: test choice, assumption checks, effect sizes, power, APA reporting. Pick tests, verify assumptions, or format results for publication. Covers frequentist (t-test, ANOVA, chi-square, regression, correlation, survival, count, reliability) and Bayesian. Use statsmodels or pymc-bayesian-modeling to fit. license: CC-BY-4.0

Statistical Analysis

Overview

Statistical analysis is the systematic process of selecting appropriate tests, verifying assumptions, quantifying effect magnitudes, and reporting results. This knowhow guides test selection, assumption diagnostics, and APA-style reporting for frequentist and Bayesian analyses in academic research.

Key Concepts

Frequentist vs Bayesian Framework

AspectFrequentistBayesian
Core outputp-value, confidence intervalPosterior distribution, credible interval
Interpretation"How likely is this data if H0 is true?""How likely is H1 given the data?"
Null supportCannot support H0 (only fail to reject)Can quantify evidence for H0 via Bayes Factor
Prior infoNot usedIncorporated via prior distributions
Sample sizeRequires adequate powerWorks with any sample size
Best forStandard analyses, large samplesSmall samples, prior info, complex models

Statistical vs Practical Significance

A statistically significant result (p < .05) may be trivially small in practice. Always report:

  • Effect size: Magnitude of the effect (Cohen's d, eta-squared, r, R-squared)
  • Confidence interval: Precision of the estimate
  • Context: Clinical/practical relevance in the domain

Common Effect Sizes

TestEffect SizeSmallMediumLarge
t-testCohen's d0.200.500.80
t-test (small n)Hedges' g0.200.500.80
ANOVAeta-squared partial0.010.060.14
ANOVAomega-squared0.010.060.14
Correlationr0.100.300.50
RegressionR-squared0.020.130.26
Regressionf-squared0.020.150.35
Chi-squareCramer's V0.070.210.35
Chi-square 2x2phi coefficient0.100.300.50

Cohen's benchmarks are guidelines, not rigid thresholds -- domain context always matters.

Assumptions Overview

Most parametric tests require:

  1. Independence: Observations are independent of each other
  2. Normality: Data (or residuals) are approximately normally distributed
  3. Homogeneity of variance: Groups have similar variances (for group comparisons)
  4. Linearity: Relationship between variables is linear (for regression)

When assumptions are violated:

  • Normality violated, n > 30: Proceed -- parametric tests are robust with large samples
  • Normality violated, n < 30: Use non-parametric alternative
  • Variance heterogeneity: Use Welch's correction (t-test) or Welch's ANOVA
  • Linearity violated: Add polynomial terms, transform variables, or use GAMs

Test-Specific Assumption Workflows

T-test assumptions: (1) Check normality per group with Shapiro-Wilk + Q-Q plots. (2) Check homogeneity with Levene's test. (3) If normality violated: Mann-Whitney U (independent) or Wilcoxon signed-rank (paired). If variance heterogeneity: use Welch's t-test.

ANOVA assumptions: (1) Normality per group. (2) Homogeneity via Levene's test. (3) For repeated measures: check sphericity (Mauchly's test); if violated, apply Greenhouse-Geisser (epsilon < 0.75) or Huynh-Feldt (epsilon > 0.75) correction. (4) If normality violated: Kruskal-Wallis (independent) or Friedman (repeated).

Linear regression assumptions: (1) Linearity via residuals-vs-fitted plot. (2) Independence via Durbin-Watson test (1.5-2.5 acceptable). (3) Homoscedasticity via Breusch-Pagan test + scale-location plot. (4) Normality of residuals via Q-Q plot + Shapiro-Wilk. (5) Multicollinearity via VIF (>10 = severe, >5 = moderate).

Logistic regression assumptions: (1) Independence. (2) Linearity of log-odds with continuous predictors (Box-Tidwell test). (3) No perfect multicollinearity (VIF). (4) Adequate sample size (10-20 events per predictor minimum).

Specialized Test Categories

Beyond the main decision flowchart, several specialized test families address specific data types:

Survival / time-to-event analysis:

  • Log-rank test: Compares survival curves between groups (non-parametric)
  • Cox proportional hazards: Models time-to-event with covariates; assumes proportional hazards
  • Parametric survival models: Weibull, exponential, log-normal for known distributional forms
  • Use when outcome is time until an event (death, relapse, failure) with possible censoring

Count outcome models:

  • Poisson regression: For count data where mean approximately equals variance
  • Negative binomial regression: For overdispersed counts (variance > mean)
  • Zero-inflated models: For excess zeros beyond what Poisson/NB predicts
  • Use when outcome is a count (number of events, incidents, occurrences)

Agreement and reliability:

  • Cohen's kappa: Inter-rater agreement for categorical ratings (2 raters)
  • Fleiss' kappa / Krippendorff's alpha: Agreement for >2 raters
  • Intraclass correlation coefficient (ICC): Continuous ratings reliability
  • Cronbach's alpha: Internal consistency of multi-item scales
  • Bland-Altman analysis: Agreement between two measurement methods (continuous)
  • Use when assessing measurement reliability or inter-rater consistency

Categorical data extensions:

  • McNemar's test: Paired binary outcomes (2x2)
  • Cochran's Q test: Paired binary outcomes (3+ conditions)
  • Cochran-Armitage trend test: Ordered categories in contingency tables

Decision Framework

Test Selection Flowchart

What is your research question?
|
+-- Comparing GROUPS on a continuous ou
阅读完整来源 ↗