Commit Analysis & Regression Detection

Overview

Automated tools for detecting regressions and analyzing code changes:

Tool Purpose Speed

scripts/smart_commit_analyzer.py Auto-evolving regression detection Fast

scripts/analyze_commits_ai.py AI semantic analysis (DeepSeek) Slow

scripts/analyze_git_changes.py Git history statistics Fast

Recommended Tool: smart_commit_analyzer.py

This is the primary regression detection tool. Rules are automatically generated from git history.

Commands

Full analysis (update rules + validate)

python3 scripts/smart_commit_analyzer.py

Update rules only (scan git for new fixes)

python3 scripts/smart_commit_analyzer.py --update

Validate only (check existing rules)

python3 scripts/smart_commit_analyzer.py --validate

Show all rules

python3 scripts/smart_commit_analyzer.py --show-rules

JSON output (for CI/CD)

python3 scripts/smart_commit_analyzer.py --json

Expected Output

🔍 Smart Commit Analyzer

Step 1: 从 Git 历史更新规则库... 📊 扫描到 78 个修复提交 ✅ 新增 5 条规则

Step 2: 验证所有规则...

============================================================ 📋 验证结果

✅ 通过: 70 ❌ 失败: 2 ⚠️ 警告: 3 ⏭️ 跳过: 0

How It Works

┌─────────────────────────────────────────────────────────┐ │ Step 1: git log --grep="fix" │ │ → Auto-discover all fix commits │ └─────────────────────────────────────────────────────────┘ ↓ ┌─────────────────────────────────────────────────────────┐ │ Step 2: git show <commit> -- <file> │ │ → Extract key code patterns from diffs │ └─────────────────────────────────────────────────────────┘ ↓ ┌─────────────────────────────────────────────────────────┐ │ Step 3: Save to configs/auto_generated_rules.json │ │ → Rules auto-grow with new fix commits │ └─────────────────────────────────────────────────────────┘ ↓ ┌─────────────────────────────────────────────────────────┐ │ Step 4: Validate all rules │ │ → Detect regressions (missing patterns) │ └─────────────────────────────────────────────────────────┘

AI Deep Analysis (Optional)

Requires DEEPSEEK_API_KEY environment variable.

Analyze last 10 commits with AI

python3 scripts/analyze_commits_ai.py --commits 10

JSON output

python3 scripts/analyze_commits_ai.py --commits 10 --json

Git History Analysis

Analyze last 50 commits

python3 scripts/analyze_git_changes.py

Show only fix commits

python3 scripts/analyze_git_changes.py --fix-only

Analyze more commits

python3 scripts/analyze_git_changes.py --commits 100

GitHub Actions Integration

These tools run automatically on every push/PR via .github/workflows/commit-analysis.yml :

Job Tool Trigger

Smart Regression Detection scripts/smart_commit_analyzer.py Always

AI Deep Analysis scripts/analyze_commits_ai.py If DEEPSEEK_API_KEY set

Key Files

File Purpose

scripts/smart_commit_analyzer.py

Main regression detection tool

configs/auto_generated_rules.json

Auto-generated validation rules

scripts/analyze_commits_ai.py

AI-powered analysis

scripts/analyze_git_changes.py

Git history parser

.github/workflows/commit-analysis.yml

GitHub Actions workflow

When to Run

• Before committing: python3 scripts/smart_commit_analyzer.py

• Before merging PR: Automatic via GitHub Actions

• After pulling updates: python3 scripts/smart_commit_analyzer.py --validate

• Investigating regressions: python3 scripts/smart_commit_analyzer.py --show-rules

Interpreting Results

Status Meaning Action

✅ Passed Pattern found in code None

❌ Failed Pattern missing (potential regression) Investigate

⚠️ Warning Pattern may have been refactored Review

⏭️ Skipped File not found (renamed/deleted) Update rules