regression-test

Comprehensive testing checklist for voxtype releases.

Safety Notice

This listing is imported from skills.sh public index metadata. Review upstream SKILL.md and repository scripts before running.

Copy this and send it to your AI assistant to learn

Install skill "regression-test" with this command: npx skills add peteonrails/voxtype/peteonrails-voxtype-regression-test

Regression Test

Comprehensive testing checklist for voxtype releases.

Note: For detailed manual smoke tests (recording cycles, GPU isolation, output drivers, etc.), see docs/SMOKE_TESTS.md. Run those tests for thorough pre-release validation.

Quick Smoke Test

Build and basic checks

cargo build --release ./target/release/voxtype --version ./target/release/voxtype --help ./target/release/voxtype setup --help

Unit Tests

cargo test

Key test modules:

  • text::

  • Spoken punctuation and replacements

  • cli::

  • Command-line argument parsing

  • state::

  • State machine transitions

CLI Command Tests

Setup Commands

List available models

./target/release/voxtype setup --list-models

Show current configuration

./target/release/voxtype setup --show-config

Check GPU detection (if available)

./target/release/voxtype setup gpu --status

Status Commands

Check daemon status (will fail if not running, that's ok)

timeout 2 ./target/release/voxtype status || echo "Daemon not running (expected)"

JSON output format

timeout 2 ./target/release/voxtype status --format json || echo "Daemon not running (expected)"

Transcription Test

Test with a sample audio file (if available)

./target/release/voxtype transcribe test.wav

Configuration Tests

Default Config Loading

Should not error with missing config

rm -f ~/.config/voxtype/config.toml ./target/release/voxtype --help

Should load config without errors

mkdir -p ~/.config/voxtype cp config/default.toml ~/.config/voxtype/config.toml ./target/release/voxtype setup --show-config

Config Backwards Compatibility

Test that old config files still work:

Create minimal old-style config

cat > /tmp/test-config.toml << 'EOF' [hotkey] key = "SCROLLLOCK"

[whisper] model = "base.en" EOF

Should not error

./target/release/voxtype --config /tmp/test-config.toml --help

Binary Variant Tests

For each binary variant, verify:

VERSION=0.4.14

AVX2

releases/${VERSION}/voxtype-${VERSION}-linux-x86_64-avx2 --version releases/${VERSION}/voxtype-${VERSION}-linux-x86_64-avx2 --help

AVX-512

releases/${VERSION}/voxtype-${VERSION}-linux-x86_64-avx512 --version releases/${VERSION}/voxtype-${VERSION}-linux-x86_64-avx512 --help

Vulkan

releases/${VERSION}/voxtype-${VERSION}-linux-x86_64-vulkan --version releases/${VERSION}/voxtype-${VERSION}-linux-x86_64-vulkan --help

Integration Tests

Daemon Lifecycle

Start daemon

./target/release/voxtype & DAEMON_PID=$! sleep 2

Check it's running

./target/release/voxtype status

Stop daemon

kill $DAEMON_PID

Signal Handling

./target/release/voxtype & DAEMON_PID=$! sleep 1

SIGUSR1 should start recording (will fail without audio, ok)

kill -USR1 $DAEMON_PID

SIGTERM should graceful shutdown

kill -TERM $DAEMON_PID

Package Tests

Debian Package

Validate structure

dpkg-deb --info releases/${VERSION}/voxtype_${VERSION}-1_amd64.deb

List contents

dpkg-deb --contents releases/${VERSION}/voxtype_${VERSION}-1_amd64.deb

Check for required files

dpkg-deb --contents releases/${VERSION}/voxtype_${VERSION}-1_amd64.deb | grep -E 'voxtype-avx2|voxtype-avx512|config.toml|voxtype.service'

RPM Package

rpm -qp --info releases/${VERSION}/voxtype-${VERSION}-1.x86_64.rpm rpm -qp --list releases/${VERSION}/voxtype-${VERSION}-1.x86_64.rpm

Checklist for Major Releases

  • cargo test passes

  • cargo clippy has no warnings

  • All binary variants build successfully

  • Binary instruction validation passes (no AVX-512 in AVX2/Vulkan)

  • Version numbers match across all binaries

  • CLI --help output is correct

  • Default config loads without errors

  • Old configs still work (backwards compatibility)

  • Packages install correctly on target distros

  • Daemon starts and stops cleanly

  • Recording/transcription works end-to-end (manual test)

Known Test Limitations

  • Audio capture requires real audio hardware (can't fully test in CI)

  • evdev hotkey detection requires /dev/input access

  • Transcription requires downloaded Whisper model

  • GPU acceleration requires Vulkan-capable hardware

Source Transparency

This detail page is rendered from real SKILL.md content. Trust labels are metadata-based hints, not a safety guarantee.

Related Skills

Related by shared tags or category signals.

General

package-release

No summary provided by upstream source.

Repository SourceNeeds Review
General

docker-test

No summary provided by upstream source.

Repository SourceNeeds Review
General

update-docs

No summary provided by upstream source.

Repository SourceNeeds Review