voice_audio_multi/docs/models/ast_audioset.md
Fabio c36510c21e
Some checks failed
Linux Build / Linux cpu (push) Has been cancelled
Linux Build / Linux cpu-clang (push) Has been cancelled
Linux Build / Linux vulkan (push) Has been cancelled
mac-build / macOS CPU (push) Has been cancelled
Nix Build / Nix (cpu) (push) Has been cancelled
Nix Build / Nix (vulkan) (push) Has been cancelled
windows-build / Windows CPU (push) Has been cancelled
Initial import: audio.cpp with Orange Pi documentation
2026-11-04 19:05:22 +01:00

1.3 KiB

AST AudioSet

AST AudioSet classifies an audio file into the 527 sound classes used by AudioSet. It uses the MIT ast-finetuned-audioset-10-10-0.4593 checkpoint. The default self-contained package is AST-AudioSet-GGUF/ast-audioset-f32.gguf under audio-cpp/audio.cpp-gguf. Only F32 is packaged.

build/debug/bin/audiocpp_cli \
  --task cls \
  --family ast_audioset \
  --model /path/to/AST-AudioSet-GGUF/ast-audioset-f32.gguf \
  --audio input.wav \
  --backend cuda \
  --threads 8 \
  --request-option top_k=10 \
  --log

Request options (use with --request-option)

Option Values Default Description
top_k 1 to 527 10 Number of highest-scoring AudioSet classes to return.

Session options (use with --session-option)

Option Values Default Description
ast_audioset.attention auto, flash, eager auto Attention lowering.
ast_audioset.weight_type native, f32, f16, bf16, q8_0, q4_0, q4_k native Weight storage override.

The model accepts ordinary audio inputs and resamples them to 16 kHz mono. Audio beyond the model's fixed 10.24-second feature window is truncated, matching the official feature extractor.