21 Feb 2025

Whisper.cpp Compile Static Release

As a follow up to the last post, I recently needed to make a static binary release of whisper.cpp. At some point whisper.cpp split out the old main binary into multiple binaries, among them whisper-cli and whisper-server. In this split both binaries now use shared libraries, which makes sense, except for when you want to make it easy to run them on another machine. So spelunking through some github issues as you do, because lets be honest, you are seldomly the first person to have a problem I found a issue creating the Go bindings, and turns out there is a build switch for it.

21 Feb 2025

Whisper.cpp Safetensors Conversion

I have been playing around with whisper.cpp for some time now. Going back to September 2023 at the NORDUnet community workshop, where someone from Oslo university was presenting on using whisper to do subtitles for their video platform. Having heard about whisper.cpp I spun it up on my MacBook Pro after the talk, and was quite impressed, as most people are when they try whisper for the first time. While the talk had been about running whisper using PyTorch with a Nvidia H100, here I was running it on a m2 max macbook, and the speed was not horrible.