Whisper Server

Self-hosted Whisper speech-to-text server compatible with Konele Android app.

Features

• WebSocket Server - Implements Konele protocol for real-time transcription
• Powered by faster-whisper - Efficient CTranslate2-based Whisper implementation
• Nix Flake - Reproducible builds and development environment
• Docker Support - Easy deployment with Nix-built containers
• Tailscale Ready - Secure access from your Android device

Quick Start

# Enter development shell
nix develop

# Run the server
just run

# Or with custom port and model
just run 9002 medium

How It Works

sequenceDiagram
    participant Phone as Android (Konele)
    participant Server as Whisper Server
    participant Whisper as faster-whisper

    Phone->>Server: WebSocket connect
    Phone->>Server: Audio chunks (binary)
    Phone->>Server: {"eof": true}
    Server->>Whisper: Transcribe audio
    Whisper-->>Server: Text result
    Server-->>Phone: {"result": {"hypotheses": [...]}}

Next Steps

1. Installation - Set up the server on NixOS
2. Android Setup - Configure Konele on your phone
3. Configuration - Customize server options
4. Architecture - Understand the system design