Transformers documentation

Open WebUI

Transformers

Get started

Transformers Installation Quickstart

Base classes

Inference

Pipeline API

Generate API

Optimization

Chat with models

Serving

Serve CLI Server optimizations Cursor Jan Open WebUI tiny-agents

Training

Quantization

Ecosystem integrations

Resources

Contribute

API

You are viewing main version, which requires installation from source. If you'd like regular pip install, checkout the latest stable version (v5.0.0).

Join the Hugging Face community

and get access to the augmented documentation experience

Collaborate on models, datasets and Spaces

Faster examples with accelerated inference

Switch between documentation themes

to get started

Open WebUI

Open WebUI provides a self-hosted interface for offline models. Enable CORS to serve local models (it’s disabled by default for security).

transformers serve --enable-cors

To use the server for speech-to-text, go to Settings > Audio.

Set Speech-to-Text Engine to OpenAI.
Set the URL to http://localhost:8000/v1.
Enter a transcription model in SST Model (openai/whisper-large-v3). Find more models on the Hub.

Start a chat and speak. The model transcribes your audio into the input field.

Update on GitHub

←Jan tiny-agents→