Transformers documentation

Jan

You are viewing main version, which requires installation from source. If you'd like regular pip install, checkout the latest stable version (v5.0.0).
Hugging Face's logo
Join the Hugging Face community

and get access to the augmented documentation experience

to get started

Jan

Jan is an open-source ChatGPT alternative. It supports transformers serve natively without extra tunneling.

Go to Settings > Model Providers.

  1. Set Base URL to http://localhost:8000/v1.
  2. Enter any text in API Key (required).

Check the Models section (click Refresh if empty). Click + to add a specific model like Qwen/Qwen3-4B.

Update on GitHub