mistralai/Mistral-Small-3.1-24B-Instruct-2503

#75 opened 8 months ago by

AtulOk

Running the model with 3*4090 will report an error about out of memory.

#73 opened 9 months ago by

iduzy

[vLLM] Stuck at "Waiting for output from MQLLMEngine"

👍 👀 2

#72 opened 9 months ago by

slemouellic

Test using M1 Max (64G) and Word

#71 opened 9 months ago by

gptlocalhost

Dirty

#70 opened 9 months ago by

Delete SYSTEM_PROMPT.txt

🤯 1

#69 opened 9 months ago by

Delete SYSTEM_PROMPT.txt

#68 opened 9 months ago by

Delete SYSTEM_PROMPT.txt

#67 opened 9 months ago by

Delete SYSTEM_PROMPT.txt

#66 opened 9 months ago by

Update SYSTEM_PROMPT.txt

#65 opened 9 months ago by

ValueError: Model architectures ['PixtralForConditionalGeneration'] failed to be inspected.

2

#64 opened 9 months ago by

sangwonjung

Add tool calling template for HF format

🔥 3

#63 opened 9 months ago by

Frrosta

FSDP Training with Mistral-Small-3.1-24B-Instruct-2503 Model and DecoderLayer

#62 opened 9 months ago by

ian00000

Unexpected PixtralProcessor use with Mistral-Small-3.1 on vLLM — text-only use case

#61 opened 9 months ago by

AbasKhan

Consolidated safetensors

#60 opened 9 months ago by

Aktsvigun

Add chat_template to tokenizer_config

👍 2

2

#58 opened 9 months ago by

alexmarques

Create Mistral-Small-3.1-24B-Instruct-2503

#56 opened 9 months ago by

dylanliao9191

Request: DOI

#55 opened 9 months ago by

gmaterni

Address discrepancies in the languages supported by the Mistral Small 3.1 2503

🔥 1

3

#54 opened 9 months ago by

fpaupier

chat template not working for tool calling

#52 opened 9 months ago by

thies

[resolved] vllm nightly hf config

#51 opened 9 months ago by

zaventh

Transformers Code Almost Works

#48 opened 9 months ago by

binder11

Problem hosting the model using vllm

➕ 3

#45 opened 10 months ago by

ShaoServient

FP8 Dynamic/W8A16 Quants Please

#44 opened 10 months ago by

rjmehta

Speculative Decoding: I'd love to have a much smaller "companion model" (0.5B for example)

👍 2

#43 opened 10 months ago by

lstrozzi

model_card

#42 opened 10 months ago by

Nahieli777777

Fix typos

👍 1

#41 opened 10 months ago by

sukrucildirr

Can you provide the finetune code？

#40 opened 10 months ago by

jason500

Upload Gravity%2520Falls%2520Intro%2520x%2520playboi%2520carti%25203%205.mp3

👀 1

#39 opened 10 months ago by

Jasond6111

Can't determine properly which is greater between 9.9 and 9.11

🧠 ➕ 2

10

#38 opened 10 months ago by

sniffski

Add transformers snippet

#36 opened 10 months ago by

merve

Please help with error: Mistral-Small is not running on MacOs with CPU M2 Silicon. With Assert Error

➕ 2

#34 opened 10 months ago by

NickolasCh

Deployment on Amazon SageMaker Endpoint

➕ 1

#33 opened 10 months ago by

dgallitelli

Request support for text-only inference in transformers (Mistral3ForCausalLM class)

5

#32 opened 10 months ago by

alan925

update metadata

#31 opened 10 months ago by

nickname100231

Quantized models with vision included?

12

#27 opened 10 months ago by

geoad

Corrected vllm link in readme

#26 opened 10 months ago by

riversnow

Regarding Video Understanding

#25 opened 10 months ago by

fensz

Support tool calls with chat template

❤️ 1

#24 opened 10 months ago by

CISCai

FIX for the pip install vllm --ugrade --> pip install vllm --upgrade

#23 opened 10 months ago by

rbgo

How do we use it with Transformers? can you give some sample code ?

9

#22 opened 10 months ago by

rameshch

Local Installation Video and Testing on Vision, Coding, Math, Text - Step by Step