how to quantizate Qwen3.5-27B dense model? #1004
Description
how to quantizate Qwen3.5-27B dense model？
Is there any docker image can be used?
System information
- OS ：Ubuntu 22.04
- CPU architecture：x86_64
- GPU ：rtx5090D v2
- GPU memory size: 24G
- Number of GPUs: 1