GPUStack – 企业级私有化部署大模型（需要显卡支持才能demo）

gpustack/gpustack: Manage GPU clusters for running AI models (github.com)GPUStack - 企业级私有化部署大模型

GPUStack - 企业级私有化部署大模型_哔哩哔哩_bilibili

docker-compose.yaml

version: '3.8'

services:
  gpustack:
    image: gpustack/gpustack
    ports:
      - "80:80"
    restart: always
    ipc: host
    volumes:
      - gpustack-data:/var/lib/gpustack
    deploy:
      resources:
        reservations:
          devices:
            - driver: nvidia
              capabilities: [gpu]
    # uncomment and update the followings for starting GPUStack worker
    # command: --server-url http://myserver --token mytoken
    # network_mode: host

volumes:
  gpustack-data: {}

欢迎来撩 ： 汇总all