【Podman】grok-buildのエンドポイントをLiteLLMでローカルLLMに差し替える環境構築手順

Last updated at 2026-08-22Posted at 2026-07-23

PCの構成はこんな感じです

OS Windows11 Pro
メモリ 64G
グラボ RTX5060Ti 16G
去年の12月に変更しました
https://qiita.com/lunar_sword3/items/181b86c3b1f69fdd2cde

ローカルLLM

LM Studio使っています

IP http://192.168.10.31:1234
モデル google/gemma-4-12b

git-hubからgrok-buildを持ってきます

ファイル構成

config\config.toml
grok-build-main (フォルダ)
workspace (フォルダ)
compose.yml
Containerfile

ファイルの中身

compose.yml


services:
  grok:
    image: grok-build:latest
    container_name: grok-local

    build:
      context: .
      dockerfile: Containerfile

    stdin_open: true
    tty: true

    working_dir: /workspace

    volumes:
      - ./config:/root/.grok
      - ./workspace:/workspace

    environment:
      GROK_HOME: /root/.grok
      LM_STUDIO_API_KEY: lm-studio
      RUST_BACKTRACE: "1"
      TERM: xterm-256color

Containerfile

FROM docker.io/library/rust:bookworm AS builder

ENV DEBIAN_FRONTEND=noninteractive
ENV CARGO_TERM_COLOR=always

RUN apt-get update \
    && apt-get install -y --no-install-recommends \
        build-essential \
        ca-certificates \
        clang \
        cmake \
        curl \
        git \
        libssl-dev \
        pkg-config \
        protobuf-compiler \
    && rm -rf /var/lib/apt/lists/*

RUN cargo install dotslash

WORKDIR /build/grok-build

# Windows側に取得済みのリポジトリをコピー
COPY grok-build-main/ ./

# リポジトリ指定のRustバージョンを確認
RUN rustup show

# grok-buildをビルド
RUN cargo build \
    --locked \
    --release \
    -p xai-grok-pager-bin


FROM docker.io/library/debian:bookworm-slim AS runtime

ENV DEBIAN_FRONTEND=noninteractive
ENV TERM=xterm-256color
ENV PATH=/usr/local/bin:${PATH}

RUN apt-get update \
    && apt-get install -y --no-install-recommends \
        bash \
        ca-certificates \
        curl \
        git \
        jq \
        less \
        openssh-client \
        procps \
        ripgrep \
    && rm -rf /var/lib/apt/lists/*

COPY --from=builder \
    /build/grok-build/target/release/xai-grok-pager \
    /usr/local/bin/grok

RUN chmod 755 /usr/local/bin/grok \
    && mkdir -p /root/.grok /workspace

WORKDIR /workspace

ENTRYPOINT ["grok"]

config.toml

[marketplace]
default_skills_installs_purged = true

[cli]
installer = "internal"

[models]
default = "lmstudio-gemma"

[model.lmstudio-gemma]
name = "LM Studio Gemma"
model = "google/gemma-4-26b-a4b-qat"
base_url = "http://192.168.10.31:1234/v1"
env_key = "LM_STUDIO_API_KEY"

[ui]
max_thoughts_width = 120
fork_secondary_model = "lmstudio-gemma"
yolo = false
compact_mode = false
permission_mode = "ask"