1
0

Delete article

Deleted articles cannot be recovered.

Draft of this article would be also deleted.

Are you sure you want to delete this article?

llama.cpp の公式 Web UI (llama-ui) を日本語で使う

1
Posted at

llama.cpp で llama-ui という WebUI が利用可能になりました(https://github.com/ggml-org/llama.cpp/discussions/16938)が、英語しか対応していません。そこで、日本語に翻訳したフォークを作成しました。

ビルド方法:

git clone --depth=1 https://github.com/Nerahikada/llama.cpp.git
cd llama.cpp
cmake -B build -DLLAMA_BUILD_UI=ON -DLLAMA_USE_PREBUILT_UI=OFF #-DGGML_CUDA=ON
cmake --build build --config Release -j$(nproc)

llama-server を起動すると、http://127.0.0.1:8080 で WebUI が起動します。リッスンするアドレスやポートを変更するには、--host, --port 引数を使用します(例: --host 127.0.0.1 --port 8033)。

1
0
0

Register as a new user and use Qiita more conveniently

  1. You get articles that match your needs
  2. You can efficiently read back useful information
  3. You can use dark theme
What you can do with signing up
1
0

Delete article

Deleted articles cannot be recovered.

Draft of this article would be also deleted.

Are you sure you want to delete this article?