LoginSignup
0
0

Delete article

Deleted articles cannot be recovered.

Draft of this article would be also deleted.

Are you sure you want to delete this article?

@onoyu1012

watsonx.ai/.governanceでRAGのプロンプトテンプレートを評価（日本語）

Posted at

検証データ

質問（question）、文脈（context）、watsonx.ai/mistral-large-2による生成回答（generated_text）、およびazure OpenAI/GPT-3.5-turbo模範回答（reference_text）を含む検証データを、RAG-Evaluation-Dataset-JAを参考に構築しました（以下参照）。
https://qiita.com/onoyu1012/items/b8cec33c2aa99765013c

image.png

プロンプトテンプレートの作成

watsonx.aiのPrompt Labでプロンプト・テンプレートを作成＆保存。

image.png
image.png
image.png

評価実施

Evaluateをクリック、検証データをアップロードして評価実施。

image.png
image.png
image.png
image.png
image.png

評価結果

image.png
image.png
image.png

0
0
0

Register as a new user and use Qiita more conveniently

  1. You get articles that match your needs
  2. You can efficiently read back useful information
  3. You can use dark theme
What you can do with signing up
Sign upLogin
0
0

Delete article

Deleted articles cannot be recovered.

Draft of this article would be also deleted.

Are you sure you want to delete this article?