1
0

Delete article

Deleted articles cannot be recovered.

Draft of this article would be also deleted.

Are you sure you want to delete this article?

More than 3 years have passed since last update.

ブラウザで有害コメントを検出 「英語」

Posted at

poison-1481596_1280.jpg

##はじめに

こんにちは streampack チームのメディです。
https://cloudpack.jp/service/option/streampack.html

Copyrights

コピーレフトのイラスト : poison-bottle-medicine-old-symbol-1481596

##目的
簡単な例でtensorflow.jsの使用方法を学びます。

このモデルは、7種類の有毒なコメントを検出できます。

英語 日本語
Insult 侮辱
Obscene 不愉快な
Severe toxicity 非常に有毒
Sexual explicit 性的露骨
Threat 脅威
Toxicity 毒性

##実装

tensorflow.jsを使用して有毒なコメントを検出する方法を学びます。

  • ラベルー
  • 検出の信頼性(0から1の間)
  • 検出一致

結果サンプル

  ...
          "label": "identity_attack",
          "results": [{
            "probabilities": [0.9659664034843445, 0.03403361141681671],
            "match": false
          }]
        },
  ...

ホームページから:

predictions is an array of objects, one for each prediction head,
that contains the raw probabilities for each input along with the
final prediction in match (either true or false).
If neither prediction exceeds the threshold, match is null.

実装

Screen Shot 2021-03-11 at 18.46.11.png

<!DOCTYPE html>
<html>

<head>
  <meta charset="utf-8" />
  <!-- Bootstrap CSS -->
  <link rel="stylesheet" href="//stackpath.bootstrapcdn.com/bootstrap/4.3.1/css/bootstrap.min.css" crossorigin="anonymous" playsinline>

  <!-- jQuery & Bootstrap JS -->
  <script src="//code.jquery.com/jquery-3.3.1.slim.min.js" crossorigin="anonymous"></script>
  <script src="//cdnjs.cloudflare.com/ajax/libs/popper.js/1.14.7/umd/popper.min.js" crossorigin="anonymous"></script>
  <script src="//stackpath.bootstrapcdn.com/bootstrap/4.3.1/js/bootstrap.min.js" crossorigin="anonymous"></script>

  <!-- Load TensorFlow.js -->
  <script src="https://cdn.jsdelivr.net/npm/@tensorflow/tfjs"></script>
  <!-- Load the pre-trained model. -->
  <script src="https://cdn.jsdelivr.net/npm/@tensorflow-models/toxicity"></script>

  <style>
    body {
      text-align: left;
    }

    #main_container {
      display: inline-block;
      margin: 0 auto;
      position: relative;
    }

    #top_div {
      padding: 1em;
    }

    #loader_div {
      display: inline-block;
    }

    #spinner_div {
      display: inline-block;
    }
  </style>
</head>

<body>
  <div>

    <div id="top_div">
      <H2>Toxic comments detector in the browser (english language)</H2>
      <div id="loader_div">
        <p id="loader_info">Loading model...
          <p />
      </div>

      <div id="spinner_div" class="spinner-border" role="status">
        <span class="sr-only"></span>
      </div>
      <br></br>

    </div>
    <br></br>
    <div class="container" id="main_container">
      <div class="form-group">
        <label for="comment">Comment:</label>
        <textarea class="form-control" rows="5" id="comment"></textarea>
      </div>
      <br>
      <div>
        <button id="detectionBtn" type="button" class="btn btn-primary" onClick="handleDetection()" disabled>Detect</button>
      </div>
      <br>
      <table class="table">
        <thead class="thead-light">
          <tr>
            <th scope="col" style="width: 30%">Label (en)</th>
            <th scope="col" style="width: 30%">Label (ja)</th>
            <th scope="col" style="width: 30%">Detected</th>
          </tr>
        </thead>
        <tbody>
          <tr>
            <td>Insult</th>
            <td>侮辱</td>
            <td id="identity_attack"></td>
          </tr>
          <tr>
            <td>Obscene</td>
            <td>不愉快な</td>
            <td id="obscene"></td>
          </tr>
          <tr>
            <td>Severe toxicity</td>
            <td>非常に有毒</td>
            <td id="severe_toxicity"></td>
          </tr>
          <tr>
            <td>Sexual explicit</td>
            <td>性的露骨</td>
            <td id="sexual_explicit"></td>
          </tr>
          <tr>
            <td>Threat</td>
            <td>脅威</td>
            <td id="threat"></td>
          </tr>
          <tr>
            <td>Toxicity</td>
            <td>毒性</td>
            <td id="toxicity"></td>
          </tr>
        </tbody>
      </table>
    </div>
  </div>
  <script type="text/javascript">
    var globalModel;
    // Load the model. Users optionally pass in a threshold and an array of
    // labels to include.
    var isModelLoaded = false;
    const threshold = 0.8;
    toxicity.load(threshold).then(model => {
      isModelLoaded = true;
      $("#detectionBtn").prop('disabled', false);
      updateTitle();
      globalModel = model;
    });

    function handleDetection() {
      $("#detectionBtn").prop('disabled', true);
      var comment = $("#comment").val();
      sentences = [];
      sentences.push(comment);
      clearFields();
      globalModel.classify(sentences).then(predictions => {
        console.log("[DEBUG] predictions: " + JSON.stringify(predictions));
        $("#detectionBtn").prop('disabled', false);
        predictions.map((itm) => {
          switch (itm.label) {
            case "identity_attack":
              $("#identity_attack").text(itm.results[0].match);
              break;
            case "insult":
              $("#insult").text(itm.results[0].match);
              break;
            case "obscene":
              $("#obscene").text(itm.results[0].match);
              break;
            case "severe_toxicity":
              $("#severe_toxicity").text(itm.results[0].match);
              break;
            case "sexual_explicit":
              $("#sexual_explicit").text(itm.results[0].match);
              break;
            case "threat":
              $("#threat").text(itm.results[0].match);
              break;
            case "toxicity":
              $("#toxicity").text(itm.results[0].match);
              break;
            default:
              break;
          }
        });
      });


    }

    function updateTitle() {
      var title = document.getElementById("loader_info");
      title.textContent = "Model loaded successfully";
      var element = document.getElementById("spinner_div");
      element.classList.remove("spinner-border");
    }

    function clearFields() {
      $("#identity_attack").text("");
      $("#insult").text("");
      $("#obscene").text("");
      $("#severe_toxicity").text("");
      $("#sexual_explicit").text("");
      $("#threat").text("");
      $("#toxicity").text("");
    }
  </script>
</body>

</html>

デモ

情報元

https://github.com/tensorflow/tfjs-models/tree/master/toxicity
https://pixabay.com/illustrations/poison-bottle-medicine-old-symbol-1481596/

1
0
1

Register as a new user and use Qiita more conveniently

  1. You get articles that match your needs
  2. You can efficiently read back useful information
  3. You can use dark theme
What you can do with signing up
1
0

Delete article

Deleted articles cannot be recovered.

Draft of this article would be also deleted.

Are you sure you want to delete this article?