LoginSignup
0
0

More than 3 years have passed since last update.

javaを使用してスクレイピングを試す[メモ書き]

Posted at

試したこと

Yahoo NewsのIT記事を取得。


メモ書き


jdk14.0.1
jsoup-1.13.1.jar


vscodeの環境設定が出来ていなかったので最初、jsoupが読み込まれず、エラー。
下記のファイルに設定を行って対応。

settings.json
    "java.project.referencedLibraries": [
        "lib/**/*.jar",
        "C:\\パス\\jsoup-1.13.1.jar"
     ],
demojava/demo3/Web.java
package demojava.demo3;
import org.jsoup.Jsoup;
import org.jsoup.nodes.Document;
import org.jsoup.nodes.Element;
import org.jsoup.select.Elements;
import java.io.IOException;

public class Web {
    public static void main(String[] args) throws IOException {
        Document document = Jsoup.connect("https://news.yahoo.co.jp/topics/it").get();
        Elements courses = document.select(".newsFeed_item_link");
        for (Element course : courses) {
            System.out.println(course.attr("href")+ " [[::]] " + course.text());
        }
    }
}

取得結果

2020-10-10_13-25-42.png

0
0
0

Register as a new user and use Qiita more conveniently

  1. You get articles that match your needs
  2. You can efficiently read back useful information
  3. You can use dark theme
What you can do with signing up
0
0