More than 5 years have passed since last update.

num-executors指定でのspark sql thriftserverの起動

Spark
sparksql

Posted at 2016-08-05

start-sparksql-thriftserver.sh

# !/bin/sh                                                                                                                                       export SPARK_HOME=/opt/spark2.0

$SPARK_HOME/sbin/start-thriftserver.sh \
  --hiveconf hive.server2.thrift.port=10001 \
  --hiveconf hive.server2.thrift.bind.host=なんかおまえのほすと \
  --master yarn \
  --num-executors=5 \
  --conf spark.ui.port=4049 &

You get articles that match your needs
You can efficiently read back useful information
You can use dark theme

What you can do with signing up