Spark
sparksql

num-executors指定でのspark sql thriftserverの起動

More than 1 year has passed since last update.
start-sparksql-thriftserver.sh
#!/bin/sh                                                                                                                                       export SPARK_HOME=/opt/spark2.0

$SPARK_HOME/sbin/start-thriftserver.sh \
  --hiveconf hive.server2.thrift.port=10001 \
  --hiveconf hive.server2.thrift.bind.host=なんかおまえのほすと \
  --master yarn \
  --num-executors=5 \
  --conf spark.ui.port=4049 &