Posted at

num-executors指定でのspark sql thriftserverの起動

More than 3 years have passed since last update.


start-sparksql-thriftserver.sh

#!/bin/sh                                                                                                                                       export SPARK_HOME=/opt/spark2.0

$SPARK_HOME/sbin/start-thriftserver.sh \
--hiveconf hive.server2.thrift.port=10001 \
--hiveconf hive.server2.thrift.bind.host=なんかおまえのほすと \
--master yarn \
--num-executors=5 \
--conf spark.ui.port=4049 &