動作環境

GeForce GTX 1070 (8GB)
ASRock Z170M Pro4S [Intel Z170chipset]
Ubuntu 16.04 LTS desktop amd64
TensorFlow v1.1.0
cuDNN v5.1 for Linux
CUDA v8.0
Python 3.5.2
IPython 6.0.0 -- An enhanced Interactive Python.
gcc (Ubuntu 5.4.0-6ubuntu1~16.04.4) 5.4.0 20160609
GNU bash, version 4.3.48(1)-release (x86_64-pc-linux-gnu)

TensorFlowをv1.1.0からv1.2.1に変更した。

参考: Tensorflowのアップデート方法
参考: https://github.com/tensorflow/tensorflow/issues/10085

$pip3 uninstall tensorflow

$sudo pip3 install --upgrade tensorflow==1.2.1

$ pip3 list | grep tensor
DEPRECATION: The default format will switch to columns in the future. You can use --format=(legacy|columns) (or define a format=(legacy|columns) in your pip.conf under the [list] section) to disable this warning.
tensorflow (1.2.1)

protobuf

protobufがcpp実装かどうかは以下で確認した。

$ python3 -c "from google.protobuf.internal import api_implementation; print(api_implementation._default_implementation_type)"
cpp

参考: https://stackoverflow.com/questions/41647784/tfrecordreader-seems-extremely-slow-and-multi-threads-reading-not-working/41688401