PanningModeを使う。デフォルトはNone。
<ScrollViewer PanningMode="Both">
Register as a new user and use Qiita more conveniently