0
0

Delete article

Deleted articles cannot be recovered.

Draft of this article would be also deleted.

Are you sure you want to delete this article?

Ruby + BigQueryで既存のテーブルのスキーマを流用してテーブルロードをするときの罠

Posted at

意外とハマったのでメモ

こんな感じにスキーマを取得して、

bigquery = Google::Cloud::Bigquery.new(project_id: PROJECT_ID)
template_table = bigquery.dataset(DATASET_ID).table(source_table_id)
schema = template_table.schema

こんな感じにそのスキーマを指定してもなぜかschemaを認識してくれない。

bigquery.dataset(DATASET_ID).dataset.load_job(destination_table_id, "GCSのパス", schema: schema)

取得したスキーマを一旦シリアライズしてからデシリアライズするとうまくいく。

sio = StringIO.new
Google::Cloud::Bigquery::Schema.dump(schema, sio)
schema2 = Google::Cloud::Bigquery::Schema.load(sio)

bigquery.dataset(DATASET_ID).dataset.load_job(destination_table_id, "GCSのパス", schema: schema2)

このあたりが影響していそうだが、詳細なメカニズムは不明。

0
0
0

Register as a new user and use Qiita more conveniently

  1. You get articles that match your needs
  2. You can efficiently read back useful information
  3. You can use dark theme
What you can do with signing up
0
0

Delete article

Deleted articles cannot be recovered.

Draft of this article would be also deleted.

Are you sure you want to delete this article?