0
0

Delete article

Deleted articles cannot be recovered.

Draft of this article would be also deleted.

Are you sure you want to delete this article?

Delta Lake UniFormを使用してIcebergフォーマットでテーブルを出力

Last updated at Posted at 2025-04-21

前提

・利用環境:Databricks、AWS

参考

手順

1)「ワークスペース」→「作成」→「ノートブック」をクリック
image.png
2)デフォルトの言語をSQLに変更し、Uniform出力用のSQL文を作成
例:
CREATE table if not exists ho-cdc.cdc.transactions_gold_iceberg as select * from ho-cdc.cdc.transactions_gold;

ALTER TABLE ho-cdc.cdc.transactions_gold_iceberg SET TBLPROPERTIES(
'delta.enableDeletionVectors' = 'false');

ALTER TABLE ho-cdc.cdc.transactions_gold_iceberg SET TBLPROPERTIES(
'delta.columnMapping.mode' = 'name',
'delta.enableIcebergCompatV2' = 'true',
'delta.universalFormat.enabledFormats' = 'iceberg');
image.png
3)S3にiceberg読み取り用のMetaデータが作成されてることを確認
image.png
以上

0
0
0

Register as a new user and use Qiita more conveniently

  1. You get articles that match your needs
  2. You can efficiently read back useful information
  3. You can use dark theme
What you can do with signing up
0
0

Delete article

Deleted articles cannot be recovered.

Draft of this article would be also deleted.

Are you sure you want to delete this article?