Advent Calendar 2020 / DevOps & Infrastructure & SRE

データ基盤 Advent Calendar 2020

Participant11People

Subscriber72People

Category：DevOps & Infrastructure & SRE

Creator：

@nii_yan

データ基盤にまつわる話をしましょう
・自社のデータ基盤アーキテクチャ
・データパイプラインの構成
・失敗例
・メタデータ関連など・・・

お題は何でも構いません！

Sunday	Monday	Tuesday	Wednesday	Thursday	Friday	Saturday
29	30	@nii_yan データ基盤運用アンチパターン Overwrite Title URL You can post either your article on Qiita or your blog post. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	@Matts966 遅れてすいません！！！【BigQuery】 AlphaSQLでスキーマ安全なデータ基盤を構築する Overwrite Title URL You can post either your article on Qiita or your blog post. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 3 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 4 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 5 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use
@takemikami embulk-input-sparqlを作った意図 Overwrite Title URL You can post either your article on Qiita or your blog post. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	@na0 なんか書く Overwrite Title URL You can post either your article on Qiita or your blog post. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 8 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 9 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 10 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 11 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 12 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use
Join calendar on 13 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	@ttk1 BigQueryでビッグデータを扱うのはそんなに簡単じゃなかった話 Overwrite Title URL You can post either your article on Qiita or your blog post. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 15 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	@mkataigi データ基盤はイベントソーシング+CQRSで設計するとキレイになりやすいかもしれない Overwrite Title URL You can post either your article on Qiita or your blog post. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	@kzk-maeda DynamoDB StreamsとKinesis Data Firehoseを使ったサーバーレスリアルタイムETL Overwrite Title URL You can post either your article on Qiita or your blog post. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	@shinyorke Overwrite Title URL You can post either your article on Qiita or your blog post. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 19 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use
@yuki_saito_en EMR〜〜〜 Overwrite Title URL You can post either your article on Qiita or your blog post. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	@simonritchie 4年間ほどデータエンジニアをしてみたので所感や知見を雑多に書き出してみる Overwrite Title URL You can post either your article on Qiita or your blog post. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	@michi_wkwk 複数のデータ形式を統一のフォーマットに変換するときに意識したこと（2020年振り返り） Overwrite Title URL You can post either your article on Qiita or your blog post. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 23 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 24 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 25 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	26

@nii_yan
データ基盤運用アンチパターン
Overwrite
Title
URL
You can post either your article on Qiita or your blog post.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
@Matts966
遅れてすいません！！！【BigQuery】 AlphaSQLでスキーマ安全なデータ基盤を構築する
Overwrite
Title
URL
You can post either your article on Qiita or your blog post.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 3 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 4 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 5 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
@takemikami
embulk-input-sparqlを作った意図
Overwrite
Title
URL
You can post either your article on Qiita or your blog post.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
@na0
なんか書く
Overwrite
Title
URL
You can post either your article on Qiita or your blog post.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 8 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 9 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 10 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 11 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 12 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 13 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
@ttk1
BigQueryでビッグデータを扱うのはそんなに簡単じゃなかった話
Overwrite
Title
URL
You can post either your article on Qiita or your blog post.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 15 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
@mkataigi
データ基盤はイベントソーシング+CQRSで設計するとキレイになりやすいかもしれない
Overwrite
Title
URL
You can post either your article on Qiita or your blog post.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
@kzk-maeda
DynamoDB StreamsとKinesis Data Firehoseを使ったサーバーレスリアルタイムETL
Overwrite
Title
URL
You can post either your article on Qiita or your blog post.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
@shinyorke
Overwrite
Title
URL
You can post either your article on Qiita or your blog post.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 19 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
@yuki_saito_en
EMR〜〜〜
Overwrite
Title
URL
You can post either your article on Qiita or your blog post.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
@simonritchie
4年間ほどデータエンジニアをしてみたので所感や知見を雑多に書き出してみる
Overwrite
Title
URL
You can post either your article on Qiita or your blog post.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
@michi_wkwk
複数のデータ形式を統一のフォーマットに変換するときに意識したこと（2020年振り返り）
Overwrite
Title
URL
You can post either your article on Qiita or your blog post.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 23 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 24 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 25 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use

Sunday	Monday	Tuesday	Wednesday	Thursday	Friday	Saturday
29	30	@nii_yan データ基盤運用アンチパターン Overwrite Title URL You can post either your article on Qiita or your blog post. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	@Matts966 遅れてすいません！！！【BigQuery】 AlphaSQLでスキーマ安全なデータ基盤を構築する Overwrite Title URL You can post either your article on Qiita or your blog post. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 3 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 4 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 5 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use
@takemikami embulk-input-sparqlを作った意図 Overwrite Title URL You can post either your article on Qiita or your blog post. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	@na0 なんか書く Overwrite Title URL You can post either your article on Qiita or your blog post. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 8 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 9 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 10 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 11 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 12 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use
Join calendar on 13 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	@ttk1 BigQueryでビッグデータを扱うのはそんなに簡単じゃなかった話 Overwrite Title URL You can post either your article on Qiita or your blog post. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 15 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	@mkataigi データ基盤はイベントソーシング+CQRSで設計するとキレイになりやすいかもしれない Overwrite Title URL You can post either your article on Qiita or your blog post. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	@kzk-maeda DynamoDB StreamsとKinesis Data Firehoseを使ったサーバーレスリアルタイムETL Overwrite Title URL You can post either your article on Qiita or your blog post. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	@shinyorke Overwrite Title URL You can post either your article on Qiita or your blog post. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 19 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use
@yuki_saito_en EMR〜〜〜 Overwrite Title URL You can post either your article on Qiita or your blog post. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	@simonritchie 4年間ほどデータエンジニアをしてみたので所感や知見を雑多に書き出してみる Overwrite Title URL You can post either your article on Qiita or your blog post. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	@michi_wkwk 複数のデータ形式を統一のフォーマットに変換するときに意識したこと（2020年振り返り） Overwrite Title URL You can post either your article on Qiita or your blog post. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 23 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 24 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	Join calendar on 25 day You can also reserve a slot without registering a title or URL. Title URL Articles to be submitted are welcome on any website as well as on Qiita. About reserved posting If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day. About posting period Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.) When you participate, we will assume that you have agreed to the terms of use	26

@nii_yan
データ基盤運用アンチパターン
Overwrite
Title
URL
You can post either your article on Qiita or your blog post.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
@Matts966
遅れてすいません！！！【BigQuery】 AlphaSQLでスキーマ安全なデータ基盤を構築する
Overwrite
Title
URL
You can post either your article on Qiita or your blog post.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 3 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 4 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 5 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
@takemikami
embulk-input-sparqlを作った意図
Overwrite
Title
URL
You can post either your article on Qiita or your blog post.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
@na0
なんか書く
Overwrite
Title
URL
You can post either your article on Qiita or your blog post.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 8 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 9 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 10 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 11 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 12 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 13 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
@ttk1
BigQueryでビッグデータを扱うのはそんなに簡単じゃなかった話
Overwrite
Title
URL
You can post either your article on Qiita or your blog post.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 15 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
@mkataigi
データ基盤はイベントソーシング+CQRSで設計するとキレイになりやすいかもしれない
Overwrite
Title
URL
You can post either your article on Qiita or your blog post.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
@kzk-maeda
DynamoDB StreamsとKinesis Data Firehoseを使ったサーバーレスリアルタイムETL
Overwrite
Title
URL
You can post either your article on Qiita or your blog post.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
@shinyorke
Overwrite
Title
URL
You can post either your article on Qiita or your blog post.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 19 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
@yuki_saito_en
EMR〜〜〜
Overwrite
Title
URL
You can post either your article on Qiita or your blog post.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
@simonritchie
4年間ほどデータエンジニアをしてみたので所感や知見を雑多に書き出してみる
Overwrite
Title
URL
You can post either your article on Qiita or your blog post.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
@michi_wkwk
複数のデータ形式を統一のフォーマットに変換するときに意識したこと（2020年振り返り）
Overwrite
Title
URL
You can post either your article on Qiita or your blog post.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 23 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 24 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use
Join calendar on 25 day
You can also reserve a slot without registering a title or URL.
Title
URL
Articles to be submitted are welcome on any website as well as on Qiita.
About reserved posting
If you register a secret article by the day before the same day, it will be automatically published around 7:00 on the same day.
About posting period
Only articles submitted after November 1 of the year can be registered. (Secret articles can be registered anytime articles are posted.)
When you participate, we will assume that you have agreed to the terms of use