Lake Formation for the first time
You are prompted to add an administrator user. Since Lake Formation has its own user management and authority management system, it is necessary to add an administrator user for Lake Formation (cooperation with IAM is possible)
You can link with IAM users and IAM roles. After selecting and adding an IAM user etc., you can start Lake Formation by clicking [Save]
IAM user "uehara" is selected.
When the addition is over, it will look like this
You can also see that an admin user has been added
By the way, Lake Formation Data Catalog is integrated with Glue's data catalog, and the data catalog that is browsed from Lake Formation and Glue has the same contents. Of course from Athena
Lake Formation
Glue DataCatalog
- On the Glue side, the function of ML Transforms job has been added along with LakeFormation GA (per left bottom of the screen)
Athena
Athena basically uses Glue's data catalog, so of course it is natural
The screen looks like this
The main menu of Lake Formation Composed
DataCatalog, Register and Ingest, Permissions.
We are responsible for the overall construction of the data lake by extracting and converting data with Register and Ingest, registering metadata, and controlling the user and operation authority with DataPermission.
The link (Crawler, Jobs) on the screen is a link to Glue, and it works strongly with Glue.
Because Lake Formation has its own authority management, the operation log on Lake Formation is displayed at the bottom of the screen
I'll try various things in the future!
Come here
Official document
https://docs.aws.amazon.com/lake-formation/latest/dg/what-is-lake-formation.html
How to use Lake Formation
https://qiita.com/pioho07/items/093d971dcb5656730ea3
How to use Glue(Japanese)
https://qiita.com/pioho07/items/32f76a16cbf49f9f712f