This is a sample project to demonstrate how to update DynamoDB with AWS Glue. On this table there are no one pokemon category, so we need to filter the data and update each row with the correct category from the pokemon API.

Create a DynamoDB table with the following schema.

Create a role with the following permissions to access DynamoDB and S3.

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Effect": "Allow",
            "Principal": {
                "Service": "glue.amazonaws.com"
            },
            "Action": "sts:AssumeRole"
        }
    ]
}

Add policies:

• DynamoDBFullAccess
• S3FullAccess

Create a Glue job with the following settings.

• Job type: Spark
• Job language: Python
• Glue version: 3.0
• Number of workers: 2

You can see the following records in the DynamoDB table.

• AWS Glue
• Connection types and options for ETL in AWS Glue
• PySpark Glue Tutorial
• How to export an Amazon DynamoDB table to Amazon S3 using AWS Step Functions and AWS Glue

Developed by Jean Jacques Barros