aws-samples / aws-samples/aws-glue-samples

EMR Hive Metastore to Glue Migration

Open
#144 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.5k
Forks
834
Avg merge
2d 17h
Merged PRs (30d)
1

Description

I was going through this documentation to migrate from Hive Metastore to the Glue Data catalog specifically the section "Migrate the Amazon EMR Hive Metastore to the AWS Glue Data Catalog" here:
https://aws.amazon.com/blogs/big-data/upgrade-amazon-emr-hive-metastore-from-5-x-to-6-x/

Here, based on that, it mentions the script here: https://github.com/aws-samples/aws-glue-samples/tree/master/utilities/Hive_metastore_migration

I was going through the README and the script to import from hive metastore and saw it mentions MYSQL as the driver.

I am using external Hive Metastore as Maria DB RDS. How to work with this script to perform the migration? The documentation https://aws.amazon.com/blogs/big-data/upgrade-amazon-emr-hive-metastore-from-5-x-to-6-x/ says steps are same for other db engines but the script specifically works for MySQL.

Any suggestions?

Contributor guide

Open the contributing guide

Research direction

Start with the README and migration script under utilities/Hive_metastore_migration, then compare their MySQL driver instructions with the AWS blog's migration steps. Determine whether MariaDB RDS is supported or what documentation change is needed; done means the README or script guidance clearly addresses MariaDB.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, mariadb, mysql, python
Domain
cloud, databases, documentation
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.