aws-samples / aws-samples/aws-glue-samples
EMR Hive Metastore to Glue Migration
- Dominant language
- Python
- Stars
- 1.5k
- Forks
- 834
- Avg merge
- 2d 17h
- Merged PRs (30d)
- 1
Description
I was going through this documentation to migrate from Hive Metastore to the Glue Data catalog specifically the section "Migrate the Amazon EMR Hive Metastore to the AWS Glue Data Catalog" here:
https://aws.amazon.com/blogs/big-data/upgrade-amazon-emr-hive-metastore-from-5-x-to-6-x/
Here, based on that, it mentions the script here: https://github.com/aws-samples/aws-glue-samples/tree/master/utilities/Hive_metastore_migration
I was going through the README and the script to import from hive metastore and saw it mentions MYSQL as the driver.
I am using external Hive Metastore as Maria DB RDS. How to work with this script to perform the migration? The documentation https://aws.amazon.com/blogs/big-data/upgrade-amazon-emr-hive-metastore-from-5-x-to-6-x/ says steps are same for other db engines but the script specifically works for MySQL.
Any suggestions?
Contributor guide
Research direction
Start with the README and migration script under utilities/Hive_metastore_migration, then compare their MySQL driver instructions with the AWS blog's migration steps. Determine whether MariaDB RDS is supported or what documentation change is needed; done means the README or script guidance clearly addresses MariaDB.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, mariadb, mysql, python
- Domain
- cloud, databases, documentation
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100