apache / apache/hudi

Newly introduced HiveSyncConfig config, syncAsSparkDataSourceTable is defaulted as true

Open
#15,155 0 comments 0 reactions 1 assignee Claimed by @nsivabalan View on GitHub
from-jira priority:critical type:bug
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Newly introduced HiveSyncConfig config, syncAsSparkDataSourceTable is defaulted as true. With this config enabled, both tableProperties and serdeProperties are added to HMS. After that when running spark.sql queries on the table the queries are failing with schema mismatch errors. Also this is not backward compatible, using 0.8 version we are not able to read the hive queries.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-3976
- Type: Bug
- Fix version(s):
- 1.1.0

---

## Comments

26/Apr/22 00:30;suryaprasanna;CC [~pwason] [~shivnarayan] ;;;

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.