NotImplementedError on converting a list to sparkSQL
- Dominant language
- Python
- Stars
- 1k
- Forks
- 131
- PR merge metrics
- No merged PRs in 30d
Description
Hi,
First of all, this is an amazing library, cheers.
I was going through the spark example here -
http://odo.pydata.org/en/latest/spark.htm
This part went well:
from pyspark import SparkContext
sc = SparkContext()
from pyspark.sql import SQLContext
sql = SQLContext(sc)
from odo import odo
data = [('Alice', 300.0), ('Bob', 200.0), ('Donatello', -100.0)]
type(sql) #
However, trying to convert:
`srdd = odo(data, sql, dshape='3 * {name: string, amount: float64}')`
gave me a
`NotImplementedError: Don't know how to append datasets of type on to type `
Is this a known issue? If not, what further details should I provide aside from the exact error message?
Thanks,
Eli
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.