blaze / blaze/odo

NotImplementedError on converting a list to sparkSQL

Open
#576 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1k
Forks
131
PR merge metrics
No merged PRs in 30d

Description

Hi,

First of all, this is an amazing library, cheers.

I was going through the spark example here -
http://odo.pydata.org/en/latest/spark.htm

This part went well:

from pyspark import SparkContext
sc = SparkContext()

from pyspark.sql import SQLContext
sql = SQLContext(sc)

from odo import odo
data = [('Alice', 300.0), ('Bob', 200.0), ('Donatello', -100.0)]
type(sql) #

However, trying to convert:
`srdd = odo(data, sql, dshape='3 * {name: string, amount: float64}')`

gave me a
`NotImplementedError: Don't know how to append datasets of type on to type `

Is this a known issue? If not, what further details should I provide aside from the exact error message?

Thanks,
Eli

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.