couchbaselabs / couchbaselabs/couchbase-spark-samples
spark couchbase concurrency always 1
Open
- Dominant language
- Scala
- Stars
- 16
- Forks
- 9
- PR merge metrics
- No merged PRs in 30d
Description
I have tried these examples with --master yarn but I got the concurrency as always 1.
There is only one partition starting from the reading.
take spark sql for an example.
val df = spark.read.couchbase()
here df is a one partition dataframe with testing data (snappy parquet size 300M).
Is there any configuration in database side (such as adding an index, adding a partition) that can make the process multi concurrency?
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.