gagolews / gagolews/stringi

stri_encode: maximal supported size of a single string is ~0.67 GB

Open
#395 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
318
Forks
48
PR merge metrics
No merged PRs in 30d

Description

To support the full 2^31-1 (\*) bytes per string, the `stri_encode` would need to be rewritten using batch uconv processing.

(\*) [R Internals](https://cran.r-project.org/doc/manuals/r-release/R-ints.html):

> *Elements of character vectors (CHARSXPs) remain limited to 2^31 - 1 bytes.*

```r
> library(stringi); x<-stri_dup("a", 2**30); y <- paste(c(x, x), collapse="")
#Error in paste(c(x, x), collapse = "") : result would exceed 2^31-1 bytes
```

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.