dspinellis / dspinellis/tokenizer

floating-point constant too large

Open
#15 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
66
Forks
21
PR merge metrics
No merged PRs in 30d

Description

Thank you for the project.

I cloned it and tried to make but I got this error. I am on mac m1.

```
[master][~/tokenizer]$ cd src rbenv:2.7.6
[master][~/tokenizer/src]$ make rbenv:2.7.6
./mkkeyword.pl C-keyword.txt CSharp-keyword.txt Cpp-keyword.txt Go-keyword.txt Java-keyword.txt JavaScript-keyword.txt PHP-keyword.txt Python-keyword.txt Rust-keyword.txt TypeScript-keyword.txt
./mktoken.pl CTokenizer.cpp CSharpTokenizer.cpp CppTokenizer.cpp GoTokenizer.cpp JavaTokenizer.cpp JavaScriptTokenizer.cpp PHPTokenizer.cpp PythonTokenizer.cpp RustTokenizer.cpp TypeScriptTokenizer.cpp TokenizerBase.cpp
c++ -Wall -Werror -MD -std=c++17 -O2 -c -o CTokenizer.o CTokenizer.cpp
c++ -Wall -Werror -MD -std=c++17 -O2 -c -o CppTokenizer.o CppTokenizer.cpp
c++ -Wall -Werror -MD -std=c++17 -O2 -c -o JavaTokenizer.o JavaTokenizer.cpp
c++ -Wall -Werror -MD -std=c++17 -O2 -c -o CSharpTokenizer.o CSharpTokenizer.cpp
c++ -Wall -Werror -MD -std=c++17 -O2 -c -o PythonTokenizer.o PythonTokenizer.cpp
c++ -Wall -Werror -MD -std=c++17 -O2 -c -o TokenizerBase.o TokenizerBase.cpp
c++ -Wall -Werror -MD -std=c++17 -O2 -c -o SymbolTable.o SymbolTable.cpp
c++ -Wall -Werror -MD -std=c++17 -O2 -c -o NestedClassState.o NestedClassState.cpp
c++ -Wall -Werror -MD -std=c++17 -O2 -c -o PHPTokenizer.o PHPTokenizer.cpp
c++ -Wall -Werror -MD -std=c++17 -O2 -c -o JavaScriptTokenizer.o JavaScriptTokenizer.cpp
c++ -Wall -Werror -MD -std=c++17 -O2 -c -o GoTokenizer.o GoTokenizer.cpp
c++ -Wall -Werror -MD -std=c++17 -O2 -c -o RustTokenizer.o RustTokenizer.cpp
c++ -Wall -Werror -MD -std=c++17 -O2 -c -o tokenizer.o tokenizer.cpp
tokenizer.cpp:154:30: error: magnitude of floating-point constant too large for type 'long double'; maximum is 1.7976931348623157E+308 [-Werror,-Wliteral-range]
for (long double d = 1; d < 1e309L; d *= 10)
^
1 error generated.
```

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.