Owner

codertimo

2 indexed repositories · View on GitHub

BERT-pytorch
Google AI 2018 BERT pytorch implementation

Python · 6527 stars
paper-log
읽어야 하는 논문들을 관리하고, 읽은 논문들의 기록을 남기는 공간

31 stars

Open All

How to use this bert model to load and finetune ? Open

codertimo/BERT-pytorch#79 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
How to implement model once pretrained for masked input sentences? Open

codertimo/BERT-pytorch#80 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Default model sizes are much smaller than BERT base Open

codertimo/BERT-pytorch#81 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
how to do Ner Open

codertimo/BERT-pytorch#82 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
transformer.py 中的forword方法调用的SublayerConnection类。实现残差链接和标准化的实现 Open

codertimo/BERT-pytorch#83 · 2 comments · 3 reactions · 0 assignees · Indexed Sep 15, 2026
In Next Sentence Prediction task,the original code may choose the same line when you try to use the negative sample Open

codertimo/BERT-pytorch#86 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
An error occurred【AttributeError: type object 'BERT' has no attribute 'hidden'】 Open

codertimo/BERT-pytorch#87 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
IndexError Open

codertimo/BERT-pytorch#88 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
The exact English pretraining data and Chinese pretraining data that are exact same to the BERT paper's pretraining data. Open

codertimo/BERT-pytorch#89 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
why language_model.py has different vectors Open

codertimo/BERT-pytorch#91 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Why not use torch.no_grad when evaluating test data? Open

codertimo/BERT-pytorch#92 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
dataset / dataset.py have one erro? Open

codertimo/BERT-pytorch#93 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
It keeps trying to use CUDA despite --with_cuda False option Open

codertimo/BERT-pytorch#94 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Pooler layer? Open

codertimo/BERT-pytorch#95 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
bert-vocab? Open

codertimo/BERT-pytorch#96 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
why specify `ignore_index=0` in the NLLLoss function in BERTTrainer? Open

codertimo/BERT-pytorch#98 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 15, 2026
What dataset did you use to train model? Open

codertimo/BERT-pytorch#99 · 2 comments · 3 reactions · 0 assignees · Indexed Sep 15, 2026
how to fine tune model with trained weight Open

codertimo/BERT-pytorch#100 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
GELU is available in PyTorch Open

codertimo/BERT-pytorch#102 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
请问训练得到的模型后缀为.model.ep*格式，应该如何进行后续的调用呢？ Open

codertimo/BERT-pytorch#103 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Why Segment Embedding number only 3? Open

codertimo/BERT-pytorch#106 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Clarification on Padding Process in BERT Model Construction Open

codertimo/BERT-pytorch#107 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
A bug in dataset.py Open

codertimo/BERT-pytorch#110 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
📋 Documentation Enhancement Suggestion Open

codertimo/BERT-pytorch#111 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026

codertimo

Get new issues in your inbox