codertimo

what’s your data set? Open

question

codertimo/BERT-pytorch#1 · 7 comments · 0 reactions · 2 assignees · Indexed Sep 15, 2026

Is it possible to train BERT? Open

help wanted question

codertimo/BERT-pytorch#3 · 7 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026

when training the masked LM, the unmasked words (have label 0) were trained together with masked words? Open

enhancement question

codertimo/BERT-pytorch#29 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026

pred_loss decrease fast while avg_acc stay at 50% Open

help wanted invalid question

codertimo/BERT-pytorch#32 · 53 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026

Vocab Replace \t to blank issue Open

bug

codertimo/BERT-pytorch#33 · 2 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026

Pretrained model transfer to pytorch Open

enhancement help wanted

codertimo/BERT-pytorch#34 · 8 comments · 11 reactions · 1 assignee · Indexed Sep 15, 2026

how to test the model? Open

enhancement question

codertimo/BERT-pytorch#38 · 2 comments · 3 reactions · 0 assignees · Indexed Sep 15, 2026

MASKGAN: BETTER TEXT GENERATION VIA FILLING IN THE ___ Open

GAN paper text-generation

codertimo/paper-log#3 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026

Recent Progress on Generative Adversarial Networks (GANs): A Survey Open

GAN paper

codertimo/paper-log#4 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026

[Stanford] Artificial Intelligence Index Report 2019 Open

documentation survey

codertimo/paper-log#5 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026

Becoming an Independent Researcher and getting published in ICLR with spotlight Open

post

codertimo/paper-log#6 · 2 comments · 1 reaction · 1 assignee · Indexed Sep 15, 2026

Evaluating Style Transfer for Text Open

2019 NAACL paper style-transfer

codertimo/paper-log#7 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026

Paper List for Style Transfer in Text Open

style-transfer survey

codertimo/paper-log#8 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026

Style Transfer for Texts: Retrain, Report Errors, Compare with Rewrites Open

2019 EMNLP paper style-transfer

codertimo/paper-log#10 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026

Domain Adaptive Text Style Transfer Open

2019 EMNLP paper style-transfer

codertimo/paper-log#11 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026

Transforming Delete, Retrieve, Generate Approach for Controlled Text Style Transfer Open

2019 EMNLP paper style-transfer

codertimo/paper-log#12 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026

Mask and Infill: Applying Masked Language Model to Sentiment Transfer Open

2019 IJCAI paper style-transfer

codertimo/paper-log#13 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026

Unsupervised Text Attribute Transfer via Iterative Matching and Translation Open

2019 EMNLP paper style-transfer

codertimo/paper-log#14 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026

Ian Goodfellow: Adversarial Machine Learning (ICLR 2019 invited talk) Open

2019 adversarial ICLR video

codertimo/paper-log#16 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026

Yoshua Bengio: From System 1 Deep Learning to System 2 Deep Learning (NeurIPS 2019) Open

2019 NeurIPS video

codertimo/paper-log#17 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026

Formality Style Transfer with Hybrid Textual Annotations Open

2019 paper style-transfer

codertimo/paper-log#20 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026

Grammatical Error Correction and Style Transfer via Zero-shot Monolingual Translation Open

2019 arxiv paper style-transfer

codertimo/paper-log#21 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026

Contextual Text Style Transfer Open

2019 arxiv paper style-transfer

codertimo/paper-log#24 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026

Style Transfer Through Back-Translation Open

2018 ACL paper style-transfer

codertimo/paper-log#26 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026

Tie the input and output embedding? Open

enhancement

codertimo/BERT-pytorch#40 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026

the format of input Open

question

codertimo/BERT-pytorch#41 · 4 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026

Making Wikipedia Corpus Open

help wanted

codertimo/BERT-pytorch#42 · 1 comment · 2 reactions · 0 assignees · Indexed Sep 15, 2026

Making Book Corpus Open

help wanted

codertimo/BERT-pytorch#43 · 5 comments · 2 reactions · 0 assignees · Indexed Sep 15, 2026

What should be the shapes and example of values of x and segment_info in BERT.forward? Open

codertimo/BERT-pytorch#48 · 0 comments · 6 reactions · 0 assignees · Indexed Sep 15, 2026

Question about the loss of Masked LM Open

good first issue

codertimo/BERT-pytorch#49 · 5 comments · 13 reactions · 0 assignees · Indexed Sep 15, 2026

made a script to generate bert pre-train data Open

codertimo/BERT-pytorch#50 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026

IndexError: list index out of range Open

codertimo/BERT-pytorch#52 · 13 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026

PositionalEmbedding Open

good first issue

codertimo/BERT-pytorch#53 · 3 comments · 4 reactions · 0 assignees · Indexed Sep 15, 2026

will "random.randint(self.corpus_lines if self.corpus_lines < 1000 else 1000)" report error? Open

codertimo/BERT-pytorch#55 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026

chooses 15% of token Open

good first issue

codertimo/BERT-pytorch#56 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 15, 2026

How to test your model after training on my own dataset? Open

codertimo/BERT-pytorch#57 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026

self.d_k = d_model // h gives 64 dimension ? Open

codertimo/BERT-pytorch#60 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026

How can I finetune with this project Open

codertimo/BERT-pytorch#61 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026

OOM error in cuda while passing large corpus of wikipedia text files ? how to manage big files to train Open

codertimo/BERT-pytorch#64 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026

Erroneous Code Open

codertimo/BERT-pytorch#65 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026

ONNX conversion: TransformerBlock problem Open

codertimo/BERT-pytorch#67 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026

Vocab's load_vectors seems to be an old method? Open

codertimo/BERT-pytorch#69 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026

# of parameter is larger than bert base instead im using specs less than bert base Open

codertimo/BERT-pytorch#70 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026

Did you have tried to use ipdb to set breakpoint in __get__item__, which is a funtion from BERTDataset Open

codertimo/BERT-pytorch#71 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026

predict next sentence ony? it also can do SQA assignments? Open

codertimo/BERT-pytorch#72 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026

Can you share me a trained data? Open

codertimo/BERT-pytorch#73 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026

How to use BERT model to fine-tune a cloze-style task? Open

codertimo/BERT-pytorch#74 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026

If I want to use /u as a placeholder instead of /t, what do I need to do Open

codertimo/BERT-pytorch#75 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026

How to Output Embedded Sentence Vector? Open

codertimo/BERT-pytorch#76 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026

embedding/position.py with RuntimeError if d_model is odd Open

codertimo/BERT-pytorch#78 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026

Get new issues in your inbox