e-p-armstrong / e-p-armstrong/augmentoolkit

First input file is the only one processed

Open
#61 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.9k
Forks
248
PR merge metrics
No merged PRs in 30d

Description

Our input folder contains 11 files. All appear to be read in:
Successfully read file: ./input/innovationqkb.glossary.WordPress.2024-07-27.xml.md
JSON file saved successfully.
Successfully read file: ./input/innovationqkb.WordPress.2024-07-26.xml.md
JSON file saved successfully.
Successfully read file: ./input/ipcomkb.WordPress.2024-07-26.xml.md
JSON file saved successfully.
Successfully read file: ./input/iqideaskb.WordPress.2024-07-26.xml.md
JSON file saved successfully.
Successfully read file: ./input/ipcomkb.faq.WordPress.2024-07-27.xml.md
JSON file saved successfully.
Successfully read file: ./input/priorartdatabasekb.WordPress.2024-07-26.xml.md
JSON file saved successfully.
Successfully read file: ./input/iqideaskb.faq.WordPress.2024-07-27.xml.md
JSON file saved successfully.
Successfully read file: ./input/innovationqkb.faq.WordPress.2024-07-27.xml.md
JSON file saved successfully.
Successfully read file: ./input/priorartdatabasekb.glossary.WordPress.2024-07-27.xml.md
JSON file saved successfully.
Successfully read file: ./input/iqideaskb.glossary.WordPress.2024-07-27.xml.md
JSON file saved successfully.
Successfully read file: ./input/priorartdatabasekb.faq.WordPress.2024-07-27.xml.md
Pretraining set created.

However, only the first file: ./input/innovationqkb.glossary.WordPress.2024-07-27.xml.md has question/answer pairs produced.

The augmentoolkit output messages do not appear to give an indication as to whether there is an issue.
COMPLETED PHASE 0
Output written to /tmp/augmentoolkit/original/output/question_generation_generations/question_generation_generations/a0db9260-500e>
Output written to /tmp/augmentoolkit/original/output/question_generation_generations/question_generation_generations/a7bc5e7d-950c>
Output written to /tmp/augmentoolkit/original/output/question_generation_generations/question_generation_generations/bd42e735-6bba>
Output written to /tmp/augmentoolkit/original/output/question_generation_generations/question_generation_generations/c6ddcde3-8678>
Output written to /tmp/augmentoolkit/original/output/question_generation_generations/question_generation_generations/15a96815-222f>
FAILED TO GENERATE QUESTIONS!
Output written to /tmp/augmentoolkit/original/output/question_generation_generations/question_generation_generations/91488b07-8c85>
Output written to /tmp/augmentoolkit/original/output/question_generation_generations/question_generation_generations/f8913bd2-afb5>
Output written to /tmp/augmentoolkit/original/output/question_generation_generations/question_generation_generations/8ef1f903-2906>
Output written to /tmp/augmentoolkit/original/output/question_generation_generations/question_generation_generations/ee46ce5b-8461>
FAILED TO GENERATE QUESTIONS!
Output written to /tmp/augmentoolkit/original/output/question_generation_generations/question_generation_generations/86b05937-c2a0>
Output written to /tmp/augmentoolkit/original/output/question_generation_generations/question_generation_generations/1b6b185c-b3fd>
Output written to /tmp/augmentoolkit/original/output/question_generation_generations/question_generation_generations/0adb9229-3210>
Output written to /tmp/augmentoolkit/original/output/question_generation_generations/question_generation_generations/d51cf6a9-1745>
FAILED TO GENERATE QUESTIONS!
Output written to /tmp/augmentoolkit/original/output/question_generation_generations/question_generation_generations/921636fe-4076>
FAILED TO GENERATE QUESTIONS!
Output written to /tmp/augmentoolkit/original/output/question_generation_generations/question_generation_generations/456d0805-b8c7>
Output written to /tmp/augmentoolkit/original/output/question_generation_generations/question_generation_generations/f09a3fd9-3fcf>
FAILED TO GENERATE QUESTIONS!
Output written to /tmp/augmentoolkit/original/output/question_generation_generations/question_generation_generations/bf45b67b-81da>
FAILED TO GENERATE QUESTIONS!
Output written to /tmp/augmentoolkit/original/output/question_generation_generations/question_generation_generations/01b56723-abdf>
Output written to /tmp/augmentoolkit/original/output/question_generation_generations/question_generation_generations/b89ac365-1286>
FAILED TO GENERATE QUESTIONS!
Output written to /tmp/augmentoolkit/original/output/question_generation_generations/question_generation_generations/1f0d3583-f9e7>
COMPLETED PHASE 1

Each file written in phase 1 appears to correspond to questions/answers related to a paragraph in the document: ./input/innovationqkb.glossary.WordPress.2024-07-27.xml.md

What are some possible reasons that files in the input folder are skipped?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.