aboutcode-org / aboutcode-org/scancode-toolkit

Collect all GenAI licenses for correct detection

Đang mở
#4,567 4 bình luận 0 reaction 1 người được giao Được giao cho @Godzilaa Xem trên GitHub
Ngôn ngữ chính
Python
Star
2.6k
Fork
791
Merge trung bình
1 ngày 12 giờ
Pull request đã merge (30 ngày)
5

Mô tả

We need to ensure that LLMs have a clear license. This is messy out there with a lot of new, weird, proprietary licenses.

There is something that would be super useful wrt. AI: find all these licenses!

The process would be:
- [ ] Collect the metadata files from all Hugging Face GenAi repos
- [ ] Scan GenAi metadata files with scancode
- [ ] Review GenAi metadata file scan results for correctness
- [ ] Create new licenses, and new license rules used @ HuggingFace

When cloning all the repos @ Hugging Face, these should shallow clones, without Git LFS and without xet large files, and possibly partial clone to focus only on a few files: model cards and licenses, and related metadata files. See for ideas:
- https://github.com/aboutcode-org/federatedcode/issues/82

Running ScanCode license detection on that and review the results to find all the funky new AI-licenses and notices may be best done in ScanCode.io for efficiency, but the licenses are ultimately created in ScanCode toolkit

Hướng dẫn đóng góp

Mở hướng dẫn đóng góp

Đánh giá

Issue này chưa được đánh giá.

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.