aboutcode-org / aboutcode-org/scancode-toolkit

[GSoC] Integrate the trained model to inject required phrases into rules

Abierto
#5,243 0 comentarios 0 reacciones 0 asignados Ver en GitHub
GSoC
Lenguaje dominante
Python
Estrellas
2.6k
Forks
791
Merge medio
1 d 12 h
PR fusionados (30 d)
5

Descripción

follows #5137. uses the trained model from there

## Goal

Run the finetuned model over eligible rules that have no required phrases, and
inject the predicted {{ }} markers using scancode's existing helpers

## Tasks

- load the trained model (PyTorch, fp32) and run inference on rule text
- pick target rules with get_updatable_rules_by_expression (skips ineligible ones)
- rebuild predicted phrases from the BIOES spans
- validate every phrase with is_good() before writing
- inject with add_required_phrase_to_rule, tagged source=ml_model
- --dry-run and a confidence threshold so only confident phrases auto-inject
- note to run scancode-reindex-licenses after any write

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.