Try out different tokenizers?

The current tokenizer is pretty unaware of the structure of the text. Situations to improve upon would be

## tokenizing links

Something like `http://www.google.com/useless/junk` gets transformed `[http, www, google, com, useless, junk]` when I think it would be better to just be `[http://www.google.com]` since talking about just http and https is common in rust and some links like `docs` or `github.com` are very good indicators

It also allows for actually using links like `v.reddit.com` and `i.reddit.com` that lose a lot of structure when tokenized

## tokenizing code

Code blocks are very common in r/rust posts yet much of the syntax is ignored when tokenizing. It would be good to either recognize the code block and retain certain information normally stripped out (like `::` or `->` for example), or it would likely just be enough to recognize a code block and classify if it's rust (since that would be very unlikely to see for the rust game

## tokenizing reddit specific things

This is primarily for certain reddit specific things like `/u/username` or `/r/subreddit`

La issue non indica file né test. Inizia individuando il tokenizer corrente e i relativi test, quindi confronta come vengono rappresentati i link, i blocchi di codice, la sintassi Rust e i percorsi Reddit. Il lavoro sarebbe completato quando sarà stato concordato l’ambito e i test dimostreranno che le strutture selezionate conservano le informazioni previste.

Scritto dal modello di indicizzazione a partire dal testo della issue.