Data source: Wikipedia Talk Pages

These could make a nice question/answer data format, they're kind-of tree like but would need a lot of filtering and formatting into trees.

Some initial research if anyone wants to have a stab at this:

• The dataset is licensed under CC-SA-BY
• Data dumps are at https://dumps.wikimedia.org/enwiki/latest/ (replace en with language code of your choice)
• Talk pages are included in "pages-meta-current" and match [a-zA-Z]+wiki\-[0-9]+\-pages\-meta\-current[0-9]+\.xml.*\.bz2
• They are 1GB each when unzipped. bzip2 --decompress some_file.bz2 creates some_file.bz2
• You'll want to use a SAX parser rather than load it all in one go, due to the file size
• Filter by <page> elements then by <ns>1</ns> to get talk pages, and extract the <id> and <text>
• All text is in MediaWiki WikiMarkup
• Conversation topic starts with ==Topic== if there is one set
• Messages end with a person's user link and a timestamp [[User:chummer|chummer]] 05:45, 13 Feb 2005 (UTC). The user link may be an IP address, both are PII
• Replies to messages start on a line with some number of :s to show how indented it is, this combined with the above is how to build the thread.
• There's a lot of bile and arguments in there, so it could be useful for an argumentation model (lol) or at least need a lot of filtering.
• Much of it talks about what needs to be done or is done, might be worth filtering that out too.