Benjamin-Lee / Benjamin-Lee/deep-rules

The Secrets of Machine Learning: Ten Things You Wish You Had Known Earlier to be More Effective at Data Analysis

Open
#206 1 comment 0 reactions 0 assignees View on GitHub
paper
Dominant language
HTML
Stars
226
Forks
44
PR merge metrics
No merged PRs in 30d

Description

https://arxiv.org/abs/1906.01998

> Despite the widespread usage of machine learning throughout organizations, there are some key principles that are commonly missed. In particular: 1) There are at least four main families for supervised learning: logical modeling methods, linear combination methods, case-based reasoning methods, and iterative summarization methods. 2) For many application domains, almost all machine learning methods perform similarly (with some caveats). Deep learning methods, which are the leading technique for computer vision problems, do not maintain an edge over other methods for most problems (and there are reasons why). 3) Neural networks are hard to train and weird stuff often happens when you try to train them. 4) If you don't use an interpretable model, you can make bad mistakes. 5) Explanations can be misleading and you can't trust them. 6) You can pretty much always find an accurate-yet-interpretable model, even for deep neural networks. 7) Special properties such as decision making or robustness must be built in, they don't happen on their own. 8) Causal inference is different than prediction (correlation is not causation). 9) There is a method to the madness of deep neural architectures, but not always. 10) It is a myth that artificial intelligence can do anything.

Could be relevant to this project. I haven't read it carefully enough to see what I agree or disagree with.

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the linked arXiv paper and its ten listed machine-learning principles in the issue body. Determine whether it belongs in this project and what specific manuscript or content change would be justified; completion is a documented decision and a clearly scoped proposed addition, if any.

Written by the indexing model from the issue text.

Assessment

Tech stack
machine-learning
Domain
content
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.