Difference between revisions of "Resources"

From AI Matters Wiki
Jump to: navigation, search
(Machine Learning: addition)
(CTR Prediction resources)
 
(7 intermediate revisions by the same user not shown)
Line 22: Line 22:
 
*** [https://sites.ualberta.ca/~szepesva/RLBook.html Csaba Szepesvári. Algorithms for Reinforcement Learning]
 
*** [https://sites.ualberta.ca/~szepesva/RLBook.html Csaba Szepesvári. Algorithms for Reinforcement Learning]
 
*** [http://dl.acm.org/citation.cfm?id=2670001 Marco Wiering and Martijn van Otterlo. Reinforcement Learning: State-of-the-Art]
 
*** [http://dl.acm.org/citation.cfm?id=2670001 Marco Wiering and Martijn van Otterlo. Reinforcement Learning: State-of-the-Art]
 +
** [http://www.kdnuggets.com/2017/04/10-free-must-read-books-machine-learning-data-science.html KDNuggets "10 Free Must-Read Books for Machine Learning and Data Science"]
 
* Online resources:
 
* Online resources:
 
** [https://www.coursera.org/learn/machine-learning Andrew Ng's free online Coursera Machine Learning course]
 
** [https://www.coursera.org/learn/machine-learning Andrew Ng's free online Coursera Machine Learning course]
Line 44: Line 45:
 
** [http://cs231n.github.io/convolutional-networks/ Stanford's CS 231n Convolutional Networks course website]
 
** [http://cs231n.github.io/convolutional-networks/ Stanford's CS 231n Convolutional Networks course website]
 
** various Wikipedia pages concerning [https://en.wikipedia.org/wiki/Artificial_neural_network artificial neural networks]
 
** various Wikipedia pages concerning [https://en.wikipedia.org/wiki/Artificial_neural_network artificial neural networks]
 +
** [http://playground.tensorflow.org/ TensorFlow Playground]
 +
** [https://distill.pub/2017/momentum/ Why Momentum Really Works]
 +
** [http://lamda.nju.edu.cn/weixs/project/CNNTricks/CNNTricks.html Xiu-Shen Wei's Must Know Tips/Tricks in Deep Neural Networks]
 +
** [https://medium.com/towards-data-science/secret-sauce-behind-the-beauty-of-deep-learning-beginners-guide-to-activation-functions-a8e23a57d046 Medium.com guide: Understanding Activation Functions]
 +
** [https://github.com/williamFalcon/DeepRLHacks John Schulman's Deep RL Hacks (summarized by William Falcon)]
 +
** [https://blog.waya.ai/deep-residual-learning-9610bb62c355 Michael Dietz's Understand Deep Residual Networks]
 
*Online Courses
 
*Online Courses
** [https://www.coursera.org/learn/machine-learning Andrew Ng's Machine Learning course]
+
** [https://www.coursera.org/learn/machine-learning Andrew Ng's Machine Learning course] and [https://www.coursera.org/specializations/deep-learning Coursera Deep Learning specialization]
 
** [https://www.coursera.org/learn/neural-networks Geoffrey Hinton's Neural Networks for Machine Learning course]
 
** [https://www.coursera.org/learn/neural-networks Geoffrey Hinton's Neural Networks for Machine Learning course]
 
** [http://www.dmi.usherb.ca/~larocheh/neural_networks Hugo Larochelle's graduate-level online Neural Network course]
 
** [http://www.dmi.usherb.ca/~larocheh/neural_networks Hugo Larochelle's graduate-level online Neural Network course]
Line 62: Line 69:
 
** [http://timdettmers.com/2017/04/09/which-gpu-for-deep-learning Tim Dettmers' GPU comparison study]
 
** [http://timdettmers.com/2017/04/09/which-gpu-for-deep-learning Tim Dettmers' GPU comparison study]
 
** [https://d4datascience.wordpress.com/2017/05/06/setting-up-a-gpu-based-deep-learning-machine/ Ved's d4datascience blog entry on setting up a GPU-based deep learning machine]
 
** [https://d4datascience.wordpress.com/2017/05/06/setting-up-a-gpu-based-deep-learning-machine/ Ved's d4datascience blog entry on setting up a GPU-based deep learning machine]
 +
 +
=Hidden Markov Models=
 +
* Video Introductions
 +
** [https://youtu.be/mNSQ-prhgsw Daphne Koller's 12-minute video "Template Models: Hidden Markov Models - Stanford University"]
 +
** [https://youtu.be/jY2E6ExLxaw Nando de Freitas' 52-minute UBC lecture "undergraduate machine learning 9: Hidden Markov models - HMM"]
 +
* Texts and Articles
 +
** Russell and Norvig, Artificial Intelligence: a modern approach, 3rd ed, sections 15.3, 20.3.3.
 +
** [https://web.stanford.edu/~jurafsky/slp3/9.pdf Speech and Language Processing, 3rd ed, Chapter 9 by Daniel Jurafsky and James H. Martin]
 +
** [http://www.ece.ucsb.edu/Faculty/Rabiner/ece259/Reprints/tutorial%20on%20hmm%20and%20applications.pdf Lawrence Rabiner tutorial "A tutorial on hidden Markov models and selected applications in speech recognition"]
 +
** Christopher Bishop's "Pattern Recognition and Machine Learning", Section 13.2
 +
** [https://stats.stackexchange.com/questions/3294/resources-for-learning-markov-chain-and-hidden-markov-models StackExchange thread "Resources for learning Markov chain and hidden Markov models"]
 +
* Other Resources
 +
** [https://www.udacity.com/course/intro-to-artificial-intelligence--cs271 Udacity's `"Intro to Artificial Intelligence" course by Peter Norvig and Sebastian Thrun]
 +
** [https://www.udacity.com/course/probabalistic-models--cx27 Udacity's "Artificial Intelligence - Probabalistic Models"]
 +
** [https://www.coursera.org/learn/bioinformatics-pku/lecture/7pbUo/hidden-markov-model Coursera's Ge Gao lecture on HMMs]
 +
** [http://cs.jhu.edu/~jason/papers/eisner.hmm.xls Jason Eisner's spreadsheet for teaching the forward-backward algorithm] and [https://cs.jhu.edu/~jason/papers/eisner.tnlp02.pdf his paper on using it for teaching]
 +
** [https://www.quora.com/What-are-some-good-resources-for-learning-about-Hidden-Markov-Models Quora question "What are some good resources for learning about Hidden Markov Models?"]
 +
* [http://modelai.gettysburg.edu Model AI Assignments]
 +
** [http://modelai.gettysburg.edu/2017/hmm Sravana Reddy's "Implementing a Hidden Markov Model Toolkit"]
 +
** [http://modelai.gettysburg.edu/2010/pacman/projects/tracking/busters.html John DeNero and Dan Klein's "The Pac-Man Projects" Project #4: Ghostbusters]
 +
 +
=Click-Through Rate (CTR) Prediction=
 +
* [https://www.kaggle.com/ Kaggle] CTR Prediction Competitions:
 +
** [https://www.kaggle.com/c/criteo-display-ad-challenge Criteo]
 +
** [https://www.kaggle.com/c/avazu-ctr-prediction Avazu]
 +
** [https://www.kaggle.com/c/avito-context-ad-clicks Avito]
 +
** [https://www.kaggle.com/c/outbrain-click-prediction Outbrain]
 +
* [https://xgboost.readthedocs.io/en/latest/ XGBoost] - Extreme Gradient Tree Boosting
 +
** [https://dl.acm.org/citation.cfm?doid=2939672.2939785 XGBoost: A Scalable Tree Boosting System] 
 +
* [https://github.com/guestwalk/libffm libffm] - library for Field-aware Factorization Machines (FFMs)
 +
** [https://dl.acm.org/citation.cfm?doid=2959100.2959134 Field-aware factorization machines for CTR prediction]
 +
** [https://www.csie.ntu.edu.tw/~r01922136/kaggle-2014-criteo.pdf Slides on winning approach to Criteo CTR Prediction competition]

Latest revision as of 13:31, 15 September 2018

Starting Places

General

Machine Learning

Neural Network Learning

Hidden Markov Models

Click-Through Rate (CTR) Prediction