2016/04/25 ML Reddit

• Dirichlet Processes And Friends with Ryan Adams: https://www.youtube.com/watch?v=xusN7RqKpPI (Sydney MLSS 2015)
• New Papers Dividing Logical Uncertainty into Two Subproblems: https://intelligence.org/2016/04/21/two-new-papers-uniform/
• Sorry ARIMA, But I’m Going Bayesian: http://multithreaded.stitchfix.com/blog/2016/04/21/forget-arima/
• Neural Networks to Upscale & Stylize Pixel Art: https://nucl.ai/blog/enhance-pixel-art/
• Generative Choreography: http://peltarion.com/creative-ai
• The Master Algorithm: http://blog.computationalcomplexity.org/2016/04/the-master-algorithm.html
• This Week in ML: http://i.imgur.com/9fLbZxl.png
• TensorFlow Introductory Lecture: https://www.reddit.com/r/MachineLearning/comments/4fwnjf/tensorflow_introductory_lecture/
• Wikipedia Exploring with Machine Learning Chrome Extension: https://chrome.google.com/webstore/detail/similar-pages-for-wikiped/ibabphmjpolljfillmhiikhdohbolado
• Doom AI Competition: http://vizdoom.cs.put.edu.pl/competition-cig-2016
• Training Deep Nets with Sublinear Memory Cost: https://arxiv.org/abs/1604.06174
• The Amazing Power of Word Vectors: https://blog.acolyer.org/2016/04/21/the-amazing-power-of-word-vectors/
• Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivation: http://arxiv.org/abs/1604.06057
• DenseCap: Fully Convolutional Localization Networks for Dense Captioning: http://cs.stanford.edu/people/karpathy/densecap/
• Backpropogating an LSTM: A Numerical Example: https://blog.aidangomez.ca/2016/04/17/Backpropogating-an-LSTM-A-Numerical-Example/
• ML Meets Economics, Part 2: http://blog.mldb.ai/blog/posts/2016/04/ml-meets-economics2/
• Visualization of Different Classification Algorithms: http://haifengl.github.io/smile/index.html#classification
• Course on Deep Learning by joanbruna: http://joanbruna.github.io/stat212b/
• Short Science, Summary Sharing Service for Academic Papers: http://www.shortscience.org/about
• What ConvNets See When It Sees Nudity: http://blog.clarifai.com/what-convolutional-neural-networks-see-at-when-they-see-nudity/#.Vx1i8Pl95hF
• Bridging the Gaps Between Residual Learning, RNNs, and Visual Cortex: http://arxiv.org/abs/1604.03640v1
• Training A Big Data Machine to Defend: http://people.csail.mit.edu/kalyan/AI2_Paper.pdf
• Futhark Programming Language – High-Performance Purely Functional Data-parallel Array Programming on the GPU: http://futhark-lang.org//
• Improving the Robustness of Deep Neural Networks via Stability Training: http://arxiv.org/abs/1604.04326
• CondensedLectures – Stanford Machine Learning Lecture 2: https://www.youtube.com/watch?v=n8LXeHUNeXg

2016/04/18 ML Reddit

• Neural Calculator: http://armlessjohn404.github.io/calcuMLator/
• TensorFlow Playground: http://playground.tensorflow.org/#activation=tanh&batchSize=10&dataset=circle&regDataset=reg-plane&learningRate=0.03&regularizationRate=0&noise=0&networkShape=4,2&seed=0.15690&showTestData=false&discretize=false&percTrainData=50&x=true&y=true&xTimesY=false&xSquared=false&ySquared=false&cosX=false&sinX=false&cosY=false&sinY=false&collectStats=false&problem=classification
• A Few Useful Things to Know about Machine Learning: https://homes.cs.washington.edu/~pedrod/papers/cacm12.pdf
• TensorFlow 0.8 with Distributed Computing Support: http://googleresearch.blogspot.kr/2016/04/announcing-tensorflow-08-now-with.html
• DeepMark: Deep Learning Benchmarks: https://github.com/DeepMark/deepmark
• AlphaGo under a Magnifying Glass: http://deeplearningskysthelimit.blogspot.kr/2016/04/part-2-alphago-under-magnifying-glass.html
• Google’s New Machine Learning Video Lecture: https://www.youtube.com/playlist?list=PLOU2XLYxmsIIuiBfYad6rFYQU_jL2ryal
• Google’s Cloud Speech API Released: https://cloudplatform.googleblog.com/2016/03/Google-takes-Cloud-Machine-Learning-service-mainstream.html
• End-end DNN Not Possible for Self Driving Cars: https://www.youtube.com/watch?v=GCMXXXmxG-I&feature=youtu.be&t=438

2016/04/11 ML Reddit

• LIME – Local Interpretable Model-Agnostic Explanations: http://homes.cs.washington.edu/~marcotcr/blog/lime/
• MetaMind acquired by Salesforce: https://www.metamind.io/salesforce-acquisition
• Frontiers in Graphical Models Research?: https://www.reddit.com/r/MachineLearning/comments/4dbeeg/frontiers_in_graphical_models_research/
• ML and AI Podcasts to Recommend?: https://www.reddit.com/r/MachineLearning/comments/4dbfw6/ml_ai_podcasts_to_reccommend/
• Deep3D: Automatic 2D-to-3D Video Conversion with CNNs: http://dmlc.ml/mxnet/2016/04/04/deep3d-automatic-2d-to-3d-conversion-with-CNN.html
• Panama Papers Dataset 2016: https://github.com/amaboura/panama-papers-dataset-2016
• Pastalog: Simple, Realtime Visualization of NN Training Performance: https://github.com/rewonc/pastalog
• Deep Learning and the Future of AI: https://mediastream.cern.ch/MediaArchive/Video/Public2/weblecture-player/index.html?year=2016&lecture=510372
• NVidia Releases Tesla P100 with Pascal Architecture: http://www.nvidia.com/object/tesla-p100.html (NVidia P100 Architecture Deep Dive: http://www.pcgamer.com/nvidia-pascal-p100-architecture-deep-dive/
• State-of-the-arts in NLP and Their Discussion: https://www.reddit.com/r/MachineLearning/comments/4dkrw1/some_stateofthearts_in_natural_language/
• Towards Bayesian Deep Learning: A Survey: http://arxiv.org/abs/1604.01662
• Evolutionary Computation – Part 1: http://www.alanzucconi.com/2016/04/06/evolutionary-coputation-1/
• Introduction to Debugging NN: http://russellsstewart.com/notes/0.html
• TensorFlow Scan Examples: https://nbviewer.jupyter.org/github/rdipietro/tensorflow-notebooks/blob/master/tensorflow_scan_examples/tensorflow_scan_examples.ipynb
• Learning in Brains and Machines (2): The Dogma of Sparsity: http://blog.shakirm.com/2016/04/learning-in-brains-and-machines-2/
• Is It Better to Have More Training Data Which Are Close to the Decision Boundary, or More Data Which Are “Typical” of Their Class?: https://www.reddit.com/r/MachineLearning/comments/4dwa6q/is_it_better_to_have_more_training_data_which_are/
• Deep Networks with Stochastic Depth Keras Implementation: https://github.com/dblN/stochastic_depth_keras
• Deep Learning for Beginners: http://randomekek.github.io/deep/deeplearning.html
• Resources for GPU Programming: https://www.reddit.com/r/MachineLearning/comments/4dxgd5/resources_for_gpu_programming/
• RNN Online Demos: https://www.reddit.com/r/MachineLearning/comments/4e0aya/rnn_online_demos/
• Someone Shared His Solution for Andrew Ng’s ML Course: https://www.reddit.com/r/MachineLearning/comments/4dyf62/my_python_solutions_to_andrew_ngs_coursera_ml/
• ArgMax Differentiable?: https://www.reddit.com/r/MachineLearning/comments/4e2get/argmax_differentiable/
• How Do You Organize/Manage Your pdf/paper Collection?: https://www.reddit.com/r/MachineLearning/comments/4e0i4h/how_do_you_organize_manage_your_pdfpaper/
• Foveation-based Mechanisms Alleviate Adversarial Examples: http://arxiv.org/abs/1511.06292
• What Are the Primary Differences in Research That a Professor Does at a University vs. What an Industry Researcher Would Do?: https://www.reddit.com/r/MachineLearning/comments/4e2mlr/what_are_the_primary_differences_in_research_that/
• The Ultimate List of Machine Learning and Data Mining Books: http://www.aioptify.com/topmldmbooks.php
• Free eBook on Machine Learning for Recommender Systems: http://subhrajitroy.com/machine-learning-for-recommender-systems-ebook/

 

2016/04/04 ML Reddit

• Markov Chains Explained Visually: http://setosa.io/ev/markov-chains/
• Deep Learning for Real-Time Atari Game Play Using Offline Monte-Carlo Tree Search Planning: https://papers.nips.cc/paper/5421-deep-learning-for-real-time-atari-game-play-using-offline-monte-carlo-tree-search-planning.pdf
• Hyperparameter Selection: https://www.reddit.com/r/MachineLearning/comments/4cff3e/hyperparameter_selection/
• Can I Hug That? Classifier Trained To Tell You Wheter Or Not What’s In an Image Is Huggable: http://imgur.com/a/T1QNL
• Quadcopter Navigation in the Forest Using Deep Neural Networks: https://www.youtube.com/watch?v=umRdt3zGgpU&feature=share
• What Are You Working On?: https://www.reddit.com/r/MachineLearning/comments/4cf7k3/what_are_you_working_on/
• Table of XX2Vec Algorithms: http://datascienceassn.org/content/table-xx2vec-algorithms
• Attend, Infer, Repeat: Fast Scene Understanding with Generative Models: http://arxiv.org/abs/1603.08575
• IBM’s True North Being Deployed at Livermore National Lab: http://arstechnica.com/science/2016/03/ibms-brain-inspired-chip-finds-a-home-at-livermore-national-lab/
• Recurrent Batch Normalization: http://arxiv.org/abs/1603.09025
• Adaptive Computation Time for Recurrent Neural Networks: http://arxiv.org/abs/1603.08983
• OpenAI Has Started Hiring: https://openai.com/blog/team-plus-plus/
• arXiv-title-fixer: Paper Titles as Tab Titles on Chrome: https://www.reddit.com/r/MachineLearning/comments/4cq9b4/arxivtitlefixer_paper_titles_as_tab_titles_on/
• TFLearn: High Level API for TensorFlow: https://github.com/tflearn/tflearn
• MS Releases Their ML API: https://www.microsoft.com/cognitive-services/en-us/apis
• Music Language Modeling with RNN: http://yoavz.com/music_rnn/
• Recurrent Autoencoder?: https://www.reddit.com/r/MachineLearning/comments/4cvfkh/q_recurrent_autoencoder/
• Deep Networks with Stochastic Depth: http://arxiv.org/abs/1603.09382v1
• As Silicon Valley Fights for Talent, Universities Struggle to Hold on to Their Stars: http://www.economist.com/news/business/21695908-silicon-valley-fights-talent-universities-struggle-hold-their
• Generating Large Images from Latent Vectors: http://blog.otoro.net/2016/04/01/generating-large-images-from-latent-vectors/
• Pentagon Eyes Deep Machine Learning in Fight Against ISIS: http://www.govtech.com/federal/Pentagon-Eyes-Deep-Machine-Learning-in-Fight-Against-ISIS.html
• A Radical Approach to Computation with Real Numbers: http://www.johngustafson.net/presentations/Multicore2016-JLG.pdf
• Interview with Hassabis from MIT Tech Review: https://www.technologyreview.com/s/601139/how-google-plans-to-solve-artificial-intelligence/
• Chess Position Evaluation with CNN in Julia: https://www.reddit.com/r/MachineLearning/comments/4d5s5b/chess_position_evaluation_with_convolutional/
• Stochastic Depth Networks Will Become the New Normal: http://deliprao.com/archives/134
• lda2vec: Tools for Interpreting Natural Language: https://github.com/cemoody/lda2vec

 

2016/03/28 ML Reddit

• Machine Learning: An In-Depth, Non-Technical Guide Part 5: https://medium.com/innoarchitech-innovation-architecture-technology/machine-learning-an-in-depth-non-technical-guide-part-5-b134da025a3e#.cctsrpd4b
• Does The Number of Layers In An LSTM Network Affect Its Ability To Remember Long Patterns?: https://www.reddit.com/r/MachineLearning/comments/4behuh/does_the_number_of_layers_in_an_lstm_network/
• Deep Advances in Generative Modeling: https://www.youtube.com/watch?v=KeJINHjyzOU
• Structured VAEs: Composing Probabilistic Graphical Models and Variational Autoencoders: http://arxiv.org/abs/1603.06277
• Latent Predictor Networks for Code Generation: http://arxiv.org/abs/1603.06744
• text2image: Generating Images from Captions with Attention: https://github.com/emansim/text2image
• Google Releases Cloud Machine Learning with TensorFlow: http://googleresearch.blogspot.kr/2016/03/machine-learning-in-cloud-with.html?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed:+blogspot/gJZg+(Official+Google+Research+Blog)
• Escaping from Saddle Points: http://www.offconvex.org/2016/03/22/saddlepoints/
• Recurrent Dropout without Memory Loss: http://arxiv.org/abs/1603.05118
• A Guide to Convolution Arithmetic for Deep Learning: http://arxiv.org/abs/1603.07285
• An ALternative Update Rule for Generative Adversarial Networks: http://www.inference.vc/an-alternative-update-rule-for-generative-adversarial-networks/
• NNPACK – Acceleration Package for Neural Networks on Multi-core CPUs: https://github.com/Maratyszcza/NNPACK
• Microsoft’s AI Millennial Chatbot Became A Racist Jerk After Less Than a Day on Twitter: http://qz.com/646825/microsofts-ai-millennial-chatbot-became-a-racist-jerk-after-less-than-a-day-on-twitter/
• Harnessing Deep Neural Networks with Logic Rules: http://arxiv.org/abs/1603.06318
• Adversarial Preference Loss: http://www.inference.vc/adversarial-preference-loss/
• Acceleration of Deep Neural Network Training with Resistive Cross-Point Devices: http://arxiv.org/abs/1603.07341
• Misleading Modelling: Overfitting, Cross-validation, and the Bias-variance Trade-off: http://blog.cambridgecoding.com/2016/03/24/misleading-modelling-overfitting-cross-validation-and-the-bias-variance-trade-off/
• L-BFGS and Neural Nets: https://www.reddit.com/r/MachineLearning/comments/4bys6n/lbfgs_and_neural_nets/
• TayAndYou – Toxic Before Human Contact: http://smerity.com/articles/2016/tayandyou.html
• Deep Spelling – Rethinking Spelling Correction in the 21st Century: https://medium.com/@majortal/deep-spelling-9ffef96a24f6#.tebxaodzi
• Generating Factoid Questions with Recurrent Neural Networks: http://arxiv.org/pdf/1603.06807v1.pdf
• A Dagger by Any Other Name: Scheduled Sampling: http://nlpers.blogspot.kr/2016/03/a-dagger-by-any-other-name-scheduled.html
• Theano 0.8 Released: http://deeplearning.net/software/theano/index.html

 

Interesting NIPS 2015 Papers

 

• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Network
• Learning visual biases from human imagination
• Tensorizing Neural Networks
• Active Learning from Weak and Strong Labelers
• Bidirectional Recurrent Neural Networks as Generative Models
• Unsupervised Learning by Program Synthesis
• Deep Visual Analogy-Making
• Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks
• Teaching Machines to Read and Comprehend
• Principal Differences Analysis: Interpretable Characterization of Differences between Distributions
• End-to-end Learning of LDA by Mirror-Descent Back Propagation over a Deep Architecture
• Spherical Random Features for Polynomial Kernels
• VISALOGY: Answering Visual Analogy Questions
• Generative Image Modeling Using Spatial LSTMs
• Learning with a Wasserstein Loss
• Natural Neural Networks
• Combinatorial Bandits Revisited
• Mind the Gap: A Generative Approach to Interpretable Feature Selection and Extraction
• Deep Convolutional Inverse Graphics Network
• Grammar as a Foreign Language
• Semi-supervised Sequence Learning

 

2016/03/21 ML Reddit

 

• XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks: http://arxiv.org/abs//1603.05279
• Neural Variational Inference for Text Processing: http://gitxiv.com/posts/oRw692PEooNcwh9Qh/neural-variational-inference-for-text-processing
• Theano Tutorial: http://www.marekrei.com/blog/theano-tutorial/
• Face2Face: Real-time Face Capture and Reenactment of RGB Videos (CVPR 2016 Oral): https://www.youtube.com/watch?v=ohmajJTcpNk
• South Korea Trumpets $860M AI Fund after AlphaGo ‘Shock’: http://www.nature.com/news/south-korea-trumpets-860-million-ai-fund-after-alphago-shock-1.19595?WT.mc_id=FBK_NatureNews
• Open Datasets: http://www.datasets.co/
• Deep Spreadsheets with ExcelNet: http://www.deepexcel.net/
• D-Q Learning Flappy Bird: https://github.com/yenchenlin1994/DeepLearningFlappyBird
• AIX Project from MS, Using Minecraft to Build More Intelligent Technology: https://blogs.microsoft.com/next/2016/03/13/project-aix-using-minecraft-build-intelligent-technology/
• Neural Networks Demystified: http://lumiverse.io/series/neural-networks-demystified
• Google Blog Post on What They Learned in Seoul with AlphaGo: https://googleblog.blogspot.kr/2016/03/what-we-learned-in-seoul-with-alphago.html
• Detecting Heart Arrhythmias Using Machine Learning and Apple Watch Data: http://insighthealthdata.com/blog/HealthyBeats/
• Topological Visualisation of a Convolutional Neural Network: http://terencebroad.com/convnetvis/vis.html
• Identity Mapping in Deep Residual Networks: http://arxiv.org/abs/1603.05027
• AlphaGo and the Future of Computer Games: https://www.youtube.com/watch?v=UMm0XaCFTJQ
• The Next Step after Andrew Ng’s Course: https://www.reddit.com/r/MachineLearning/comments/4anq6h/age_old_question_the_next_step_after_andrew_ngs/
• Exploratory Gradient Boosting for Reinforcement Learning in Complex Domains: http://arxiv.org/abs/1603.04119
• The BlackBox Challenge – Win the Game with Unknown Rules: http://blackboxchallenge.com/
• Do You Think TensorFlow Will Eventually Replace Theano and Torch: https://www.reddit.com/r/MachineLearning/comments/4amr7p/askreddit_do_you_think_tensorflow_will_eventually/
• Whiskey Embeddings: http://wrec.herokuapp.com/methodology
• Diagnosing Heart Diseases with Deep Neural Networks: http://irakorshunova.github.io/2016/03/15/heart.html
• Why Enrollment is Surging in Machine learning Classes: https://blogs.nvidia.com/blog/2016/02/24/enrollment-in-machine-learning/
• GNU Launches NN Framework, Gneural Network: https://www.gnu.org/software/gneuralnetwork/
• Installing TensorFlow on Raspberry Pi 3: https://github.com/samjabrahams/tensorflow-on-raspberry-pi
• Advice on Deep Learning with Time Series: https://www.reddit.com/r/MachineLearning/comments/4ad4zl/advice_on_deep_learning_with_time_series/
• Yann LeCun’s Statement on General AI: https://www.facebook.com/yann.lecun/posts/10153426023477143