Karthik Yearning Deep Learning

Summary - SGDR

SGDR: STOCHASTIC GRADIENT DESCENT WITH WARM RESTARTS Restart techniques are common in gradient-free optimization to deal with multimodal functions. Partial warm restarts are also gaining popularity in gradientbased optimization to improve the rate of convergence in accelerated gradient schemes to deal with ill-conditioned functions. In ... Read more

AI @ Cornell

Research Group Machine Learning Robotics Vision Projects Vision Recognition, Image Matching and Image Databases Object Recognition using the Hausdorff Distance Spatially Coherent Matching and Bayesian Recognition Flexible Object Recognition Motion, Stereo and Segmentation Image Segmentation using Local Variation Ma... Read more

List of AI Research Projects at Stanford.MIT.CMU

Stanford Intelligent wearable Robotics Safe feedback interactions in human autonomous vehicle systems Detailed understanding of human actions and behavior for smart vehicles Human centric autonomous and assistive driving Understanding driver state in laboratory and naturalistic environments ... Read more

Summary - Gradient Descent Finds Global Minimum

Gradient Descent Finds Global Minima of Deep Neural Networks Simon S. Du Jason D. Lee Haochuan Li Liwei Wang Xiyu Zhai Abstract Gradient descent finds a global minimum in training deep neural networks despite the objective function being non-convex. The current paper proves gradient descent achieves zero training loss in polyn... Read more

Summary - Mask RCNN

MASK R-CNN Facebook AI Research (FAIR) Kaiming He Georgia Gkioxari Piotr Dollar Ross Girshick What does Mask R-CNN do We present a conceptually simple, flexible, and general framework for object instance segmentation. Our approach efficiently detects objects in an image while simultaneously generating a high-quality segmentation... Read more

Interesting projects at Microsoft Research AI

Project Frigatebird. Link Github Code Taking instantaneous decisions during an uncertain situation is near impossible for machines even when considering multi-level observations and their striving ability to learn complex policies. This progress is facilitated by the availability of abundant data, simulators such as games. These projects ... Read more

Summary - Google BERT

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova Abstract What’s BERT BERT stands for Bidirectional Encoder Representations from Transformers. How BERT is unique BERT is designed to pre-train deep bidirectional representations by jointl... Read more

Deep Learning interview questions.

Difference between Deep Networks vs Shallow Networks ? Deep Networks - The number of hidden layers are more in deep networks with large number of parameters. Since there are higher number of parameters, higher the degree of non-linearity in the network. Hence this increases the capability to extract high level features. Shallow Networks - The ... Read more

Summary - Super Resolution

Fast and Accurate Image Super Resolution by Deep CNN with Skip Connection and Network in Network Current trend We propose a highly efficient and faster Single Image Super-Resolution (SISR) model with Deep Convolutional neural networks (Deep CNN). Deep CNN have recently shown that they have a significant reconstruction performance on single-... Read more