Why training deep learning models is more likely to suffer from plateaus than local minima?   Could anyone illustrate it.
I heard Andrew Ng (in a video I unfortunately can't find anymore) talk about how the understanding of local minima in deep learning problems has changed in the sense that they are now regarded as less problematic because in high-dimensional spaces (encountered in deep learning) critical points are more likely to be saddle points or plateaus rather than local minima.   I've seen papers (e.g. ) that discuss assumptions under which "every local minimum is a global minimum". These assumptions are all rather technical, but from what I understand they tend to impose a structure on the neural network that make it somewhat linear.  Is it a valid claim that, in deep learning (incl. nonlinear architectures), plateaus are more likely than local minima? And if so, is there a (possibly mathematical) intuition behind it?   Is there anything particular about deep learning and saddle points?
How do I audit my reputation? If I am concerned that my reputation score is incorrect, how can I audit it, or get a report of a detailed breakdown of my reputation? Stargate - Destiny's Gate Address from Icarus base Simple question - What is the address they dial to connect with the Ancient ship Destiny in Stargate Universe from Icarus base.  I have found the address on  - however they have an unconfirmed order, and not sure of the validity of this.  Any help deciphering the above would be great! general solution sum of two uniform random variables aY+bX=Z? is there a general solution to that? I have seen simple examples for Y+X=Z but I was wondering how this would be with rescaling? JavaScript: client-side vs. server-side validation Which is better to do client side or server side validation?  In our situation we are using    jQuery and MVC.   JSON data to pass between our View and Controller.     A lot of the validation I do is validating data as users enter it. For example I use the the keypress event to prevent letters in a text box, set a max number of characters and that a number is with in a range.   I guess the better question would be, Are there any benefits to doing server side validation over client side?    Awesome answers everyone. The website that we have is password protected and for a small user base(&lt;50). If they are not running JavaScript we will send ninjas. But if we were designing a site for everyone one I'd agree to do validation on both sides. Considering the following formulae:  (i) $1+2+3+..+n = n(n+1)/2$  (ii) $1\cdot2+2\cdot3+3\cdot4+...+n(n+1) = n(n+1)(n+2)/3$  (iii) $1\cdot2\cdot3+2\cdot3\cdot4+...+n(n+1)(n+2) = n(n+1)(n+2)(n+3)/4$  Find and prove a 'closed formula' for the sum  $1\cdot2\cdot3\cdot...\cdot k + 2\cdot3\cdot4\cdot...\cdot(k+1) + ... + n(n+1)(n+2)\cdot...\cdot (k+n-1)$  generalizing the formulae above.  I have attempted to 'put' the first 3 formulae together but I am getting nowhere and wondered where to even start to finding a closed formula. Syntax error on print with Python 3 Measures of residuals heteroscedasticity This wikipedia  lists a number of techniques to detect OLS residuals heteroscedasticity. I would like to learn which hands-on technique is more efficient in detecting regions affected by heteroscedasticity.  For example, here the central region in the OLS 'Residuals vs Fitted' plot seen to have higher variance than the sides of the plot (I am not entirely sure in facts, but let's assume it's the case for the sake of the question). To confirm, looking at the error labels in the QQ plot we can see that they match the error labels in the center of the Residuals plot.  But how can we quantify the residuals region that has significantly higher variance? If $a^2$ divides $b^2$, then $a$ divides $b$ How to use unnumbered chapters with KOMA-script? I am having some issues with the hyperref package. I would like to create a Introduction chapter without a number so I use \chapter*{Introduction} and \addcontentsline{toc}{chapter}{Introduction} because I want it in the table of contents (see example).  But then the link in my PDF viewer gets it wrong and also the automatically created header is no longer correct (see picture). The table of contents shows the right page number (p.1) but the link is also wrong.   What is my mistake here?  \documentclass{scrbook}  \usepackage{hyperref} \usepackage{blindtext} \usepackage{glossaries}   \makeglossaries  \newacronym{eg}{e.g.}{% for example }   \begin{document}   \frontmatter  % abstract before the table of contents \chapter*{Abstract} \addcontentsline{toc}{chapter}{Abstract} \blindtext  \tableofcontents  % chapter with acronyms \cleardoublepage \phantomsection  \printglossary[type=\acronymtype] \addcontentsline{toc}{chapter}{Glossary}  \cleardoublepage \mainmatter   \phantomsection % \chapter{Introduction} % with this everything is correct but I don't want the number \chapter*{Introduction} \addcontentsline{toc}{chapter}{Introduction}  \blindtext  \pagebreak  \blindtext  % first chapter \chapter{Chapter1}  \gls{eg} \blindtext  \pagebreak  \blindtext   \end{document} Let $a&gt;0$, show that for $x&gt;0$, $1&lt;f(x)&lt;2$, where $$f(x)=\frac{1}{\sqrt{1+x}}+\frac{1}{\sqrt{1+a}}+\sqrt{\frac{ax}{ax+8}}$$  I could take the derivative, find the maximum of the function and conclude. But that involves heady algebra and you have to solve a high degree polynomial. Is there an easier way simply using inequalities? Thanks, much appreciated I would like to know how potential difference is created between two points?Is potential difference created by adding more electrons at one side?If that's the case how to add more electrons at one side?  I'm really looking to know what really constitutes potential difference? Error - SqlDateTime overflow. Must be between 1/1/1753 12:00:00 AM and 12/31/9999 11:59:59 PM has the following ability:     Whenever a creature you control with a +1/+1 counter on it dies, return that card to the battlefield under your control at the beginning of the next end step.   I had a number of creatures on the battlefield, including Marchesa herself, with one or more +1/+1 counters on them when  was played, destroying each creature on the board.  When Marchesa and several other creatures would be killed simultaneously,   Does Marchesa's ability trigger for herself? Does Marchesa's ability trigger for the other creatures under my control with +1/+1 counters?   In attempting to resolve the issue, we tried to look things up, leading to , which cites Rule 603.6d as proving that Marchesa's ability should trigger both for herself and for each other creature with +1/+1 counters.  Unfortunately, none of us could actually understand Rule 603.6d, aside from this example:     Two creatures are on the battlefield along with an artifact that has the ability Whenever a creature dies, you gain 1 life. Someone plays a spell that destroys all artifacts, creatures, and enchantments. The artifacts ability triggers twice, even though the artifact goes to its owners graveyard at the same time as the creatures.   The example certainly seems analogous to me, but without understanding the actual rule, rather than just the example, we weren't too sure.  A complete answer has to not only answer the question, but back up that answer with citation and explanation of the official rules on the matter. Execute sudo without Password? Inspired by this ....  I am the sole person using my system with 12.04. Every time I issue a sudo command; the system asks for the user password (which is good in its own way).  However I was thinking; without activating the root account; how can I execute the sudo commands which will not ask for user password to authenticate.  NOTE: I want to execute sudo command without authenticating via password; only when they are executed via terminal. I don't want to remove this extra layer of security from other functions such a while using 'Ubuntu software center' or executing a bash script by drag-drop something.sh file to the terminal. Why does Li+ ion move to cathode in Li-ion battery? Windows says RAM ran out while there is still 4 GB of physical memory available Most OO languages prefix their interface names with a capital I, why does Java not do this?  What was the rationale for not following this convention?  To demonstrate what I mean, if I wanted to have a User interface and a User implementation I'd have two choices in Java:        Class = User, Interface = UserInterface   Class = UserImpl, Interface = User      Where in most languages:     Class = User, Interface = IUser   Now, you might argue that you could always pick a most descriptive name for the user implementation and the problem goes away, but Java's pushing a POJO approach to things and   most IOC containers use DynamicProxies extensively.  These two things together mean that you'll have lots of interfaces with a single POJO implementation.  So, I guess my question boils down to: "Is it worth following the broader Interface naming convention especially in light of where Java Frameworks seem to be heading?" How to use grep on column? I want to apply grep on particular column in column command.  myfile.txt  3,ST,ST01,3,3,856 3,ST,ST02,4,9,0234 6,N1,N101,2,3,ST 6,N1,N102,1,60,Comcast 6,N1,N103,1,2,92   My Command:  column -s, -t &lt; myfile.txt | grep -w "ST"   Here I want to only grep the pattern ST in 2nd column. How to do this ?  Expected Result:  3       ST            ST01              3            3            856 3       ST            ST02              4            9            0234 Access 2007 Work in a separate file using ACCDE Have been working in an Access 2007 application for over 3 weeks and it should be ready now. Anyway, I know (and tried) that "Make ACCDE" can actually split the raw data from the application itself so you can run it using the Access RunTime.  The question is... can I deploy my app for general use and modify a separate copy of the forms/views inside the application to deploy it when it´s ready without touching the data? How to find the list of all available packages along with the lastest version number available in the repositories? I want to list all the packages(installed or not installed) along with the latest version number available in the repositories.  For example:  The output of apt-cache policy chromium-browser shows like below  $ apt-cache policy chromium-browser chromium-browser:   Installed: (none)   Candidate: 34.0.1847.116-0ubuntu2   Version table:      34.0.1847.116-0ubuntu2 0         500 http://ftp.cuhk.edu.hk/pub/Linux/ubuntu/ trusty/universe amd64 Packages   So the latest version of chromium-browser package available in the repository is 34.0.1847.116-0ubuntu2. Like that, i want to list the version number along with the package names that are available in repositories. And all i want to do this through command-line.  I want the output to be like this,  chromium-browser 34.0.1847.116-0ubuntu2 xxxxxxxxxxxxxx   yyyyyyyyyyy ............     ............