Hi are there any tips or procedures in order to get a neural network which generalizes over whole data and difference between training loss error and test error does not increase dramatically over time? what can we do at all except just training and watching if training loss error and test error diverge or not?
I'm training a neural network and the training loss decreases, but the validation loss doesn't, or it decreases much less than what I would expect, based on references or experiments with very similar architectures and data. How can I fix this?    As for question        to which this question is inspired, the question is intentionally left general so that other questions about how to reduce the generalization error of a neural network down to a level which has been proved to be attainable, can be closed as duplicates of this one.  See also dedicated thread on Meta:
From  (emphasis mine):     Neutron degeneracy is a stellar application of the Pauli Exclusion Principle, as is electron degeneracy. No two neutrons can occupy identical states, even under the pressure of a collapsing star of several solar masses. For stellar masses less than about 1.44 solar masses (the Chandrasekhar limit), the energy from the gravitational collapse is not sufficient to produce the neutrons of a neutron star, so the collapse is halted by electron degeneracy to form white dwarfs. Above 1.44 solar masses, enough energy is available from the gravitational collapse to force the combination of electrons and protons to form neutrons. As the star contracts further, all the lowest neutron energy levels are filled and the neutrons are forced into higher and higher energy levels, filling the lowest unoccupied energy levels. This creates an effective pressure which prevents further gravitational collapse, forming a neutron star. However, for masses greater than 2 to 3 solar masses, even neutron degeneracy can't prevent further collapse and it continues toward the black hole state.   How then, can they collapse, without violating the Pauli Exclusion Principle? At a certain point does it no longer apply? I have a simple shutdown script which i want to run as root  shutdown -h +30; echo "succesfull";   I have followed these answer, to make my script root.  first I run this command  sudo chown root.root $HOME/test/test.sh sudo chmod 4755 $HOME/test/test.sh   and then made changes in sudoers  sudo visudo   added this command after this line %sudo   ALL=(ALL:ALL) ALL  eka ALL=(ALL) NOPASSWD: $HOME/test/test.sh   But when i executed my script its showing this error  shutdown: Need to be root succesfull Finding the missing digits of $23!$ Changing the color of the path in Terminal.app I would like the CasebashMac:bfgenv chris$ part of the following line to appear in a different color in my terminal.  CasebashMac:bfgenv chris$ python natbib and hyperref create by default two links to the bibentry in the reference section|chapter of the document:   \begin{filecontents}{\jobname.bib} @book{author08, title = {{A Title}}, publisher = {Alpha}, year = {2008}, author = {Author, A}, address = {London} } @book{buthor90, title = {{B Title}}, publisher = {Bravo}, year = {1990}, editor = {Buthor, B}, address = {New York} } \end{filecontents}  \documentclass{article}  \usepackage{natbib} \usepackage{hyperref} \hypersetup{colorlinks,citecolor=red}  \begin{document}  \noindent citet: \citet{author08}, \citet[see][p. 20]{author08} \\ citep: \citep{author08}, \citep[see][p. 20]{author08}  \bibliographystyle{plainnat} \bibliography{\jobname}  \end{document}     In order to avoid two links to the bibliography (one for the [author] and one for the year [year], respectively), I took  to an older question and added it to my preamble.  \usepackage{etoolbox} \makeatletter  \pretocmd{\NAT@citex}{%   \let\NAT@hyper@\NAT@hyper@citex   \def\NAT@postnote{#2}%   \setcounter{NAT@total@cites}{0}%   \setcounter{NAT@count@cites}{0}%   \forcsvlist{\stepcounter{NAT@total@cites}\@gobble}{#3}}{}{} \newcounter{NAT@total@cites} \newcounter{NAT@count@cites} \def\NAT@postnote{}  % include postnote and \citet closing bracket in hyperlink \def\NAT@hyper@citex#1{%   \stepcounter{NAT@count@cites}%   \hyper@natlinkstart{\@citeb\@extra@b@citeb}#1%   \ifnumequal{\value{NAT@count@cites}}{\value{NAT@total@cites}}     {\ifNAT@swa\else\if*\NAT@postnote*\else%      \NAT@cmt\NAT@postnote\global\def\NAT@postnote{}\fi\fi}{}%   \ifNAT@swa\else\if\relax\NAT@date\relax   \else\NAT@@close\global\let\NAT@nm\@empty\fi\fi% avoid compact citations   \hyper@natlinkend} \renewcommand\hyper@natlinkbreak[2]{#1}  % avoid extraneous postnotes, closing brackets \patchcmd{\NAT@citex}   {\ifNAT@swa\else\if*#2*\else\NAT@cmt#2\fi    \if\relax\NAT@date\relax\else\NAT@@close\fi\fi}{}{}{} \patchcmd{\NAT@citex}   {\if\relax\NAT@date\relax\NAT@def@citea\else\NAT@def@citea@close\fi}   {\if\relax\NAT@date\relax\NAT@def@citea\else\NAT@def@citea@space\fi}{}{}  \makeatother     Which gets me almost where I want to be, but leaves me with two issues I would like to be solved:   while \citet includes pre- and postnotes in the link, \citep doesn't. How can \citep be changed to include postnotes? is there a way to color the brackets and commas that are typeset in black in the unmodified first example also in black in the modified second example without removing them from the link? Sometimes we read books rather quickly and don't give them much (or any) thought, so the action 'reading' does not necessarily imply that we have given enough thoughts to any book we read.   Is there a word that describes reading a book with great care; usually but necessarily slowly over a long period of time. I had an article, but I lost it.  It showed and described a couple of C/C++ tricks that people should be careful. One of them interested me but now that I am trying to replicate it I'm not being able to put it to compile.  The concept was that it is possible to change by accident the value of a const in C/C++  It was something like this:  const int a = 3;          // I promise I won't change a const int *ptr_to_a = &amp;a; // I still promise I won't change a int *ptr; ptr = ptr_to_a;  (*ptr) = 5;               // I'm a liar; a is now 5   I wanted to show this to a friend but now I'm missing a step.  Does anyone know what's missing for it to start compiling and working?  ATM I'm getting invalid conversion from 'const int*' to 'int*' but when I read the article I tried and it worked great. No option to remove Bluetooth device in iOS Settings app? I would like to remove my Raspberry Pi from my iPhone 8 (running iOS 11.2.1) as a connected bluetooth device.  Normally, I would go into my Settings -> Bluetooth and select the Info button (a small blue circled "i") to show the "Disconnect" and "Forget Device" dialogs:    Unfortunately, iOS does not give me this option for my device. The bluetooth device list does not contain an "i" for the item, and there is seemingly no other way to disconnect.    How do I unpair this device if there is no button to trigger to the unpair prompt?  Due to work restrictions I cannot completely reset the device. I'm searching for a template which makes a document look like it's written with a real typewriter. Ideally, this means it's not only in mono-spaced font, but the hyphenation is adjusted accordingly. Also, some randomness would be nice (e.g. some characters more bold than others), so that it looks more natural. Why pendulum does not follow SHM for larger angular displacement? Considering an ideal case(neglecting drag of air, damping etc.), a pendulum follows SHM if the angular displacement is small (upto 10 degrees). But, for large angular displacement(more than 10 degree), it does not follow SHM. Why? What force cause the pendulum not to follow SHM? Why do prisms work (why is refraction frequency dependent)? Maximum area of isosceles triangle with perimeter 6 cm is that function must be constant under the following conditions I'm talking about complex function   $f$ is analytic function on a region $D$ that include the point $z=0$. for every $n\in N$ such $\frac{1}{n}$ is in $D$ , the function follows this condition $|f(\frac{1}{n})| \leq \dfrac{1}{2^n}$   is that function must be constant ? I have two raster images, Boolean classified (1 or 2).  They overlap in given areas.   I need a raster that is only the overlapping sections.  Using Arcinfo 10.  Answer can only use raster methods, no converting to polygons, points, etc... Add Fake Display when No Monitor is Plugged In I have an Ubuntu 14.04 server that has no external monitor connected.  I use NoMachine to remote control the machine.  When I do so, the Unity/Gnome interface doesn't see any monitors connected, so I can only use 800x600 when connecting with NoMachine.  If I plug in a monitor, I can set the resolution to whatever size the NoMachine window is on the remote computer.  Is there a way to create a "fake" monitor device on Ubuntu so I can set a desktop resolution in Unity/Gnome? A Google search spewed forth millions of hits on how to find tables without clustered indexed, the PK normally being the clustered index of a table. However, a table could easily have a natural key as a clustered index, and a non-clustered surrogate index, like an identity column.  How do I find all tables in a DB without a primary key defined? I have 245 tables in this DB: manual inspection is grossly inefficient. With the Taylor series representation of $\sin$ or $\cos$ as a starting point (and assuming no other knowledge about those functions), how can one:  a. prove they are periodic?  b. find the value of the period? How to split larger files into smaller parts? While using the Pixel Inspector, whenever I click "copy all values" it only copies values that you can see on the screen. Anyone know a solution? I need all the values to count the number of times 1, 2, and 0 appear on the graph. How to create old looking/ cracked glass I am looking for old looking cracked glass for a window in a shack scene. I have looked everywhere but can find a tutorial or material or model on this please can someone help me on this thanks