Why the prediction of neural network doesn't change? I've created two neural networks for a prediction purposes, the first is a network with one hidden layer and the second is two hidden layers, I use the cross validation techniques,  the training error for both networks is around 2E-4 but at the test step, for the two topologies, the prediction values do not change over the time, (just a small change in a fraction of 5).  I've tried different functions for the hidden layers (between tangh and sigmoid) and a sigmoid for the output layer.  So, where is the problem?  Thanks.
What should I do when my neural network doesn't learn? I'm training a neural network but the training loss doesn't decrease. How can I fix this?  I'm not asking about overfitting or regularization. I'm asking about how to solve the problem where my network's performance doesn't improve on the training set.    This question is intentionally general so that other questions about how to train a neural network can be closed as a duplicate of this one, with the attitude that "if you give a man a fish you feed him for a day, but if you teach a man to fish, you can feed him for the rest of his life." See this Meta thread for a discussion:   If your neural network does not generalize well, see:
Double booked - User bookmarking question recorded twice Probability of lim sup, lim inf for sequence of random variables. Maybe this is extremely simple, but i havent found a specific answer for this online.  For a sequence of independent continuous random variables $X_n$ ,$n=1,2,3,...$ , all with the same probability density function $f(x)&gt;0$ for all real $x$, and a specific real number $b$, what do the following events mean in simple terms and what is the probability of each?  a)$\lim_n\sup\{X_n \gt b\}$ b)$\lim_n\inf\{X_n \gt b\}$ c)$\lim_n\sup\{X_n \le b\}$ d)$\lim_n\inf\{X_n \le b\}$ How to fix "Package is in a very bad inconsistent state" error? I can't update my system because it freezes while installing a third-party update (zramswap-enabler)! Sometimes I get the following message in Update manager:  Could not initialize the package information An unresolvable problem occurred while initializing the package information. Please report this bug against the 'update-manager' package and include the following error message: E:The package zramswap-enabler needs to be reinstalled, but I can't find an archive for it.  I tried to remove the zramswap-enabler, but it's impossible because I get the following message: dpkg: error processing zramswap-enabler (--remove):  Package is in a very bad inconsistent state - you should  reinstall it before attempting a removal. Errors were encountered while processing:  zramswap-enabler E: Sub-process /usr/bin/dpkg returned an error code (1)  Actually I would really reinstall that package, but it is unable to do it! If I remove this third-party PPA then the system is warning me about a very very serious problem. So why can I not install/reinstall/remove/update this package and why freezes the updater if I try to update? I've bunch of folders in folder A. I want to move files from all those folders to A.  Or  I want to cut all files from child folders and paste them in parent folder.  How to do that? I need to build a list of files present in a directory but also pass in a file containing a list of directories to exclude.  I've seen the below suggestion but I've had no luck with it when it comes to the type flag:  find $dir_name $(printf "! -name %s " $(cat $exclude_file))   Is there a way I can do it or will I need to create the entire list and then work through it removing ones that partially match ones in the exclude directory. How do I get the UI thread's Dispatcher? How soon can I re-enter the USA having stayed for 90 days under the Visa Waiver Program? I am currently visiting the USA from the UK (I am a UK citizen) and am intending on staying here for the full 90 days under the Visa Waiver Program.     How long would I have to stay out of the US at the end of this period before returning again?    Would I have to return to the UK, or could I stay with friends in another country (such as Canada) for a while? Best practice for typesetting quantifiers? When I work with quantifiers I noted that are very close to the other symbols and the result does not look good, for example  $\exists a\in\mathbb{R}\exists b\in\mathbb{R}\forall c\in\mathbb{R}\forall d\in\mathbb{R}$   Which is the proper form to write quantifiers? Does slowing light violate relativity? When has Wonder Woman died? I know Wonder Woman has died in canon before, but in which issue did this happen? It maby be weird, I want to make header and footer for every page including the first page of each chapter, how can I do this? Is it worth it to upgrade a Toshiba Satellite C55-A5300 laptop given the latest productivity software requirements? I would like to upgrade a Toshiba Satellite C55-A5300 laptop so it can be as useful as it can be nowadays. I haven’t needed to use much software for a few years now, and I’m not able to gauge whether a maxed out upgrade of this laptop would be up to running the latest versions of MS Office and Acrobat smoothly. Maybe even run some Photoshop and Lightroom? I want to install the best CPU that will work optimally within the parameters of this laptop, including the laptop’s cooling capabilities. I ultimately want improved performance, but I want the performance to be as smooth as possible. From what I gather the Pentium 2030M is the best processor this motherboard will accept. Am I on the right track? I also plan to fully upgrade the memory and the hard disk speed with respective upgrades. What is the max memory per RAM slot (2 total)? What is the fastest speed of RAM I can use?  Copied from the Toshiba spec sheet:  Processor and Graphics Intel® Celeron® Processor 1037U o (2M Cache, 1.80GHz) Mobile Intel® NM70 Express Chipset Mobile Intel® HD graphics with shared graphics memory Memory Memory Configured with 4GB DDR3 1333MHz (max 16GB) 2 main memory slots. One slot is occupied Storage Drive 500GB (5400 RPM) Serial ATA hard disk drive Power 45W (19V 2.37A) 100-240V/50-60Hz AC Adapter Math mode macro in TeXstudio I want to set up a macro in TeXstudio for math mode which displays $*$ and places the cursor at position *. So far I have tried using $%|$ but upon triggering, this macro does not allow text insertion at the placeholder.  EDIT: The method above works fine if the macro shortcut is set to the default Shift+F1. However, changing the shortcut to another combination, as I would like to do, seems to be the cause of the problem. How do you challenge the closing of one of your questions? As a newcomer to StackOverflow, I recently asked my first . I wanted to start with a fairly safe general question, to get the feel for how the site worked. My question was intended to be programming-related, but my original wording was not clear enough, so another user decided to close it.  I've re-phrased my question, and had received one useful answer before the question was closed, but I'm not sure what the procedure is after your question is closed to allow people to post answers again...  I've checked the FAQ and About pages, searched the SO questions, but have had no luck. Could someone point me in the right direction as to how I get my question re-opened, or if it is possible to do at all? Series convergence or divergence how to test I have the following series defined.   $$\displaystyle\sum_{k=1}^{n} \cos \left( {\frac{\pi}{2}} k \right) \frac{k}{k+1000} \frac{1}{\sqrt{k}}$$ where $n = 1,2...$  How to test whether this series converges or diverges ? dev/sda1: clean, 552599/6111232 files, 7119295/24414464 blocks   After I turn on my laptop this message appears. The system never boots, the message just stays there. While my code is compiling, I usually like to go through some reviewing and especially the late answers.  What I do see a lot in answers to old questions is the self-defense mechanism     ""   As if there is something fundamentally wrong with answering old questions. This leads me to two questions/thoughts:   Should we edit phrases like that out of the answer? (Given it's a good/valid answer to begin with, without any of the likely "old answer" problems. I realize the example linked to has its flaws.) Should we perhaps explicitly encourage answering old unanswered questions somewhere in the FAQ? (I'm unaware of any such recommendation, but might have read over it. Let me know if I did) A message may be accompanied with a digital signature, a MAC or a message hash, as a proof of some kind.  Which assurances does each primitive provide to the recipient?  What kind of keys are needed? How to change SQL Server collation Why is this markdown for a link not showing properly? The Stack Exchange (Personal Productivity) markdown  is showing literally rather than as a named link. Don't know why.