What is the intuitive explanation of Attention Maps? I just came across this link.   But I did not understand what exactly are those and how is it useful.
What are attention mechanisms exactly? Attention mechanisms have been used in various Deep Learning papers in the last few years. Ilya Sutskever, head of research at Open AI, has enthusiastically praised them:    Eugenio Culurciello at Purdue University has claimed that RNNs and LSTMs should be abandoned in favor of purely attention-based neural networks:    This seems an exaggeration, but it's undeniable that purely attention-based models have done quite well in sequence modeling tasks: we all know about the aptly named paper from Google,   However, what exactly are attention-based models? I've yet to find a clear explanation of such models. Suppose I want to forecast the new values of a multivariate time series, given its historical values. It's quite clear how to do that with an RNN having LSTM cells. How would I do the same with an attention-based model?
I tried to update Grub so I run:  sudo update-grub  Generating grub configuration file ... Warning: Setting GRUB_TIMEOUT to a non-zero value when GRUB_HIDDEN_TIMEOUT is set is no longer supported.   What exactly this warning wants to be changed? (I upgraded from 12.04 to 14.04 before)  This is my /etc/default/grub file:  GRUB_DEFAULT="0" GRUB_HIDDEN_TIMEOUT="0" GRUB_HIDDEN_TIMEOUT_QUIET="true" GRUB_TIMEOUT="10" GRUB_DISTRIBUTOR="`lsb_release -i -s 2&gt; /dev/null || echo Debian`" GRUB_CMDLINE_LINUX_DEFAULT="quiet splash" GRUB_CMDLINE_LINUX="" My options to link large image into AI file My .psd file has a resolution of 6m x 3m @ 150 DPI. This makes it 35433px x 5906px in size. Photoshop CS6 saves the file as .tiff or .psb only. When I first import into Illustrator I get an error that the file is not readable but I have tried many options. Last one is not supported by AI.  So I'm puzzled... is there a way to link large images into Illustrator? Test for existence of nested JavaScript object key Can I take clear night sky photographs with my smartphone? is it possible to take clear night sky shots with stars/ planets visible from Redmi Note 4? what settings do I use? when I try to take it just comes black, unless on full moon day with HDR, though stars like Orion's belt won't get captured. Would using a telescope make celestial objects much clear to capture? Snapping in PyQGIS3.0 The following expression enables snapping for PyQGIS 2.0 :  QgsProject.instance().setSnapSettingsForLayer(layer.id(), True, 2, 1, 10, True)   What is the equivalent expression in PyQGIS 3.0? Reasons to use opamp How can I give other drives and partitions short, meaningful names in nautilus? In nautilus and Unity the external drive has a nice short descriptive name "mcat", but all partitions on the 4 internal drives are displayed as a size (834 GB filesystem) or a huge 32-character string form of a GUID:  I'm guessing the external drive is nice, short, sweet and readable because that drive may have no partitions (well, just one I guess) and that name may be the drive label, whereas partitions usually don't have names. That may explain my problem, but doesn't solve it.  Is there some way to give reasonable names to these partitions in nautilus and Unity? A closed ball in a metric space is a closed set Solve differential equation, $x'=x^2-2t^{-2}$ Solve differential equation:  $x'=x^2- \frac{2}{t^2}$  Maybe is it sth connected with homogeneous equation? I have no idea how to solve it. In my passport, my name is Firstname middlename1 middlename2 lastname, and in the ticket is LASTNAME/FIRSTNAME MR.  Will be a problem? I'll travel from Brazil to Bali, Indonesia and according to the agency I bought the ticket from, there's no problem and it's common.  The airline is Qatar Airlines and I have looked , which says that the passenger name can't be changed after the booking has finished.  But I don't know if it is a problem. How can a photon have no mass and still travel at the speed of light? Why do I get the same result with rand() every time I compile and run? If $A$ and $B$ are square matrices such that $AB = I$, where $I$ is the identity matrix, show that $BA = I$.    I do not understand anything more than the following.   Elementary row operations. Linear dependence. Row reduced forms and their relations with the original matrix.   If the entries of the matrix are not from a mathematical structure which supports commutativity, what can we say about this problem?  P.S.: Please avoid using the transpose and/or inverse of a matrix. I develop an application in which i constantly get samples of heart pulse.  I defined an interval of t seconds.  In each t seconds I have n samples.  In every interval, I want to calculate the tendency of those n samples. For example, lets say I have n = 5, and I have samples with values {70, 88, 95, 103, 115}. I want to recognize I have a growth in the heart pulse, and I want to have some measure for the rate of grows/decrease/almost no change.  I thought on two approaches for solving this problem.   I calculate the linear approximation for the n samples using linear regression by applying least squares implemented by the normal equations. (I treat each sample as two coordinates vector with x coordinate as time and y coordinate as heart pulse). I get from the normal equations a linear function of the form y = mx+b and my measure for the tendency is the slope, i.e. the m value. The second approach is to calculate the correlation (pearson's correlation) between vector x and vector y when x is the time and y is the heart pulse.   I'm asking which approach do you think is better for my problem (determining the tendency of heart pulses). Or, do you have a better algorithm for solving this problem? Suppose $n$ is an even positive integer and $H$ is a subgroup of $\mathbb Z/n \mathbb Z$. Prove that either every element of $H$ is... MongoDB could not connect local server How to make a cross-module variable? We have to shift our web-site to a new domain due to some unavoidable circumstances. The portal has been up and running there since 2009.  It has good index in various search engines and we are getting a good number of page hits on daily basis.  Losing the search hits and index are our big concern. We are not sure how best we can handle this.  What all can be done to preserve as much as possible while shifting to new domain name. Is it possible to adjust desktop monitor brightness like on laptops? Yes all desktop monitors have separate menu for it. But is it possible to change this to something like Winkey+(F1..F12)?    Monitor is connected via VGA or DVI cable.   OS: Ubuntu 14.04 Desktop monitors Conky Widgets are Opening in their Own Windows I just upgraded to 16.04 and I'm getting all my customization set up again, but it seems that most Conky widgets are opening in their own window, instead of just appearing on the Desktop; although some are working correctly.  For example:  LSD (working properly):    Seamod (not working, opening in own window):    Since it's not affecting every single widget, I assume it could be an issue with the conkyrc with the widgets that aren't working, but this also never happened in 14.04 so I wasn't sure if maybe there was some compatibility issue in 16.04. My Google-fu has failed me in finding a solution.  If anyone can point me in the right direction, it would be much appreciated! :)