Method to determine outliers with a skewed dataset
Outlier Detection on skewed Distributions
Does there exist a magical shell piping which would allow easily to grep through bunch of .gz log files without needing to extract them somewhere?  .gz files are Apache logs, result of log rotation. I'd like to quickly check how often certain URIs are accessed in the past. A problem of Schwarz-Pick theorem in complex analysis Set $f \in H(B(0,1)),f(B(0,1)) \subset B(0,1)$，prove that $$|f(z)-\frac{f(0)(1-|z|^2)}{1-|f(0)|^2||z|^2}| \le \frac{|z|(1-|f(0)|^2)}{1-|z|^2|f(0)|^2}$$  I think this problem is supposed to be proved by Schwarz-Pick theorem, I tried hard but failed to build a function to prove it. I even doubted that this problem is wrong, so I want to whether this problem can be proved or be falsified, and how.  Any help would be appreciated. Massive 404 attack with non existent URLs. How to prevent this? The problem is a whole load of 404 errors, as reported by Google Webmaster Tools, with pages and queries that have never been there. One of them is viewtopic.php, and I've also noticed a scary number of attempts to check if the site is a WordPress site (wp_admin) and for the cPanel login. I block TRACE already, and the server is equipped with some defense against scanning/hacking. However, this doesn't seem to stop. The referrer is, according to Google Webmaster, totally.me.  I have looked for a solution to stop this, because it isn't certainly good for the poor real actual users, let alone the SEO concerns.  I am using the Perishable Press mini black list (), a standard referrer blocker (for porn, herbal, casino sites), and even some software to protect the site (XSS blocking, SQL injection, etc). The server is using other measures as well, so one would assume that the site is safe (hopefully), but it isn't ending.  Does anybody else have the same problem, or am I the only one seeing this? Is it what I think, i.e., some sort of attack? Is there a way to fix it, or better, prevent this useless resource waste?  EDIT I've never used the question to thank for the answers, and hope this can be done. Thank you all for your insightful replies, which helped me to find my way out of this. I have followed everyone's suggestions and implemented the following:   a honeypot a script that listens to suspect urls in the 404 page and sends me an email with user agent/ip, while returning a standard 404 header a script that rewards legitimate users, in the same 404 custom page,  in case they end up clicking on one of those urls. In less than 24 hours I have been able to isolate some suspect IPs, all listed in Spamhaus. All the IPs logged so far belong to spam VPS hosting companies.   Thank you all again, I would have accepted all answers if I could. If you copy the contents of   httpd.conf   and then paste it into a cat command.. such as this one..  #!/bin/bash cat &gt; /test &lt;&lt; EOF pasted here.. EOF   you run into this error:  -bash: command substitution: line 1: unexpected EOF while looking for matching `'' -bash: command substitution: line 4: syntax error: unexpected end of file   perhaps the solution is to escape the dollar signs and maybe even quotes and so on..  but given that this is such a large file.. can dollar signs be automatically be escaped ?  is my only option to escape them via another program and then give it to the cat command ? Why is it disadvantageous in graduate admissions to have a higher degree? indicates that holders of a master’s degree are held to higher standards when it comes to graduate admissions. The stated requirements for some graduate programs () also outright exclude applicants with doctoral degrees. These seem to be saying that holding a higher degree prior to application is a disadvantage (a fatal one in the case of a PhD). This also applies to private universities: Stanford  (at least in computer science); .  I don't understand why:   If there are two applicants, Alice and Bob, who have achieved largely similar things, it seems logical that both should have a roughly equal chance of being admitted. However, based on JeffE's answer, if Alice has a Masters degree while Bob does not, it's Bob that gets admitted instead of Alice. JeffE's answer even indicates that if Alice has achieved slightly more than Bob, it's still Bob that gets admitted.  If graduate admissions is looking for students that are capable of succeeding in its program, then Alice should be more likely to succeed than Bob since she's already had some experience of graduate study. This should be even more the case if Alice already has a PhD – if she can do it once, she should be able to do it again.    JeffE's answer indicates that since Alice has had more opportunities than Bob, she should also be held to higher standard. However it should also be true that Alice has already achieved what Bob has yet to and in fact might not be able to achieve. Further, JeffE's answer seems to be saying that Alice should do the academic equivalent of financial engineering and pass her graduate-level courses &amp; thesis without getting a master’s degree even if she qualifies for it, which sounds silly.  As for applicants with PhD degrees, my first guess would be that this is because , and the university is acting in the applicant's best interests. However if this is the case, then this is effectively telling the applicant "I know what you want better than you do", which also sounds silly. UC Berkeley's requirements also seem to be saying that if someone with a CV worthy of a tenured position were to apply for a PhD student position, the university will say "no" even though it's clearly better in their best interests (in terms of research output) to say "yes".   Presumably I'm misunderstanding something because if this behavior were irrational, it would already have been changed. What am I missing?  EDIT: I wonder if things are different in programs where the student is involved in research directly without spending time on coursework? How do I calculate standard errors for sums of OLS coefficients? As a bulk sender, is there a way to make Gmail show my avatar?    I would like to obtain this without creating a Google Account.  Maybe embedding my vCard? Or maybe ? Which one is correct: '3 hour journey' or a '3-hour journey'? Which one of the following is correct (bold part)?      It took us quite a long time to get here. It was 3 hour journey.   or     It took us quite a long time to get here. It was a 3-hour journey. For some reason my Steam just broke today after working perfectly since I installed it a few days ago.  It was originally installed via the deb from the Steam site. So I uninstalled that using the Ubuntu Software Center. Then I installed steam-launcher. When I run it from the menu it does nothing at all. When I go through terminal it gives this message, no error:  $ steam/usr/bin/steam:  line 196: /home/andrew/.local/share/Steam/steam.sh: Success   So I purge-removed it and removed the .steams directory from my home directory but on re-installation its the same story.  I am using Xubuntu 12.10 64bit.  It appears that steam .local/share/Steam/steam.sh is blank. What is it meant to have in it? I am so confused with how reinstalling it doesn't fix it. Finding languages such that $L_{1} \subseteq L_{2} \subseteq L_{3}$ where $L_{1}, L_{3} \notin \mathbb{R}$, $L_{2} \in \mathbb{R}$ I am struggling to find such languages $L_{1}$, $L_{2}$, and $L_{3}$ such that  $$ L_{1} \subseteq L_{2} \subseteq L_{3} $$ where $L_{1}, L_{3} \notin  \mathbb{R}$ and $L_{2} \in  \mathbb{R}$.  I know they exist, I need help finding them. Mammals, reptiles, arachnids, insects, etc are all as far as I am aware symmetrical in appearance.  Take a human for instance, make a line from the top of our head right down the middle. However, internally it is not the same. Our organs excluding the kidneys, lungs, reproductive organs, etc are not symmetrically placed in our body.   Why do we not have an even number of each organ so it can be placed symmetrically? If we have a single organ why is it not placed in the middle like the brain or bladder is for instance? Is there some evolutionary advantage that led to this setup? Why are SMD LEDs shipped in a sealed bag containing desiccant? I had a selection of 0805 LEDs in my last Mouser order and was a bit surprised to discover they arrived in heat-sealed (rather than folded and taped with sticker) bags containing a desiccant bag and some sort of litmus-esque paper indicator saying something about baking them if the dots on it went pink (instead of blue).    A quantity of through-hole LEDs I had in the same order just came in the regular ESD-protective bag, folded over with a sticker.  What's up with SMD LEDs that they work so hard to keep them dry? Surely their dryness can't be assured once they're installed. Does it have to do with their solderability or something? Why would that be different than other SMD parts? I was just reading Harry Potter and the Deathly Hallows, and I was wondering, when Hermione Granger changed into Bellatrix Lestrange, she should've obtained the Dark Mark, temporarily.  Now, my question is: would the Dark Mark work if pressed? Tools to get a pictorial function call graph of code I have a large work space which has many source files of C code. Although I can see the functions called from a function in MS VS2005 using the Object browser, and in MSVC 6.0 also, this only shows functions called from a particular function in a non-graphical kind of display. Additionally, it does not show the function called starting from say main(), and then the functions called from it, and so on, deeper inside to the leaf level function.  I need a tool which will give me a function call graph pictorially with functions callee and caller connected by arrows or something like that, starting from main() to the last level of function, or at least showing a call graph of all functions in one C source file pictorially. It would be great if I could print this graph.  Any good tools to do that (need not be free tools)? Let $a$ and $b$ be positive reals. Show that $$\lim\limits_{n\to\infty} \left(\frac{a^{\frac{1}{n}}+b^{\frac{1}{n}}}{2}\right)^n =\sqrt{ab}$$ What are some good tutorials on writing custom styles (classes) that clearly explain commands used and some of the features that TeX has to offer in the way of styles? Why would Antimatter behave differently via Gravity? LaTeX template for resume/curriculum vitae If you have a TeX'ed resume, did you use a template or make your own? Are there any useful packages? What looks the most professional? How about special considerations for different areas of work (e.g. in academia)? I just had a case of a user who re-posted his question because his first question was closed as a duplicate. And, logically, I closed his re-post as a duplicate of his original, asking him to edit his original and explain why it's not a duplicate, so we can reopen it.  This process has worked like that for years now, but suddenly I realized that with the new message, question repetition is even encouraged:     This question has been asked before and already has an answer. If those answers do not fully address your question, please ask a new question.   Clearly, a new user who finds their questions closed will now be happy to just post their question again and again, until it's not a duplicate anymore, instead of just fixing their original post.  We need to be more explicit about this, and show this message to the OP of the question:     If those answers do not fully address your question, please edit your question and explain why it is not a duplicate.   The original message should still be visible to other users and visitors, as they can't fix that question, of course. How to plot and solve the numerical solution of a integro-differential equation