I didn't see this question already asked but I also don't know if this may be called something in particular so my apologies.  While learning SQL and PHP I was curious to know how do bots search a website if there is no physical .html files being populated onto the server?  How do bots index the site?
102
I have a very stupid question. I developed a website that has only one page at the public html directory(index.php).  all content are dynamically loaded as different pages.   How can i SEO my pages for google?  i mean like the what we type in this site are .............i believe stored in database and search engine find these pages like any static pages...  Just a little tip would be appreciable.......!
100333
How, within any one of the Stack Exchange sites, or from the Stack Exchange site itself, do I search and find the link to a Stack Exchange site by title, versus by content of the questions inside those sites? Specifically, the end result of the search should not return links to particular questions in that site, but only to the links to the "top" of the site such as .  This is not the same as . That is a different (albeit quite useful) use case from this one.
32813
How do I best approach common SEO techniques for a website with images as the main content?  The problem here is the content is all image based, so other than Friendly URLS, H1/H2 tags, Sitemap, RSS Feed, Alt Img, what else can be done to gain search rankings?  I realise most search engines (if not all) are text based and text is how they better understand the business and "usefulness" of a site and therefore compare it with other sites, but other than social media and driving constant traffic what is the best thing to do or focus on?
108707
You can search for anything on Google, right? At least, so I thought. I was trying to see how the special characters get encoded in the url, like how &amp; gets converted to %26. I started searching for *. It did not get encoded, but weirdly google didn't tell me that it was an asterisk symbol. All other search engines (yahoo, bing, duckduckgo) did.   See for yourself : . Basically it treats it as a regular expression. So *+* will also not give any results. Still, shouldn't Google at least say that * is the asterisk symbol.  I don't know where else to ask this question, so I came to SO.
31806
On my site, I currently have no special rules for search engines. It is a blog, statically generated using a Python program. When I search for some of my articles on Google, there is usually a tag or category page included in the results. Sometimes it even ranks ahead of the article itself. Obviously, as these links aren't always going to have the article on them, this aren't the results I want people to click on.  So, I'm thinking of setting noindex on these pages. Is there any possible downside to doing so? Is this possible to do via robots.txt, or do I have to add it to all the relevant templates? All I can find for robots.txt are ways to stop the search engine crawling those pages, which isn't what I want - while I don't want them indexed, it's still the only surefire way to find all my blog posts.
99409
A search for domains like mysite.com provides thousands of results on  and hundreds on . I sampled some. Each and every one I checked was a post by someone ignorant about ,  and , as defined in . Other "natural examples" domains are abused pretty much too.  My request is - disallow these:   mysite.TLD site.TLD abc.TLD xyz.TLD [one letter repeated].TLD   When they are detected, propose  or . With old questions, use robot or find other way to edit them.    Even if SEO is not a problem, professional sites about Internet and associated technologies should not ignore RFC on such a large scale. Not to mention linking porn like about thousand links to xxx.com - I was already detected as one who visits "sites related to content forbidden here" by a firewall or two thanks to that.  I can assure you: you don't want to explain to your boss why are you searching for "adult content" in working hours, or agrotourism farm owner why that happens under his roof. Even WSODs are not nice. Now I think I have SE whitelisted, but anyway... Sadly, firewall was right, I did have xxx.com mentioned in my search results here and on Drupal Answers.
21458
I don't know much more about SEO, but it's interesting to learn about it. When I tried to search my website with an associated keyword or you can say with the exact name of the domain, I got some suggestions by Google. Here's .  First of all, I don't want to spamming here, I just want prove my question and want to give a hint about what I am talking here. The above link display the Did You Mean, I know the specific reason why Google shows this, but I want to know the Google's guidelines and some guidance by you experts so that if someone search for the particular keyword then Google hide that Did You Mean and display the result.
55048
Me and a friend are having a debate where she claims that every and all subdomains will get crawled/indexed by google unless you specifically tell it not to, and I'm saying that if a page isn't linked to from anywhere then it shouldn't get crawled.  For example, let's say I own example.com and I make a new subdomain with a weird  random name such as adayinthewoods.example.com and I throw a wordpress installation on there that I plan to use for testing purposes.  What would have to happen for google to start crawling and indexing this? Is google going to look at the whois records and see that I've added a subdomain in my DNS table and then start crawling it as a result? Is the fact I've installed wordpress on it making my installation "ping search engines"? How does that work? How do top level domains get crawled when it's a brand new domain? I assume the mechanism there is different from random subdomains.  What if I add a new page in my root folder called "noOneWillEverSeeThis.html", could that ever get crawled/indexed if it wasn't included in any sitemap and wasn't linked to from anywhere?  Would really appreciate a solid answer from someone that understands what's going on with this.  Thanks much
106604
It looks like we'll be adding  support to Stack Overflow. This is necessary to prevent bots, spammers, and other malicious scripted activity. We only want human beings to post or edit things here!  We'll be using a JavaScript (jQuery) CAPTCHA as a first line of defense:    The advantage of this approach is that, for most people, the CAPTCHA won't ever be visible!  However, for people with JavaScript disabled, we still need a fallback and this is where it gets tricky.  I have written a  which we can re-use.    However, I'd prefer to go with something textual to avoid the overhead of creating all these images on the server with each request.  I've seen things like..   ASCII text captcha: \/\/(_)\/\/ math puzzles: what is 7 minus 3 times 2? trivia questions: what tastes better, a toad or a popsicle?   Maybe I'm just tilting at windmills here, but I'd like to have a less resource intensive, non-image based &lt;noscript&gt; compatible CAPTCHA if possible.  Ideas?
8492
I have seen links in servers that can send you to a page in a browser, is there any way to replicate this with command blocks?  I don't mean command links, I mean web pages.
87724
What techniques are available for sending an email via a webpage or a form on a webpage?   I've got some background idea that you POST the form data to a script but I've don't really know what a cgi script is (I'd love to learn if this is the suggested method!) or what the current practice is.  This is just to provide some way for users to contact the operators. The in-page form seems like it would be easier on the user than ask them to open their mail client. I was also concerned about bots harvesting the contact email address (in the case of mailto: links).
372
What is the difference between the search() and match() functions in the ?  I've read the  (), but I never seem to remember it.  I keep having to look it up and re-learn it.  I'm hoping that someone will answer it clearly with examples so that (perhaps) it will stick in my head.  Or at least I'll have a better place to return with my question and it will take less time to re-learn it.
100633
I have a website built on drupal with search functionality. When I search for example for "test" the link of the search is displayed like search/node/test  Is there any possibility that if I call search/node/test?json or search/node/test/json the returned page would be plain text in json format of node ids ?
39874
I did a website scrape for a conversion project. I'd like to do some statistics on the types of files in there -- for instance, 400 .html files, 100 .gif, etc. What's an easy way to do this? It has to be recursive.   Edit: With the script that maxschelpzig posted, I'm having some problems due to the architecture of the site I've scraped. Some of the files are of the name *.php?blah=blah&amp;foo=bar with various arguments, so it counts them all as unique. So the solution needs to consider *.php* to be all of the same type, so to speak.
101250
I am lost in a big database and I am not able to find where the data I get comes from. I was wondering if it is possible with SQL Server 2005 to search for a string in all tables, rows and columns of a database?  Does anybody has an idea if it is possible and how?
14387
When I check Alexa rankings for my site it says that one site is linking to my site.   Is it only showing back links? If it is then why are other website traffic checking tools like Google showing different different back links?
97050
I noticed in my Webmaster Tools account that Google is crawling old site URLs that no longer exist.  Can anybody tell me where GoogleBot is getting these URLs?