I read here  on the section "Which URLs should be put in a sitemap" that i should exclude Paginated Pages, i seached it on google and i did'nt found a person saying that i should'nt, i also don't found a person saying that i should, so i'm kinda confused.  The content from my paginated pages is unique and i'ts can only be accessable with the url , there's only one item in this page, and only the first item can be accessable with the url   I want to know: can i put these URL on sitemap?
121334
My website is ad listing for boats, boats' engines, boat rentals, etc (www.mynautics.com).  There are ads listed on multiple pages. I have finished (not jet seen on link above) pagination:   added prev added next   On some pages (sorting, etc.) I also added canonical relation.  Now I want to add pages to sitemap generator and I am not sure if I should add all URLs for example:   example.com/list/page/1  example.com/list/page/2  example.com/list/page/3 example.com/list/page/4   Or should I just add example.com/list?
67528
Just out of curiosity, I have developed a small app analysing and generating sitemaps for a given domain.   Can I tell search engines to look for the sitemap of a given domain on my app using a dynamic url i.e. can you use cross-domain sitemaps.xml without validating you are owner of the destination domain?  For example :   http://example.com/mydomain.com/sitemap.xml
26883
I am having an issue with one of the websites.  Google is reporting that I am having duplicate meta descriptions for few pages. What we did is that we used URL rewrite to rewrite the pages to be more seo friendly. Here is one example with one of our product pages:  Old format:  www.mysite.com/Product.aspx?ProductID=12345&amp;SKU=44412-2212A   New format:  www.mysite.com/Products/12345-44412-2212a.aspx   What we are doing now, when someone will ask for www.mysite.com/Products/12345-44412-2212a.aspx they are taken to www.mysite.com/Product.aspx?ProductID=12345&amp;SKU=44412-2212A but the URL still remains www.mysite.com/Products/12345-44412-2212a.aspx.  But if someone type in www.mysite.com/Product.aspx?ProductID=12345&amp;SKU=44412-2212A, they will see exactly the same page as www.mysite.com/Products/12345-44412-2212a.aspx since the data on the page is same.  What I was thinking is to block product.aspx pages in robots.txt file, but I don't know if that automatically will block Google bots from crawling this page too www.mysite.com/Products/12345-44412-2212a.aspx, since that one is only URL rewritted page from the other page format, www.mysite.com/Product.aspx?ProductID=12345&amp;SKU=44412-2212A.  What do you guys think, how can we tackle this problem, any advice, because GWT is reporting that I have duplicate meta description issue, and those are the pages reported as duplicate, I want to have only one page per product?
30732
What is the difference between these two URLs:   http://example.com/ http://example.com   Should we always add the final / or avoid it? Does it make a difference?
31806
On my site, I currently have no special rules for search engines. It is a blog, statically generated using a Python program. When I search for some of my articles on Google, there is usually a tag or category page included in the results. Sometimes it even ranks ahead of the article itself. Obviously, as these links aren't always going to have the article on them, this aren't the results I want people to click on.  So, I'm thinking of setting noindex on these pages. Is there any possible downside to doing so? Is this possible to do via robots.txt, or do I have to add it to all the relevant templates? All I can find for robots.txt are ways to stop the search engine crawling those pages, which isn't what I want - while I don't want them indexed, it's still the only surefire way to find all my blog posts.
55048
Me and a friend are having a debate where she claims that every and all subdomains will get crawled/indexed by google unless you specifically tell it not to, and I'm saying that if a page isn't linked to from anywhere then it shouldn't get crawled.  For example, let's say I own example.com and I make a new subdomain with a weird  random name such as adayinthewoods.example.com and I throw a wordpress installation on there that I plan to use for testing purposes.  What would have to happen for google to start crawling and indexing this? Is google going to look at the whois records and see that I've added a subdomain in my DNS table and then start crawling it as a result? Is the fact I've installed wordpress on it making my installation "ping search engines"? How does that work? How do top level domains get crawled when it's a brand new domain? I assume the mechanism there is different from random subdomains.  What if I add a new page in my root folder called "noOneWillEverSeeThis.html", could that ever get crawled/indexed if it wasn't included in any sitemap and wasn't linked to from anywhere?  Would really appreciate a solid answer from someone that understands what's going on with this.  Thanks much
87272
On one of our classified sites, when doing site:[mysite.com] in Google, the link text is simply [product name] - [mysite.com], where as it should read [product name] classifieds for sale in...  I suspect that the site map may have been submitted when we just had [product name], and updated the page titles later.  However, it has been a couple of weeks that I have confirmed the longer page titles, and still they appear shortened in organic results.  How can I get this looking right in Google's organic results?
7008
I'm working for a website to convert the website URL to an SEO friendly URL. I plan to use this:  example.com/category-name/pageid-123-page-name  I looked at some similarly categorized, highly ranked websites. They have the same structure, except for one thing. In one case, the URL format was  example.com/category-name/pageid-123-page-name.html  Another was   example.com/category-name/pageid-123-page-name.php  Now I know the text in URLs help with SEO. Is it more helpful to have a file extension? If yes, which one is better?  Or if my current plan is okay, will it be better with a / at the end?
16479
We have a site with categories and subcategories.  If anybody navigates to a content belongs to a subcategory the url will have the following form: domain/main-category/sub-category/mycontent/ But we need another form: domain/main-category/mycontent where mycontent belongs a subcategory inside main-category, but we don't want the subcategory to be displayed in the URL.  Is there any possible solution for this?
24818
I have the schema with this:  &lt;sitemapindex xmlns="https://www.sitemaps.org/schemas/sitemap/0.9"&gt;   Is it correct or should be:  &lt;sitemapindex xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"&gt;   if all my web pages are on HTTPS?
86769
We have a website dedicated to our ActiveX and .NET components that has been working for more than 12 years. The site consists of 2 parts: the static part (product descriptions and articles) and the dynamic part (forum dedicated to our tools).  Google indexes the static part without any problems - all the pages are found due to a good textual hyperlink menu system. These pages also have good positions in SERPs.  However, many SEO pro's insist that we need to have a sitemap.xml file to enhance the positions of our website in the "eyes" of Google or other search engines like Bing. My 2 questions related to this are the followings:  1) Do we really need sitemap.xml for our website?  2) If so, how to code the dynamic forum pages in it?
31617
We have recently discovered a host of spammy links pointing to our website been put up in last 1 month through webmaster tool We have not engaged any seo agency/link building and have never created these links  Worst, these are spammy forum sites and almost some-one seems making an attack to our site as the link and keyword is same in all these sites Till not Have not received any warning, however as it has come to our notice - before any SERP getting down - we want to action this out  One thing we have observed is that - All these spammy links points to a single inner page of website  Pl suggest as have   a) Will Google disvow tool will work by stating to disvow these links  or  b) Is it a good way if we make this specific page 'nofollow' and even 'noindex' The reasoning behind this is like if the page is not followed and not indexed - the negative links pointing to the page of the site is already no follow and may be out from google serp  or what's the best alternate way to tackle this. Pl suggest in urgent help and advise required
110632
I'm currently building a sitemap for my web app.  Note: my app is a single page app built with React and Firebase.  Basically I wan to index blogPost and product pages. So I intend to generate my sitemap dynamically (on server). It's a small website (around 500 pages).  I want to build something like this:  &lt;urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"&gt;   &lt;url&gt;     &lt;loc&gt;       https://www.myproject.org/blog/some-blog-post-slug     &lt;/loc&gt;     &lt;lastmod&gt;2019-11-14T20:22:43.502+00:00&lt;/lastmod&gt;     &lt;changefreq&gt;weekly&lt;/changefreq&gt;     &lt;priority&gt;0.8&lt;/priority&gt;   &lt;/url&gt;   &lt;url&gt;     &lt;loc&gt;       https://www.myproject.org/dp/some-product-slug     &lt;/loc&gt;     &lt;lastmod&gt;2019-11-15T13:08:52.127+00:00&lt;/lastmod&gt;     &lt;changefreq&gt;weekly&lt;/changefreq&gt;     &lt;priority&gt;0.8&lt;/priority&gt;   &lt;/url&gt; &lt;/urlset&gt;   And I keep the following properties in my database, both for blogPosts and products:  createdAt: &lt;Timestamp&gt; lastModifiedAt: &lt;Timestamp&gt;  // UPDATED EVERYTIME I UPDATE THE RECORD   And I'm thinking about using my lastModifiedAt value as the &lt;lastmod&gt; tag for the sitemap.  So far, so good! Everytime I update my blogPost or product objects in my database. The next time the sitemap is requested, the new modifiedDate will show on those that have been changed.  QUESTION  But what if I make a change not in the database itself, but in the way I render all the product pages, for example.  Imagine that I've added some structured data tags to display rich results on google, with price, reviews etc. So my product info is the same, but from that point on, all of my product pages will render those extra tags that I need to be re-indexed.  Example (add a structured data tag with the product price):   &lt;div property="schema:price" content="119.99"&gt;&lt;/div&gt;   In that situation, will I have to update all &lt;lastmod&gt; for all the products? How Google will know that it needs to re-crawl those pages and be able to see the structured data tags?  What if I change only the styles for the productPages? Do I have to update the &lt;lastmod&gt; for every product in this case?
113432
My urls do not seem to have my main keywords in them. Is this bad for SEO? Should I include them?   Of course I do not mean actually writing one keyword after each other, but have an organically / naturally readably URL which makes sense to the user and to SEO, if at all, hence my question.
89412
The crawl report shows this: "HTTP ‎(1)‎ In Sitemaps ‎(5)‎ Not found ‎(993)‎ Restricted by robots.txt ‎(487,544)‎"  So the discrepancy between 50,000 and 44,592 isn't coming from that.  Are there any obvious reasons?
87136
I created a custom URL parameter for sorting posts by their vote scores. I have a "most voted" link that sends a ?sort=most_voted URL paramater and using a query posts filter I display posts with most votes.  If for instance I want to display most voted posts in category 5, I'll need a URL like this ?cat=5&amp;sort=most_votes  How do I preserve/attach the sort parameter in the URL when browsing categories (or even by tag name, search, etc)?
120821
In short:  Should I resubmit my sitemap through Google Webmasters Tools every time I replace a sitemap.xml with an existing sitemap.xml (i.e., www.domain.com/sitemap.xml)? Or does it check it automatically?  Detail explanation:  Once a week, I add  new articles to my website, and each time after uploading new content, I am replacing my existing sitemap.xml with a newly generated sitemap.xml in my website folder.  So, do you think I need to do the same changes (i.e., again submitting the sitemap.xml) to search engines (e.g., Google, Bing, etc...) and in Google Webmaster Tools also?  Yandex Webmaster Tools says this regarding sitemaps:     Please note: there is no need to delete or add another Sitemap file if it has been modified as the Yandex indexing robot regularly checks for changes.