<div dir="ltr"><div class="gmail_extra"><div><div dir="ltr"><div><div>You'll see it's easy. The cool thing is you only update your robots.txt when you change the structure of the site. Permit all the URLs you want using rules and exclude all the URL styles you don't want (also using rules). </div><div><br></div><div>I'm not convinced a sitemap can do much for a forum. Perhaps to add detail to some pages that surround the forum (if there are any). Make sure you're using google Webmaster tools if you start fooling with that. But you should already be using it...</div><div><br></div><div><br></div></div></div></div>
<br><div class="gmail_quote">On Tue, Sep 16, 2014 at 4:02 PM, Richard Sloan <span dir="ltr"><<a href="mailto:rsloan@themindfactory.com" target="_blank">rsloan@themindfactory.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Thanks I will have a look at that and see if that can be done.<br></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Sep 16, 2014 at 3:58 PM, Darcy Whyte <span dir="ltr"><<a href="mailto:darcy@siteware.com" target="_blank">darcy@siteware.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Oh I see...<div><br></div><div>I think you want to look at robots.txt to keep crawlers off the duplicate urls. </div><div><div><div><br></div><div><br></div><div class="gmail_extra"><div><div dir="ltr"><div><div><br></div><div><br></div></div></div></div>
<br><div class="gmail_quote">On Tue, Sep 16, 2014 at 3:50 PM, Richard Sloan <span dir="ltr"><<a href="mailto:rsloan@themindfactory.com" target="_blank">rsloan@themindfactory.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div>I had posted a link to the new site I started a few weeks back now, it has become very popular and I am submitting site links to Google and worried that I might be sending duplicate content. the site is <a href="http://www.esp8266.com" target="_blank">http://www.esp8266.com</a> and its a Community Forum for a new low cost WIFI IC that has come out of Asia.<br><br></div>I think I found a mod for SEO that deals with duplicate content and changes cryptic URLS like <a href="http://www.esp8266.com/viewtopic.php?f=9&t=19" target="_blank">http://www.esp8266.com/viewtopic.php?f=9&t=19</a> into <a href="http://www.esp8266.com/compiler-chat-f9-t19" target="_blank">http://www.esp8266.com/compiler-chat-f9-t19</a> kind of format.<br><br></div>R.<br></div><div class="gmail_extra"><br><div class="gmail_quote"><div><div>On Tue, Sep 16, 2014 at 3:00 PM, Darcy Whyte <span dir="ltr"><<a href="mailto:darcy@siteware.com" target="_blank">darcy@siteware.com</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div><div dir="ltr"><div>Does the forum have a lot of content yet or is it a future forum? Where is it if it exists? </div><div><br></div>If you want to use sitemaps you'll want to have it rendered from software.. You may want to manually tag some content as important and frequent though. Just tag them in the database. But don't change their tables. Add tables and use a foreign key to link your flags to their data.<div><br></div><div>For duplicate content, .... well you shouldn't have duplicate content much but if there are numerous URL's that have the same content (which happens), you want to use robots.txt to keep indexers out of that.</div><div><br></div><div>The robots.txt is probably worth to keep the crawlers focused but I'm not convinced a sitemap has much benefit. Forums benefit more from community management and development of content people want. The google indexer will figure that out based on the link structure that forms around it.</div></div><div class="gmail_extra"><br clear="all"><div><div dir="ltr"><br><div><div><br></div><div><div>--</div><div>Darcy Whyte</div><div><br></div><div>Software Since '88 <a href="http://siteware.com" target="_blank">siteware.com</a> | Contact: <a href="mailto:darcy@siteware.com" target="_blank">darcy@siteware.com</a> | <a href="tel:613-563-3634" value="+16135633634" target="_blank">613-563-3634</a> by appointment</div><div><br></div><div>Canada N 45° 25'03.1" W 75° 42'21.4"</div></div><div>Art+ <a href="http://inventorartist.com/" target="_blank">inventorArtist.com</a> | Aviation <a href="http://rubber-power.com/" target="_blank">rubber-power.com</a><br></div><div><br></div><div><br></div></div></div></div>
<br><div class="gmail_quote"><span>On Tue, Sep 16, 2014 at 2:50 PM, Richard Sloan <a href="mailto:themindfactory@gmail.com" target="_blank">themindfactory@gmail.com</a> [ORE_bits] <span dir="ltr"><<a href="mailto:ORE_bits@yahoogroups.com" target="_blank">ORE_bits@yahoogroups.com</a>></span> wrote:<br></span><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<u></u>
<div style="background-color:#fff">
<span> </span>
<div>
<div><span>
<div>
<p></p><p dir="ltr">I am currently running a phpbb3 forum and wonder if anyone else has experience with this code and particularly sitemaps and duplicate content?</p>
<p></p>
</div>
</span><div style="color:#fff;min-height:0">__._,_.___</div>
<div style="clear:both"> </div>
<div style="margin-top:10px">
<hr style="min-height:2px;border-width:0;color:#e3e3e3;background-color:#e3e3e3">
Posted by: Richard Sloan <<a href="mailto:rsloan@themindfactory.com" target="_blank">rsloan@themindfactory.com</a>> <hr style="min-height:2px;border-width:0;color:#e3e3e3;background-color:#e3e3e3">
</div>
<div style="clear:both"> </div>
<table style="margin-top:10px;margin-bottom:10px;color:#2d50fd" cellspacing="4px">
<tbody>
<tr>
<td style="font-size:12px;font-family:arial;font-weight:bold;padding:7px 5px 5px">
<a style="text-decoration:none;color:#2d50fd" href="https://groups.yahoo.com/neo/groups/ORE_bits/conversations/messages/14660;_ylc=X3oDMTJxdDU3aGlsBF9TAzk3MzU5NzE0BGdycElkAzE5MjI3MTAEZ3Jwc3BJZAMxNzA1MTM3MDc4BG1zZ0lkAzE0NjYwBHNlYwNmdHIEc2xrA3JwbHkEc3RpbWUDMTQxMDg5MzQzMw--?act=reply&messageNum=14660" target="_blank">Reply via web post</a>
</td>
<td>•</td>
<td style="font-size:12px;font-family:arial;padding:7px 5px 5px">
<a href="mailto:rsloan@themindfactory.com?subject=Re%3A%20Phpbb3" style="text-decoration:none;color:#2d50fd" target="_blank">
Reply to sender </a>
</td>
<td>•</td>
<td style="font-size:12px;font-family:arial;padding:7px 5px 5px">
<a href="mailto:ORE_bits@yahoogroups.com?subject=Re%3A%20Phpbb3" style="text-decoration:none;color:#2d50fd" target="_blank">
Reply to group </a>
</td>
<td>•</td>
<td style="font-size:12px;font-family:arial;padding:7px 5px 5px">
<a href="https://groups.yahoo.com/neo/groups/ORE_bits/conversations/newtopic;_ylc=X3oDMTJlMGUxZWFyBF9TAzk3MzU5NzE0BGdycElkAzE5MjI3MTAEZ3Jwc3BJZAMxNzA1MTM3MDc4BHNlYwNmdHIEc2xrA250cGMEc3RpbWUDMTQxMDg5MzQzMw--" style="text-decoration:none;color:#2d50fd" target="_blank">Start a New Topic</a>
</td>
<td>•</td>
<td style="font-size:12px;font-family:arial;padding:7px 5px 5px;color:#2d50fd">
<a href="https://groups.yahoo.com/neo/groups/ORE_bits/conversations/topics/14660;_ylc=X3oDMTM2dWFhdW8xBF9TAzk3MzU5NzE0BGdycElkAzE5MjI3MTAEZ3Jwc3BJZAMxNzA1MTM3MDc4BG1zZ0lkAzE0NjYwBHNlYwNmdHIEc2xrA3Z0cGMEc3RpbWUDMTQxMDg5MzQzMwR0cGNJZAMxNDY2MA--" style="text-decoration:none;color:#2d50fd" target="_blank">Messages in this topic</a>
(1)
</td>
</tr>
</tbody>
</table>
<div>
<hr style="min-height:2px;border-width:0;color:#e3e3e3;background-color:#e3e3e3">
<div>
<div style="margin-bottom:10px">
<div style="background-color:white">
<div style="display:inline"><img name="148800f26ead2dbb_148800c8604ef61e_148800ba9afe26ca_1488003e19ee336e_1487fd704602f929_1487fcd402d15bc0_tn_file" style="padding:0px 10px;vertical-align:top;margin-top:5px" src="http://l.yimg.com/ru/static/images/yg/img/megaphone/1410876701_phpHfAKXM" height="82" width="82"></div>
<div style="display:inline-block">
<div style="padding-left:6px;font-size:13px;color:gray">Yahoo Groups</div>
<a rel="nofollow" name="148800f26ead2dbb_148800c8604ef61e_148800ba9afe26ca_1488003e19ee336e_1487fd704602f929_1487fcd402d15bc0_sub_url" href="http://yahoogroups.tumblr.com/post/97620124611/search-improvements-in-yahoo-groups" style="color:#0000ff;display:block;margin-left:5px;text-decoration:none" target="_blank"><div style="font-size:15px">New Improved Groups Search</div></a>
<div style="max-width:530px;padding:2px 5px">Searching for new groups to join is easier than ever. We've honed our algorithm to bring you better search results based on relevance and activity. Try it today!</div>
</div>
</div>
</div> </div>
<hr style="min-height:2px;border-width:0;color:#e3e3e3;background-color:#e3e3e3">
<div>
<div>
<div style="background-color:white;padding:0px 10px">
<div style="margin-right:10px;display:inline-block;width:400px">
<a rel="nofollow" style="text-decoration:none" href="http://yahoogroups.tumblr.com/post/97620124611/search-improvements-in-yahoo-groups" target="_blank"><div style="font-size:15px;line-height:20px;color:blue">Improvements in Yahoo Groups Search</div></a>
<div style="margin-top:5px">Searching for new groups to join is easier than ever. We've honed our algorithm to bring you better search results based on relevance and activity. Try it today!</div>
</div>
<div style="display:inline-block;vertical-align:top;margin-top:10px">
<a rel="nofollow" href="https://help.yahoo.com/kb/groups/SLN2409%20.html" name="148800f26ead2dbb_148800c8604ef61e_148800ba9afe26ca_1488003e19ee336e_1487fd704602f929_1487fcd402d15bc0_lm_btn_url" style="text-decoration:none" target="_blank">
<input value="Learn more" style="font-size:14px;vertical-align:middle;min-height:30px;margin-bottom:10px;width:100px;background-color:rgb(250,250,250);margin-right:10px" name="lm_btn" type="button">
</a>
<a rel="nofollow" href="https://groups.yahoo.com/neo/search;_ylc=X3oDMTExaGFoanEzBF9TAzk3MzU5NzE0BGNmMTEDUEEEc2VjA21lZ2FwaG9uZQ--?query=" name="148800f26ead2dbb_148800c8604ef61e_148800ba9afe26ca_1488003e19ee336e_1487fd704602f929_1487fcd402d15bc0_try_btn_url" style="text-decoration:none" target="_blank">
<input value="Try it now" style="font-size:14px;vertical-align:middle;min-height:30px;margin-bottom:10px;width:100px;background-color:rgb(250,250,250)" name="try_btn" type="button">
</a>
</div>
</div>
</div> </div>
<hr style="min-height:2px;border-width:0;color:#e3e3e3;background-color:#e3e3e3">
</div>
<div style="font-family:Verdana;font-size:12px;padding:15px 0">
To unsubscribe from this group, send an email to:<br>
<a href="mailto:ORE_bits-unsubscribe@groups.yahoo.com" target="_blank">ORE_bits-unsubscribe@groups.yahoo.com</a><br>
<br>
</div>
<div style="background-color:#f2f2f2;font-family:Verdana;font-size:10px;margin-bottom:10px;padding:10px">
<span style="font-weight:bold;color:#333;text-transform:uppercase"><a href="https://groups.yahoo.com/neo/groups/ORE_bits/info;_ylc=X3oDMTJlaGhlYnFlBF9TAzk3MzU5NzE0BGdycElkAzE5MjI3MTAEZ3Jwc3BJZAMxNzA1MTM3MDc4BHNlYwN2dGwEc2xrA3ZnaHAEc3RpbWUDMTQxMDg5MzQzMw--" style="text-decoration:none" target="_blank">Visit Your Group</a></span>
<ul style="list-style-type:none;margin:0;padding:0;display:inline">
</ul>
</div>
<div style="font-family:Arial;font-size:11px;margin-top:5px;padding:0 2px 0 0;clear:both">
<a href="https://groups.yahoo.com/neo;_ylc=X3oDMTJka3RlcTZxBF9TAzk3NDc2NTkwBGdycElkAzE5MjI3MTAEZ3Jwc3BJZAMxNzA1MTM3MDc4BHNlYwNmdHIEc2xrA2dmcARzdGltZQMxNDEwODkzNDMz" style="float:left" target="_blank"><img src="http://l.yimg.com/ru/static/images/yg/img/email/new_logo/logo-groups-137x15.png" alt="Yahoo! Groups" style="border:0" height="15" width="137"></a>
<div style="color:#747575;float:right"> • <a href="https://info.yahoo.com/privacy/us/yahoo/groups/details.html" style="text-decoration:none" target="_blank">Privacy</a> • <a href="mailto:ORE_bits-unsubscribe@yahoogroups.com?subject=Unsubscribe" style="text-decoration:none" target="_blank">Unsubscribe</a> • <a href="https://info.yahoo.com/legal/us/yahoo/utos/terms/" style="text-decoration:none" target="_blank">Terms of Use</a> </div>
</div>
<br>
</div>
<div style="width:160px;float:right;clear:none;margin:0 0 25px 0;background:#fff">
<div>
</div>
</div>
<div style="clear:both;color:#fff;font-size:1px">.</div>
</div>
<img src="http://geo.yahoo.com/serv?s=97359714/grpId=1922710/grpspId=1705137078/msgId=14660/stime=1410893433" height="1" width="1"> <br>
<img src="http://y.analytics.yahoo.com/fpc.pl?ywarid=515FB27823A7407E&a=10001310322279&js=no&resp=img&cf10=PA&cf11=PA" height="1" width="1">
<div style="color:#fff;min-height:0">__,_._,___</div>
</div>
</blockquote></div><br></div>
<br></div></div>_______________________________________________<br>
Lab mailing list<br>
1. subscribe <a href="http://artengine.ca/mailman/listinfo/lab" target="_blank">http://artengine.ca/mailman/listinfo/lab</a><br>
2. then email <a href="mailto:Lab@artengine.ca" target="_blank">Lab@artengine.ca</a> to send your message to the list<br></blockquote></div><br></div>
</blockquote></div><br></div></div></div></div>
<br>_______________________________________________<br>
Lab mailing list<br>
1. subscribe <a href="http://artengine.ca/mailman/listinfo/lab" target="_blank">http://artengine.ca/mailman/listinfo/lab</a><br>
2. then email <a href="mailto:Lab@artengine.ca" target="_blank">Lab@artengine.ca</a> to send your message to the list<br></blockquote></div><br></div>
</div></div><br>_______________________________________________<br>
Lab mailing list<br>
1. subscribe <a href="http://artengine.ca/mailman/listinfo/lab" target="_blank">http://artengine.ca/mailman/listinfo/lab</a><br>
2. then email <a href="mailto:Lab@artengine.ca">Lab@artengine.ca</a> to send your message to the list<br></blockquote></div><br></div></div>