XML Sitemap for threads + LastMod
The single biggest challenge we deal with on larger projects is crawl budget limitation. Buried pages - pages with a depth over 10 often see little to no crawler traffic, which means that these pages tend to drop in value and expire over time. Sitemaps are a good way of remedying this, as we could provide crawlers with direct links to the threads themselves, adding another avenue of discovery outside of organic crawl traffic.However, the current sitemap layout only covers the first level of depth the site, which means the front page and high level categories. With depth we mean the number of clicks from the front page to the page in question. The RSS feed only covers a minor part of the site, and generally speaking pages that would have organically floated to the top anyway. I think this is an issue that most users on this platform will run into sooner or later. While it is possible to alleviate this through third party generated sitemaps, they are costly and often cause additional st