We have a GraphQL interface that people can use to scrape Forum data.
We block web crawlers from the All Posts page so that they don’t click “load more” a thousand times and slow down the site. But you can use your own crawlers on the page if you’re willing to click “Load More” a lot.
Let me know if you have more questions, and I’ll make sure they get answered (that is, I’ll ask the tech team).
We have a GraphQL interface that people can use to scrape Forum data.
We block web crawlers from the All Posts page so that they don’t click “load more” a thousand times and slow down the site. But you can use your own crawlers on the page if you’re willing to click “Load More” a lot.
Let me know if you have more questions, and I’ll make sure they get answered (that is, I’ll ask the tech team).
You don’t need to use the allPosts page to get a list of all the posts. You can just ask the GraphQL API for the ids of all of them.