Hi there fellow RPers! I'm a long time lurker but I actually never made an account.

First of all, thank you all for sharing your knowledge and helping me and many others understand how the world really works: yes, it was shocking, frustrating at first but now it all makes sense. It's awesome how this community works even though I wasn't actually part of it - I just read what you guys suggested and spent days looking in the contributions made by /u/Rollo-Tomassi, /u/IllimitableMan, /u/GayLubeOil, and many others.

Now let's get to the business: yesterday a wrote a little Ruby script that backs up the last 1000 posts in the "Hot" section and all the posts from the "Top" (all time) section. It saves each post with its comments in a YAML file (the content is a serialised hash containing the post object(RedditKit::Link) and the comment objects (RedditKit::Comment). The stored data is as raw as it gets, but it can be made back into an object and used (for example inserted into a database and presented in a simple web application).

I want to improve the script so I can fetch all of the important TRP submissions; the plan is to get each author from the posts already saved and check their submission history for /r/TheRedPill and then save everything that matches.

At this point the script runs for about 2 hours (Reddit API limit friendly) by making a 2 second sleep between requests. Feel free to contribute, I will check and merge pull requests. You can find the code on github.