Social Harvest Review

It's built in Go and takes advantage of concurrency allowing it to be quite fast. It can gather and analyze data quickly and efficiently using very little system resources.

It stores data to several databases natively (including Postgres which is then of course available on Amazon RDS and RedShift, etc.), but also logs out to file on disk. These files can then be picked up by something like Fluentd and then sent literally anywhere. This allows Social Harvest to fit any work flow and act as a stand alone data harvester (without the dashboard part).

It's free, open source software allowing it to be modified to fit specific needs. It's licensed under GPL v3 with code available on GitHub.