Enable web site log analysis

[dfandrich]

Right now, the statistics that Fastly gives on web site accesses is extremely broad. It would be useful at times to have more details on which URLs are being hit most, and which ones are causing errors. Logs on the origin server don't provide many details because of the caching. This would be very useful in cases like #344 for example, and it might have spotted #272 for us, as well as just giving general estimates on site usage.

Fastly has just announced their own analysis system that is in beta: https://www.fastly.com/blog/introducing-log-manager-and-insights-now-in-beta It might be worth asking them if we could try it out. With curl's traffic levels, even running it for an hour would likely provide some useful insights.

Alternately, running a simple access log analysis tool like http://www.awstats.org/ on the origin server would be better than nothing.

If this is done, privacy of the reports needs to be considered, which probably means most reports can't be publicly visible.