Comments on: Logging: Unsexy, Important, and now Usable.

By: Ben

Ben — Wed, 31 Mar 2010 14:27:09 +0000

I too would be interested in how you differ/are better than Splunk which I am about to evaluate. Is it mainly data volume?

By: Ben

Ben — Tue, 30 Mar 2010 21:25:23 +0000

Great to see discussion about logging – not a hot topic everywhere but at end of day a key in my view, to insight into any application – and not just for debugging/recovering from errors. 1st question: Is this – LogSearch – hosted (eg cloud) or does one need to deploy it?

By: Scalability updates for Feb 18, 2010 | Scalable web architectures

Scalability updates for Feb 18, 2010 | Scalable web architectures — Fri, 19 Feb 2010 05:17:56 +0000

[...] Logging: unsexy, important and now usable [...]

By: Michael Wilde

Michael Wilde — Tue, 26 Jan 2010 20:15:16 +0000

@Bradford… would you consider 7-10TB per day a lot of data… because Splunk has customers of that volume… and ALOT less hardware necessary than Hadoop needs.

That being said.. i’m interested in your approach.

By: Stephan Schmidt

Stephan Schmidt — Tue, 26 Jan 2010 09:58:01 +0000

I agree, there is not enough discussion about logging. Some can be found in \Release it!\ and I’ve blogged about logging in the past, e.g. here

http://codemonkeyism.com/7-more-good-tips-on-logging/

Cheers
Stephan

By: Tweets that mention Logging: Unsexy, Important, and now Usable. | Road to Failure -- Topsy.com

Tue, 26 Jan 2010 07:19:05 +0000

[...] This post was mentioned on Twitter by Deepak, Régis Gaidot, Mike Olson, stefano bertolo, Mark Nielsen and others. Mark Nielsen said: Logging: Unsexy, Important, and now Usable. http://bit.ly/6XsK5c [...]

By: Xico

Xico — Tue, 26 Jan 2010 03:40:53 +0000

Splunk is a good introductory tool.

The NSA, Dept. of Treasury, IRS, tons of telcos, banks, insurance companies, health care companies use SenSage. Many customers gather 200GB to 500GB of log data daily from their data centers, aggregating them into 20-40 node clusters. And they keep this data around for forensic analysis for 2-7 years. At least one customer already has a petabyte under management.

http://www.sensage.com/customers/

By: Bradford

Bradford — Tue, 26 Jan 2010 00:25:24 +0000

By “huge” amounts of data we mean several TB. We scale down to GB, of course. Not that huge these days, but it’s more than an RDBMS or several competitors can handle.

Yes, we’re shared nothing.

By: Kevin

Kevin — Tue, 26 Jan 2010 00:22:03 +0000

What do you guys consider huge amounts of data?

In a distributed environment are you shared nothing.

By: Bradford

Bradford — Mon, 25 Jan 2010 22:46:17 +0000

Yes, Splunk is very good with small to moderate amounts of data. Our tool focuses on scaling to massive amounts of data, and handles both search and analytics.