Skip to content

Semi-automatic incremental construction and debugging of regular expressions for grok to parse logfiles for logstash http://logstash.net/ . Deployed at http://grokconstructor.appspot.com/ .

Notifications You must be signed in to change notification settings

JoernSchimmelpfeng/GrokConstructor

 
 

Repository files navigation

grokconstructor

AVAILABLE ON http://grokconstructor.appspot.com/

Grok is a collection of named regular expressions that can be used - for instance with logstash http://logstash.net/ - to parse logfiles. GrokDiscovery http://grokdebug.herokuapp.com/ can somewhat help you by suggesting regular expressions. GrokConstructor goes beyond that by finding many possible regular expressions that match a whole set of logfile lines by using groks patterns and fixed strings. This can be done automatically (which is of limited use only for small stuff), or in a incremental process.

Use it on http://grokconstructor.appspot.com/ - there is also a good description, and you can use it on some examples or for your own log lines you want to match.

To run locally, build with mvn clean install and start with mvn appengine:devserver . It runs on http://localhost:9090/

Status: beta.

TODO:

  • Better error handling in incremental matching
  • Give definition of grok patterns as title on pattern selections.
  • Send mail for bugreports
  • !!! Log4j Conversion pattern to grok regex converter

TODO eventually:

  • Move error box on top of page
  • AutomaticDiscoveryView: use simpler examples such that the output makes sense.
  • Quoting and unquoting of patterns for logstash.conf
  • Clarify licence.

https://cloud.google.com/appengine/docs/java/tools/maven : mvn help:describe -DgroupId=com.google.appengine -DartifactId=appengine-maven-plugin -Ddetail=true

About

Semi-automatic incremental construction and debugging of regular expressions for grok to parse logfiles for logstash http://logstash.net/ . Deployed at http://grokconstructor.appspot.com/ .

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Scala 50.5%
  • CSS 29.4%
  • HTML 14.9%
  • Java 5.2%