java - parse json objects from a log file -

-

i want parse json objects log file. using json parser complete files has in json format not case me. there way can parse file line line , json objects. below log file format:

2015-10-19 11:24:35:701 info  brokertcpclient:28 - set destination  2015-10-19 11:24:35:929 debug brokertcpclient:32 - received data: {type=data,  payload={      "core" : [ {       "id" : {         "datatype" : "http://www.w3.org/2001/hk#long",         "type" : "gh",         "value" : "gh"       },       "entity" : {         "type" : "uri",         "value" : "http://fg.fg.com/ext/g/fg"       },       "sno" : {         "type" : "literal",         "value" : "fg"       }] 2015-10-19 11:24:35:701 info  brokertcpclient:28 - set destination  2015-10-19 11:24:35:929 debug brokertcpclient:32     "core" : [ {       "id" : {         "datatype" : "http://www.w3.org/2001/hk#long",         "type" : "gh",         "value" : "gh"       },       "entity" : {         "type" : "uri",         "value" : "http://fg.fg.com/ext/g/fg"       },       "sno" : {         "type" : "literal",         "value" : "fg"       }]

can 1 please how should json objects. when trying parse single line of json objects throwing exception.

here solution works sample log posted.

import java.io.*; import com.fasterxml.jackson.databind.*; public class jsontest {     public static void main(string[] args) {         string logfilename = "c://temp/sample.log";         string line, json = "";          try (bufferedreader br = new bufferedreader(new filereader(logfilename))) {             while ((line = br.readline()) != null) {                 if (islogline(line)) {                     if (!json.isempty()) {                         parsejson(json);                         json = "";                     }                 } else {                     json += line;                 }             }         } catch (exception e) {             e.printstacktrace();         }     }      public static boolean islogline(string line) {         return line.matches("^\\d{4}\\-\\d{2}\\-\\d{2}\\s\\d{2}:\\d{2}:\\d{2}:\\d{3}.+$");     }      public static void parsejson(string json) throws exception {         if (!json.startswith("{") && !json.endswith("}")) json = "{" + json + "}";         objectmapper om = new objectmapper();         system.out.println(om.readvalue(fixjson(json), object.class));     }      public static string fixjson(string json) {         return "{" + json.replace("}]", "}}]") + "}";     } }

notes:

  1. the regex identifies log line checking timestamp @ begining of line. not work in case log message spans multiple lines (for example if message contains new line)
  2. there method attempts "fix" incomplete json log file, may need additional logic, if there more cases of incomplete json along way
  3. i used jackson json parser , let objectmapper figure out data structure parse into

Comments

Post a Comment

Popular posts from this blog

php - Invalid Cofiguration - yii\base\InvalidConfigException - Yii2 -

-
Image
i've installed yii2-user module/dektrium yii2-app-basic application command composer require "dektrium/yii2-user:0.9.*@dev" config/console.php return [ . . 'modules' => [ 'gii' => 'yii\gii\module', 'user' => [ 'class' => 'dektrium\user\module', ], ], . . ] config/web.php 'components' => [ . . /* 'user' => [ 'identityclass' => 'app\models\user', 'enableautologin' => true, ], */ 'modules' => [ 'user' => [ 'class' => 'dektrium\user\module', ], ], . . ] after that, run command $ php yii migrate/up --migrationpath=@vendor/dektrium/yii2-user/migrations updating database schema . but, when run http://localhost/mylawsuit/yii/web/index.php?r=u
Read more

How to show in django cms breadcrumbs full path? -

-
need advice - how show in breadcrumbs whole path article or page? i've got code: {% ance in ancestors %} <li> {% if not forloop.last %} <a href="{{ ance.get_absolute_url }}">{{ ance.get_menu_title }}</a> {% else %} <span class="active">{{ ance.get_menu_title }}</span> {% endif %} </li> {% endfor %} but shows "home" , current page. how modify show whole path in breadcrumbs? i've found in file menu_tags.py code calls ancestors. @ least there class showbreadcrumbs: class showbreadcrumb(inclusiontag): """ shows breadcrumb node has same url current request - start level: after level should breadcrumb start? 0=home - template: template used render breadcrumb """ name = 'show_breadcrumb' template = 'menu/dummy.html' options = options( argument('start_level', default=0, require
Read more

ruby on rails - npm error: tunneling socket could not be established, cause=connect ETIMEDOUT -

-
i have app uses rails framework , implements angularjs part of front end. i have pushed heroku , have heroku toolbelt installed, when try migrate db using "heroku run rake db:migrate" receive following error(s): installing core plugins heroku-cli-addons, heroku-apps, heroku-fork, heroku-git, heroku-local, heroku-run, heroku-status... error installing package. try running again gode_debug=info see more output. ! `run` not heroku command. ! perhaps meant `-h`, `2fa`, `auth`, `join`, `open`, `orgs`, `pg`, `ps` or `rake`. ! see `heroku help` list of available commands. i run command "gode_debug=info heroku run rake db:migrate" , receive error: npm err! darwin 14.5.0 npm err! argv "/users/christopher_pelnar/.heroku/node-v4.2.1-darwin-x64/bin/node" "/users/christopher_pelnar/.heroku/node-v4.2.1-darwin-x64/lib/node_modules/npm/cli.js" "install" "heroku-cli-addons" "heroku-apps" "heroku-fork
Read more