maven - Apache SparkUI on local mode -
i'm new apache spark. using in on intellij idea 14, maven project method. i'm unable access spark ui after program stops because of
15/10/22 23:28:27 info sparkui: stopped spark web ui @ http://192.168.1.88:4041
sparkui stops fast me review program does. there way review sparkui particular program after it's stopped? or can find kind of log created after running program?
after setting "spark.eventlog.enabled" true , "spark.eventlog.dir" local folder, able produce unix executable files(local-1445955378567). however, details of log not expected. how add sparklistener??
you need either keep ui alive (by keeping context alive) or start history server since ui tied context. http://spark.apache.org/docs/latest/monitoring.html
Comments
Post a Comment