2016-04-12 14:41:20,040 WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2016-04-12 14:41:21,974 INFO org.apache.flink.runtime.jobmanager.JobManager - -------------------------------------------------------------------------------- 2016-04-12 14:41:21,974 INFO org.apache.flink.runtime.jobmanager.JobManager - Starting JobManager (Version: 1.0.1, Rev:4afa401, Date:31.03.2016 @ 13:40:33 UTC) 2016-04-12 14:41:21,974 INFO org.apache.flink.runtime.jobmanager.JobManager - Current user: vishal 2016-04-12 14:41:21,974 INFO org.apache.flink.runtime.jobmanager.JobManager - JVM: OpenJDK 64-Bit Server VM - Oracle Corporation - 1.7/24.91-b01 2016-04-12 14:41:21,975 INFO org.apache.flink.runtime.jobmanager.JobManager - Maximum heap size: 742 MiBytes 2016-04-12 14:41:21,975 INFO org.apache.flink.runtime.jobmanager.JobManager - JAVA_HOME: /usr/lib/jvm/java-7-openjdk-amd64 2016-04-12 14:41:22,063 INFO org.apache.flink.runtime.jobmanager.JobManager - Hadoop version: 2.6.3 2016-04-12 14:41:22,063 INFO org.apache.flink.runtime.jobmanager.JobManager - JVM Options: 2016-04-12 14:41:22,063 INFO org.apache.flink.runtime.jobmanager.JobManager - -Xms768m 2016-04-12 14:41:22,063 INFO org.apache.flink.runtime.jobmanager.JobManager - -Xmx768m 2016-04-12 14:41:22,064 INFO org.apache.flink.runtime.jobmanager.JobManager - -XX:MaxPermSize=256m 2016-04-12 14:41:22,064 INFO org.apache.flink.runtime.jobmanager.JobManager - -Dlog.file=/home/vishal/flink-1.0.1/log/flink-vishal-jobmanager-0-localvm.log 2016-04-12 14:41:22,064 INFO org.apache.flink.runtime.jobmanager.JobManager - -Dlog4j.configuration=file:/home/vishal/flink-1.0.1/conf/log4j.properties 2016-04-12 14:41:22,064 INFO org.apache.flink.runtime.jobmanager.JobManager - -Dlogback.configurationFile=file:/home/vishal/flink-1.0.1/conf/logback.xml 2016-04-12 14:41:22,064 INFO org.apache.flink.runtime.jobmanager.JobManager - Program Arguments: 2016-04-12 14:41:22,064 INFO org.apache.flink.runtime.jobmanager.JobManager - --configDir 2016-04-12 14:41:22,064 INFO org.apache.flink.runtime.jobmanager.JobManager - /home/vishal/flink-1.0.1/conf 2016-04-12 14:41:22,064 INFO org.apache.flink.runtime.jobmanager.JobManager - --executionMode 2016-04-12 14:41:22,064 INFO org.apache.flink.runtime.jobmanager.JobManager - local 2016-04-12 14:41:22,064 INFO org.apache.flink.runtime.jobmanager.JobManager - Classpath: /home/vishal/flink-1.0.1/lib/flink-dist_2.10-1.0.1.jar:/home/vishal/flink-1.0.1/lib/flink-python_2.10-1.0.1.jar:/home/vishal/flink-1.0.1/lib/log4j-1.2.17.jar:/home/vishal/flink-1.0.1/lib/slf4j-log4j12-1.7.7.jar::: 2016-04-12 14:41:22,064 INFO org.apache.flink.runtime.jobmanager.JobManager - -------------------------------------------------------------------------------- 2016-04-12 14:41:22,075 INFO org.apache.flink.runtime.jobmanager.JobManager - Registered UNIX signal handlers for [TERM, HUP, INT] 2016-04-12 14:41:23,390 INFO org.apache.flink.runtime.jobmanager.JobManager - Loading configuration from /home/vishal/flink-1.0.1/conf 2016-04-12 14:41:23,551 INFO org.apache.flink.runtime.jobmanager.JobManager - Starting JobManager without high-availability 2016-04-12 14:41:23,586 INFO org.apache.flink.runtime.jobmanager.JobManager - Starting JobManager on 127.0.0.1:6123 with execution mode LOCAL 2016-04-12 14:41:24,120 INFO org.apache.flink.runtime.jobmanager.JobManager - Security is not enabled. Starting non-authenticated JobManager. 2016-04-12 14:41:24,152 INFO org.apache.flink.runtime.jobmanager.JobManager - Starting JobManager 2016-04-12 14:41:24,159 INFO org.apache.flink.runtime.jobmanager.JobManager - Starting JobManager actor system at 127.0.0.1:6123 2016-04-12 14:41:28,557 INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started 2016-04-12 14:41:29,091 INFO Remoting - Starting remoting 2016-04-12 14:41:30,317 INFO Remoting - Remoting started; listening on addresses :[akka.tcp://flink@127.0.0.1:6123] 2016-04-12 14:41:30,348 INFO org.apache.flink.runtime.jobmanager.JobManager - Starting JobManger web frontend 2016-04-12 14:41:30,850 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils - Determined location of JobManager log file: /home/vishal/flink-1.0.1/log/flink-vishal-jobmanager-0-localvm.log 2016-04-12 14:41:30,850 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils - Determined location of JobManager stdout file: /home/vishal/flink-1.0.1/log/flink-vishal-jobmanager-0-localvm.out 2016-04-12 14:41:30,874 INFO org.apache.flink.runtime.webmonitor.WebRuntimeMonitor - Using directory /tmp/flink-web-ec59b34d-9fde-46b0-a74e-68f731d2249e for the web interface files 2016-04-12 14:41:30,875 INFO org.apache.flink.runtime.webmonitor.WebRuntimeMonitor - Using directory /tmp/flink-web-upload-9d1050dc-00d5-4413-bdc5-87c176baa196 for web frontend JAR file uploads 2016-04-12 14:41:34,727 INFO org.apache.flink.runtime.webmonitor.WebRuntimeMonitor - Web frontend listening at 0:0:0:0:0:0:0:0:8081 2016-04-12 14:41:34,728 INFO org.apache.flink.runtime.jobmanager.JobManager - Starting JobManager actor 2016-04-12 14:41:34,778 INFO org.apache.flink.runtime.blob.BlobServer - Created BLOB server storage directory /tmp/blobStore-c5ac0472-47e1-45e0-a327-55600d546642 2016-04-12 14:41:34,809 INFO org.apache.flink.runtime.blob.BlobServer - Started BLOB server at 0.0.0.0:58954 - max concurrent requests: 50 - max backlog: 1000 2016-04-12 14:41:34,928 INFO org.apache.flink.runtime.checkpoint.SavepointStoreFactory - Using job manager savepoint state backend. 2016-04-12 14:41:35,280 INFO org.apache.flink.runtime.jobmanager.MemoryArchivist - Started memory archivist akka://flink/user/archive 2016-04-12 14:41:35,282 INFO org.apache.flink.runtime.jobmanager.JobManager - Starting embedded TaskManager for JobManager's LOCAL execution mode 2016-04-12 14:41:35,287 INFO org.apache.flink.runtime.jobmanager.JobManager - Starting JobManager at akka.tcp://flink@127.0.0.1:6123/user/jobmanager. 2016-04-12 14:41:35,512 INFO org.apache.flink.runtime.jobmanager.JobManager - JobManager akka.tcp://flink@127.0.0.1:6123/user/jobmanager was granted leadership with leader session ID None. 2016-04-12 14:41:35,597 INFO org.apache.flink.runtime.taskmanager.TaskManager - Messages between TaskManager and JobManager have a max timeout of 10000 milliseconds 2016-04-12 14:41:35,607 INFO org.apache.flink.runtime.taskmanager.TaskManager - Temporary file directory '/tmp': total 6 GB, usable 1 GB (16.67% usable) 2016-04-12 14:41:35,879 INFO org.apache.flink.runtime.io.network.buffer.NetworkBufferPool - Allocated 64 MB for network buffer pool (number of memory segments: 2048, bytes per segment: 32768). 2016-04-12 14:41:36,361 INFO org.apache.flink.runtime.taskmanager.TaskManager - Limiting managed memory to 0.7 of the currently free heap space (460 MB), memory will be allocated lazily. 2016-04-12 14:41:36,365 INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager uses directory /tmp/flink-io-805c0485-ff6a-46d6-b47c-8abfb811d19f for spill files. 2016-04-12 14:41:36,421 INFO org.apache.flink.runtime.filecache.FileCache - User file cache uses directory /tmp/flink-dist-cache-451d92ce-a0b5-4573-9a12-9a113d0148ae 2016-04-12 14:41:36,437 INFO org.apache.flink.runtime.webmonitor.WebRuntimeMonitor - Starting with JobManager akka.tcp://flink@127.0.0.1:6123/user/jobmanager on port 8081 2016-04-12 14:41:36,437 INFO org.apache.flink.runtime.webmonitor.JobManagerRetriever - New leader reachable under akka.tcp://flink@127.0.0.1:6123/user/jobmanager:null. 2016-04-12 14:41:40,083 INFO org.apache.flink.runtime.taskmanager.TaskManager - Starting TaskManager actor at akka://flink/user/taskmanager#-1324116371. 2016-04-12 14:41:40,104 INFO org.apache.flink.runtime.taskmanager.TaskManager - TaskManager data connection information: localhost (dataPort=41883) 2016-04-12 14:41:40,104 INFO org.apache.flink.runtime.taskmanager.TaskManager - TaskManager has 1 task slot(s). 2016-04-12 14:41:40,111 INFO org.apache.flink.runtime.taskmanager.TaskManager - Memory usage stats: [HEAP: 107/742/742 MB, NON HEAP: 31/33/304 MB (used/committed/max)] 2016-04-12 14:41:40,134 INFO org.apache.flink.runtime.taskmanager.TaskManager - Trying to register at JobManager akka.tcp://flink@127.0.0.1:6123/user/jobmanager (attempt 1, timeout: 500 milliseconds) 2016-04-12 14:41:40,161 INFO org.apache.flink.runtime.instance.InstanceManager - Registered TaskManager at localhost (akka://flink/user/taskmanager) as d3b193a5aa74875b5bb27ea606e153d9. Current number of registered hosts is 1. Current number of alive task slots is 1. 2016-04-12 14:41:40,174 INFO org.apache.flink.runtime.taskmanager.TaskManager - Successful registration at JobManager (akka://flink/user/jobmanager), starting network stack and library cache. 2016-04-12 14:41:40,278 INFO org.apache.flink.runtime.taskmanager.TaskManager - Determined BLOB server address to be localhost/127.0.0.1:58954. Starting BLOB cache. 2016-04-12 14:41:40,286 INFO org.apache.flink.runtime.blob.BlobCache - Created BLOB cache storage directory /tmp/blobStore-b279789e-9bfd-4ca6-8d09-9be0443a1722 2016-04-12 14:42:09,708 INFO org.apache.flink.api.java.ExecutionEnvironment - The job has 0 registered types and 0 default Kryo serializers 2016-04-12 14:42:25,445 INFO org.apache.flink.api.java.ExecutionEnvironment - The job has 0 registered types and 0 default Kryo serializers 2016-04-12 14:42:26,622 INFO org.apache.flink.runtime.jobmanager.JobManager - Submitting job 29da8bd26da260af9632a1df6d571fa8 (Flink Java Job at Tue Apr 12 14:42:25 IST 2016). 2016-04-12 14:42:26,623 INFO org.apache.flink.runtime.jobmanager.JobManager - Using restart strategy NoRestartStrategy for 29da8bd26da260af9632a1df6d571fa8. 2016-04-12 14:42:26,767 INFO org.apache.flink.runtime.jobmanager.JobManager - Scheduling job 29da8bd26da260af9632a1df6d571fa8 (Flink Java Job at Tue Apr 12 14:42:25 IST 2016). 2016-04-12 14:42:26,768 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN DataSource (at wikiedits.Test4$.main(Test4.scala:20) (org.apache.flink.api.java.io.CollectionInputFormat)) -> Reduce (Reduce at wikiedits.Test4$.main(Test4.scala:21)) (1/1) (68eb6c69d6f6626225f79592df801498) switched from CREATED to SCHEDULED 2016-04-12 14:42:26,811 INFO org.apache.flink.runtime.jobmanager.JobManager - Status of job 29da8bd26da260af9632a1df6d571fa8 (Flink Java Job at Tue Apr 12 14:42:25 IST 2016) changed to RUNNING. 2016-04-12 14:42:26,842 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN DataSource (at wikiedits.Test4$.main(Test4.scala:20) (org.apache.flink.api.java.io.CollectionInputFormat)) -> Reduce (Reduce at wikiedits.Test4$.main(Test4.scala:21)) (1/1) (68eb6c69d6f6626225f79592df801498) switched from SCHEDULED to DEPLOYING 2016-04-12 14:42:26,843 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying CHAIN DataSource (at wikiedits.Test4$.main(Test4.scala:20) (org.apache.flink.api.java.io.CollectionInputFormat)) -> Reduce (Reduce at wikiedits.Test4$.main(Test4.scala:21)) (1/1) (attempt #0) to localhost 2016-04-12 14:42:26,969 INFO org.apache.flink.runtime.taskmanager.TaskManager - Received task CHAIN DataSource (at wikiedits.Test4$.main(Test4.scala:20) (org.apache.flink.api.java.io.CollectionInputFormat)) -> Reduce (Reduce at wikiedits.Test4$.main(Test4.scala:21)) (1/1) 2016-04-12 14:42:26,997 INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task CHAIN DataSource (at wikiedits.Test4$.main(Test4.scala:20) (org.apache.flink.api.java.io.CollectionInputFormat)) -> Reduce (Reduce at wikiedits.Test4$.main(Test4.scala:21)) (1/1) 2016-04-12 14:42:27,008 INFO org.apache.flink.runtime.blob.BlobCache - Downloading f48606a3adabec97fccaaf15367da8670c1dde98 from localhost/127.0.0.1:58954 2016-04-12 14:42:27,337 INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: CHAIN DataSource (at wikiedits.Test4$.main(Test4.scala:20) (org.apache.flink.api.java.io.CollectionInputFormat)) -> Reduce (Reduce at wikiedits.Test4$.main(Test4.scala:21)) (1/1) [DEPLOYING] 2016-04-12 14:42:27,342 INFO org.apache.flink.runtime.taskmanager.Task - CHAIN DataSource (at wikiedits.Test4$.main(Test4.scala:20) (org.apache.flink.api.java.io.CollectionInputFormat)) -> Reduce (Reduce at wikiedits.Test4$.main(Test4.scala:21)) (1/1) switched to RUNNING 2016-04-12 14:42:27,365 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN DataSource (at wikiedits.Test4$.main(Test4.scala:20) (org.apache.flink.api.java.io.CollectionInputFormat)) -> Reduce (Reduce at wikiedits.Test4$.main(Test4.scala:21)) (1/1) (68eb6c69d6f6626225f79592df801498) switched from DEPLOYING to RUNNING 2016-04-12 14:42:27,412 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (org.apache.flink.api.java.Utils$CollectHelper@280a4782) (1/1) (5fbcfd5802df2ad8296475a7e37f7c20) switched from CREATED to SCHEDULED 2016-04-12 14:42:27,416 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (org.apache.flink.api.java.Utils$CollectHelper@280a4782) (1/1) (5fbcfd5802df2ad8296475a7e37f7c20) switched from SCHEDULED to DEPLOYING 2016-04-12 14:42:27,416 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSink (org.apache.flink.api.java.Utils$CollectHelper@280a4782) (1/1) (attempt #0) to localhost 2016-04-12 14:42:27,433 INFO org.apache.flink.runtime.taskmanager.TaskManager - Received task DataSink (org.apache.flink.api.java.Utils$CollectHelper@280a4782) (1/1) 2016-04-12 14:42:27,442 INFO org.apache.flink.runtime.taskmanager.Task - CHAIN DataSource (at wikiedits.Test4$.main(Test4.scala:20) (org.apache.flink.api.java.io.CollectionInputFormat)) -> Reduce (Reduce at wikiedits.Test4$.main(Test4.scala:21)) (1/1) switched to FINISHED 2016-04-12 14:42:27,443 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for CHAIN DataSource (at wikiedits.Test4$.main(Test4.scala:20) (org.apache.flink.api.java.io.CollectionInputFormat)) -> Reduce (Reduce at wikiedits.Test4$.main(Test4.scala:21)) (1/1) 2016-04-12 14:42:27,444 INFO org.apache.flink.runtime.taskmanager.TaskManager - Un-registering task and sending final execution state FINISHED to JobManager for task CHAIN DataSource (at wikiedits.Test4$.main(Test4.scala:20) (org.apache.flink.api.java.io.CollectionInputFormat)) -> Reduce (Reduce at wikiedits.Test4$.main(Test4.scala:21)) (68eb6c69d6f6626225f79592df801498) 2016-04-12 14:42:27,449 INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task DataSink (org.apache.flink.api.java.Utils$CollectHelper@280a4782) (1/1) 2016-04-12 14:42:27,461 INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: DataSink (org.apache.flink.api.java.Utils$CollectHelper@280a4782) (1/1) [DEPLOYING] 2016-04-12 14:42:27,463 INFO org.apache.flink.runtime.taskmanager.Task - DataSink (org.apache.flink.api.java.Utils$CollectHelper@280a4782) (1/1) switched to RUNNING 2016-04-12 14:42:27,465 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (org.apache.flink.api.java.Utils$CollectHelper@280a4782) (1/1) (5fbcfd5802df2ad8296475a7e37f7c20) switched from DEPLOYING to RUNNING 2016-04-12 14:42:27,481 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN DataSource (at wikiedits.Test4$.main(Test4.scala:20) (org.apache.flink.api.java.io.CollectionInputFormat)) -> Reduce (Reduce at wikiedits.Test4$.main(Test4.scala:21)) (1/1) (68eb6c69d6f6626225f79592df801498) switched from RUNNING to FINISHED 2016-04-12 14:42:27,506 INFO org.apache.flink.runtime.taskmanager.Task - DataSink (org.apache.flink.api.java.Utils$CollectHelper@280a4782) (1/1) switched to FINISHED 2016-04-12 14:42:27,506 INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for DataSink (org.apache.flink.api.java.Utils$CollectHelper@280a4782) (1/1) 2016-04-12 14:42:27,507 INFO org.apache.flink.runtime.taskmanager.TaskManager - Un-registering task and sending final execution state FINISHED to JobManager for task DataSink (org.apache.flink.api.java.Utils$CollectHelper@280a4782) (5fbcfd5802df2ad8296475a7e37f7c20) 2016-04-12 14:42:27,514 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSink (org.apache.flink.api.java.Utils$CollectHelper@280a4782) (1/1) (5fbcfd5802df2ad8296475a7e37f7c20) switched from RUNNING to FINISHED 2016-04-12 14:42:27,518 INFO org.apache.flink.runtime.jobmanager.JobManager - Status of job 29da8bd26da260af9632a1df6d571fa8 (Flink Java Job at Tue Apr 12 14:42:25 IST 2016) changed to FINISHED.