Compiling error when running stream word count in the flink-streaming-scala_2.11 module

Compiling error when running stream word count in the flink-streaming-scala_2.11 module



I git clone the Flink project from git with Intellij Idea.



I am able to run the batch work count org.apache.flink.examples.scala.wordcount.WordCount in the module flink-examples-batch_2.11 successfully.


org.apache.flink.examples.scala.wordcount.WordCount


flink-examples-batch_2.11



But when I try to run the stream word count org.apache.flink.streaming.scala.examples.wordcount.WordCount in the module flink-examples-streaming_2.11, A couple of compiling errors occur:


org.apache.flink.streaming.scala.examples.wordcount.WordCount


flink-examples-streaming_2.11


D:projectsBigData_Projectsflinkflink-streaming-scalasrctestscalaorgapacheflinkstreamingapiscalaSideOutputITCase.scala
Error:(30, 30) object streaming is not a member of package org.apache.flink.test
import org.apache.flink.test.streaming.runtime.util.TestListResultSink
Error:(46, 36) not found: type TestListResultSink
val sideOutputResultSink = new TestListResultSink[String]
Error:(47, 26) not found: type TestListResultSink
val resultSink = new TestListResultSink[Int]
Error:(82, 36) not found: type TestListResultSink
val sideOutputResultSink = new TestListResultSink[String]
Error:(83, 26) not found: type TestListResultSink
val resultSink = new TestListResultSink[Int]
Error:(119, 36) not found: type TestListResultSink
val sideOutputResultSink = new TestListResultSink[String]
Error:(120, 26) not found: type TestListResultSink
val resultSink = new TestListResultSink[Int]
Error:(152, 26) not found: type TestListResultSink
val resultSink = new TestListResultSink[String]
Error:(153, 30) not found: type TestListResultSink
val lateResultSink = new TestListResultSink[(String, Int)]
Error:(196, 26) not found: type TestListResultSink
val resultSink = new TestListResultSink[String]
Error:(197, 30) not found: type TestListResultSink
val lateResultSink = new TestListResultSink[(String, Int)]
Error:(242, 26) not found: type TestListResultSink
val resultSink = new TestListResultSink[String]
Error:(243, 36) not found: type TestListResultSink
val sideOutputResultSink = new TestListResultSink[String]
Error:(289, 26) not found: type TestListResultSink
val resultSink = new TestListResultSink[String]
Error:(290, 36) not found: type TestListResultSink
val sideOutputResultSink = new TestListResultSink[String]
D:projectsBigData_Projectsflinkflink-streaming-scalasrctestscalaorgapacheflinkstreamingapiscalaStreamingScalaAPICompletenessTest.scala
Error:(22, 35) object completeness is not a member of package org.apache.flink.api.scala
import org.apache.flink.api.scala.completeness.ScalaAPICompletenessTestBase
Error:(32, 49) not found: type ScalaAPICompletenessTestBase
class StreamingScalaAPICompletenessTest extends ScalaAPICompletenessTestBase {
Error:(101, 5) not found: value checkMethods
checkMethods("DataStream", "DataStream", classOf[JavaStream[_]], classOf[DataStream[_]])
Error:(103, 5) not found: value checkMethods
checkMethods(
Error:(108, 5) not found: value checkMethods
checkMethods(
Error:(113, 5) not found: value checkMethods
checkMethods(
Error:(118, 5) not found: value checkMethods
checkMethods(
Error:(123, 5) not found: value checkMethods
checkMethods(
Error:(128, 5) not found: value checkMethods
checkMethods(
Error:(133, 5) not found: value checkMethods
checkMethods(
Error:(138, 5) not found: value checkMethods
checkMethods(
Error:(143, 5) not found: value checkMethods
checkMethods(



I am not sure what's wrong there, could some one help? Thanks





Can you clarify which version of Flink you are using, and how you tried to run the streaming word count example?
– David Anderson
Aug 22 at 16:21





Thanks @DavidAnderson for the reply. I git clone the latest code from github(the master branch) ,and open it with Intellij Idea as a Maven project, and then run it directly in Intellij Idea. I am able to run the batch mode word count: I am able to run the batch work count org.apache.flink.examples.scala.wordcount.WordCount in the module flink-examples-batch_2.11 successfully.
– Tom
Aug 22 at 22:52


I am able to run the batch work count org.apache.flink.examples.scala.wordcount.WordCount in the module flink-examples-batch_2.11 successfully.









By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

-

Popular posts from this blog

Help:Category

Image
Help:Category From Wikipedia, the free encyclopedia Jump to navigation Jump to search For guidelines on the use of categories in Wikipedia, see Wikipedia:Categorization. For a basic readers' guide see Help:Categories. For quick answers, see the readers' FAQ or the editors' FAQ on categories. For a list of categories, see Special:Categories. This is an information page. It describes the editing community's established practice on some aspect or aspects of Wikipedia's norms and customs. It is not one of Wikipedia's policies or guidelines, as it has not been thoroughly vetted by the community. Shortcut H:CAT Wikipedia data structure Namespaces Subject namespaces Talk namespaces 0 (Main/Article) Talk 1 2 User User talk 3 4 Wikipedia Wikipedia talk 5 6 File File talk 7 8 MediaWiki MediaWiki talk 9 10 Template Template talk 11 12 Help Help talk 13 14 Category Category talk 15 100 Portal Portal talk 101 108 Book Book tal...
Read more

How can temperature be calculated given relative humidity and dew point?

Image
How can temperature be calculated given relative humidity and dew point? While looking into the better indicator of how miserable it feels outside, either dew point or relative humidity, I came across this statement: The optimum combination for human comfort is a dewpoint of about 60 F and a RH of between 50 and 70% (this would put the temperature at about 75 F). Source: http://www.theweatherprediction.com/habyhints/190/ This led me to this calculator that will calculate the temperature given relative humidity and dew point - for example a dew point of 70 degrees F and a relative humidity of 90% results in a temperature of 73.11 degrees F. The web site for this calculator says the values are based on the August-Roche-Magnus approximation and gives the following equation to calculate temperature: $T =243.04 Large fracfrac17.625 TD243.04+TD-lnleft(fracRH100right)17.625+lnleft(fracRH100right)- frac17.625 TD243.04+TD$ Given the equation I'm still having a hard time figuring out...
Read more

I have a recursive function to validate tree graph and need a return condition

Image
I have a recursive function to validate tree graph and need a return condition I have a tree graph. Each node has attribute 'amount'. The rule governing the attribute value of root is this, The root 'amount' value is the sum of the 'amount' attribute of each of it's children. This continues to the last node with children. In other words this tree's attributes are unlike a sum tree, because the root node is not the sum of each node in the tree. Here is a toy example as graph G: nodedict = 'apples': 'amount': 5.0, 'bananas': 'amount': 10.0, 'tomato': 'amount': 50.0, 'total_fruits': 'amount': 15.0, 'total_vegetables': 'amount': 9.0, 'carrot': 'amount': 3.0, 'squash': 'amount': 6.0, 'total_fruits_and_vegetables': 'amount': 74.0 edgelist = [('total_fruits', 'apples'), ('total_fruits', 'bananas...
Read more