The Spark SQL engine will take care of running it incrementally and continuously and updating the final result as streaming data continues to arrive. You can express your streaming computation the same way you would express a batch computation on static data. Structured Streaming is a scalable and fault-tolerant stream processing engine built on the Spark SQL engine. Recovery Semantics after Changes in a Streaming Query.Recovering from Failures with Checkpointing.Reporting Metrics programmatically using Asynchronous APIs.Policy for handling multiple watermarks.Support matrix for joins in streaming queries.Basic Operations - Selection, Projection, Aggregation.Operations on streaming DataFrames/Datasets.
0 kommentar(er)
