File:Kafka Batch processing.jpg
Jump to navigation
Jump to search
Size of this preview: 800 × 534 pixels. Other resolutions: 320 × 214 pixels | 640 × 427 pixels | 1,024 × 684 pixels | 1,195 × 798 pixels.
Original file (1,195 × 798 pixels, file size: 76 KB, MIME type: image/jpeg)
Captions
Captions
Real time Batch Processing using Kafka and Spark Streaming from https://sparkdatabox.com
Summary
[edit]
| Description |
English: This file represents the architecture diagram of how you can do a realtime project using, Hive, Spark and Kafka. Data is pulled from MySQL database using Scoop and stored into HDFS file system. Using Spark and Kafka the data is further streamed into Hive. |
| Date | |
| Source | Own work |
| Author | SparkDatabox |
Licensing
[edit]
I, the copyright holder of this work, hereby publish it under the following license:
This file is licensed under the Creative Commons Attribution-Share Alike 4.0 International license.
- You are free:
- to share – to copy, distribute and transmit the work
- to remix – to adapt the work
- Under the following conditions:
- attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- share alike – If you remix, transform, or build upon the material, you must distribute your contributions under the same or compatible license as the original.
File history
Click on a date/time to view the file as it appeared at that time.
| Date/Time | Thumbnail | Dimensions | User | Comment | |
|---|---|---|---|---|---|
| current | 23:31, 18 March 2020 | | 1,195 × 798 (76 KB) | SparkDatabox (talk | contribs) | Uploaded own work with UploadWizard |
You cannot overwrite this file.
File usage on Commons
There are no pages that use this file.
