Prerequisite – Types of Operating Systems
1. Batch Processing :
Batch processing refers to processing of high volume of data in batch within a specific time span. It processes large volume of data all at once. Batch processing is used when data size is known and finite. It takes little longer time to processes data. It requires dedicated staffs to handle issues. Batch processor processes processes data in multiple passes. When data is collected overtime and similar data batched/grouped together then in that case batch processing is used.
Challenges with Batch processing :
- Debugging of these system is difficult as it requires dedicated professional to fix the error.
- Software and training requires high expenses initially just to understand batch scheduling, triggering, notification etc.
2. Stream Processing :
Stream processing refers to processing of continuous stream of data immediately as it is produced. It analyzes streaming data in real time. Stream processing is used when the data size is unknown and infinite and continuous. It takes few seconds or milliseconds to process data. In stream processing data output rate is as fast as data input rate. Stream processor processes data in few passes. When data stream is continuous and requires immediate response then in that case stream processing is used.
Challenges with Stream processing :
- Data input rate and output rate sometimes creates a problem.
- Cope with huge amount of data and immediate response.
Difference between Batch Processing and Stream processing :
|S.No.||BATCH PROCESSING||STREAM PROCESSING|
|01.||Batch processing refers to processing of high volume of data in batch within a specific time span.||Stream processing refers to processing of continuous stream of data immediately as it is produced.|
|02.||Batch processing processes large volume of data all at once.||Stream processing analyzes streaming data in real time.|
|04.||In Batch processing data size is known and finite.||In Stream processing data size is unknown and infinite in advance.|
|05.||In Batch processing the data is processes in multiple passes.||In stream processing generally data is processed in few passes.|
|06.||Batch processor takes longer time to processes data.||Stream processor takes few seconds or milliseconds to process data.|
|07.||In batch processing the input graph is static.||In stream processing the input graph is dynamic.|
|08.||In this processing the data is analyzed on a snapshot.||In this processing the data is analyzed on continuous.|
|09.||In batch processing the response is provided after job completion.||In stream processing the response is provided immediately.|
|10.||Examples are distributed programming platforms like MapReduce, Spark, GraphX etc.||Examples are programming platforms like spark streaming and S4 (Simple Scalable Streaming System) etc.|
|11.||Batch processing is used in payroll and billing system, food processing system etc.||Stream processing is used in stock market, e-commerce transactions, social media etc.|
Attention reader! Don’t stop learning now. Get hold of all the important CS Theory concepts for SDE interviews with the CS Theory Course at a student-friendly price and become industry ready.
- Difference between Batch Processing and Real Time Processing System
- Difference between Batch Processing System and Online Processing System
- Difference between Traditional Processing and Stream Processing
- Difference between Batch Processing OS and Multiprogramming OS
- Difference between Batch Gradient Descent and Stochastic Gradient Descent
- foreach() loop vs Stream foreach() vs Parallel Stream foreach()
- Difference between Opening and Closing in Digital Image Processing
- Difference between Digital Light Processing (DLP) and Liquid Crystal Display (LCD) Projector
- Difference between Image Processing and Computer Vision
- Difference between Data Warehousing and Online transaction processing (OLTP)
- Difference between Text Mining and Natural Language Processing
- Difference between Data Cleaning and Data Processing
- Difference between Block Cipher and Stream Cipher
- What is SMP (Symmetric Multi-Processing)?
- Multistep Processing of a User Program
- Parallel vs Sequential Stream in Java
- Difference between Stop and Wait, GoBackN and Selective Repeat
- Difference between Stop and Wait protocol and Sliding Window protocol
- Similarities and Difference between Java and C++
- Difference between Yaacomo and and XAP
If you like GeeksforGeeks and would like to contribute, you can also write an article using contribute.geeksforgeeks.org or mail your article to email@example.com. See your article appearing on the GeeksforGeeks main page and help other Geeks.
Please Improve this article if you find anything incorrect by clicking on the "Improve Article" button below.