Pre-requisite:- GCP
To create and run a Virtual Machine in the Google Cloud Platform, one needs Compute Services to perform certain operations. Google Cloud Platform’s Compute Engine provides a variety of computing options according to users’ needs. Some of them are discussed below along with their use cases:
Cloud Dataproc:
- Cloud Dataproc is a managed Apache Hadoop-based data processing service, which is an ideal solution for Big Data analytics.
- Cloud Dataproc can process and analyze Apache Hadoop-based workloads using clusters of virtual machines.
Cloud Functions:
- The Google Cloud Platform offers fully managed code execution environments called “Cloud Functions” that developers can use to build event-driven applications in the cloud without having to manage infrastructure or write boilerplate code.
- With just a few lines of JavaScript, you can write small pieces of code that respond to events and do things like send an SMS notification, execute a database query, or generate thumbnails from uploaded images.
Cloud Storage API:
- The Google Cloud Storage API is a RESTful API that allows developers and partners to store and retrieve data on the Google Cloud Platform.
Cloud Pub/Sub:
- The Cloud Pub/Sub API is a publish/subscribe messaging system that enables developers to build a global and distributed real-time messaging application in the cloud.
- This API provides a simple, stateless, and scalable model for building applications that need to send real-time messages or updates.
- It allows you to subscribe (create topics) as well as “publish” messages (create topics) on these topics.
- The message payloads are decoded from JSON records, then serialized into JSON format for storage and delivery via an HTTP request.
Cloud Bigtable:
- The Google Cloud Bigtable API provides programmatic access to Google’s global, distributed, persistent multi-model database.
- This API allows you to read and write data in Cloud Bigtable, create and run administrative and user-defined actions on the tables, as well as delete data from the tables.
Cloud Spanner:
- The Cloud Spanner API allows developers to access the Cloud Spanner-managed database service using RESTful calls.
- A globally distributed database for horizontal scaling of SQL queries is readily available for applications that need a relational database and high availability without having to manage any infrastructure or be an expert in SQL.
Cloud Dataflow:
- The Cloud Dataflow API is a fully managed service for data processing pipelines, including both batch and streaming data.
- Apps that process large amounts of data can run as reliably and efficiently as those processing small amounts of data, thanks to the scalability and high availability provided by Google infrastructure.
Cloud Tasks:
- The Cloud Tasks API is a fully managed task execution service for developers who want their applications to respond quickly to user interactions by executing lightweight code in the cloud.
- Developers can use this API to run tasks on-demand or schedule them to run at specific times or dates.
Cloud Pub/Sub:
- The Cloud Pub/Sub API is a publish/subscribe messaging system that enables developers to build a global and distributed real-time messaging application in the cloud. This API provides a simple, stateless, and scalable model for building applications that need to send real-time messages or updates. It allows you to subscribe (create topics) as well as “publish” messages (create topics) on these topics.
- The message payloads are decoded from JSON records, then serialized into JSON format for storage and delivery via an HTTP request.
Cloud Storage:
- The Google Cloud Storage APIs provide programmatic access to Google’s globally distributed object storage service. Using the APIs, developers can store and retrieve objects from Google Cloud Storage buckets, as well as query metadata about those objects.
- It is a highly available and scalable service that stores object data in a bucket, defined by the app developer.
Cloud Datastore:
- The Google Cloud Datastore API is a managed NoSQL database service that provides global, distributed storage for your application’s data.
- The API includes full CRUD support for Entities, and supports indexing and searching over your Entities using built-in indexes.
- The API supports multiple language bindings including Java, PHP, Python, and Ruby.