Mẹo nhỏ: Để tìm kiếm chính xác các bài viết của Mapleshoes.vn, hãy search trên Google với cú pháp: "Từ khóa" + "Mapleshoes". (Ví dụ: cách chơi fifa online mapleshoes). Tìm kiếm ngay
51 lượt xem

Chế độ manager 2.0

This document gives a short overview of how noithatvietphat.vn runs on clusters, to make it easier to understandthe components involved. Read through the application submission guideto learn about launching applications on a cluster.

Bạn đang xem: Chế độ manager 2.0


noithatvietphat.vn applications run as independent sets of processes on a cluster, coordinated by the noithatvietphat.vnContextobject in your main program (called the driver program).

Specifically, to run on a cluster, the noithatvietphat.vnContext can connect to several types of cluster managers(either noithatvietphat.vn’s own standalone cluster manager, Mesos or YARN), which allocate resources acrossapplications. Once connected, noithatvietphat.vn acquires executors on nodes in the cluster, which areprocesses that run computations and store data for your application.Next, it sends your application code (defined by JAR or Python files passed to noithatvietphat.vnContext) tothe executors. Finally, noithatvietphat.vnContext sends tasks to the executors to run.

There are several useful things to note about this architecture:

Each application gets its own executor processes, which stay up for the duration of the wholeapplication and run tasks in multiple threads. This has the benefit of isolating applicationsfrom each other, on both the scheduling side (each driver schedules its own tasks) and executorside (tasks from different applications run in different JVMs). However, it also means thatdata cannot be shared across different noithatvietphat.vn applications (instances of noithatvietphat.vnContext) withoutwriting it to an external storage system. noithatvietphat.vn is agnostic to the underlying cluster manager. As long as it can acquire executorprocesses, and these communicate with each other, it is relatively easy to run it even on acluster manager that also supports other applications (e.g. Mesos/YARN). Because the driver schedules tasks on the cluster, it should be run close to the workernodes, preferably on the same local area network. If you’d like to send requests to thecluster remotely, it’s better to open an RPC to the driver and have it submit operationsfrom nearby than to run a driver far away from the worker nodes.Cluster Manager Types

Xem Thêm:  Cách nấu canh rau ngót với thịt

The system currently supports several cluster managers:

A third-party project (not supported by the noithatvietphat.vn project) exists to add support forNomad as a cluster manager.

Xem thêm: https://vonggosua.com.vn/cach-choi-leblanc-mua-11-tu-a/

Submitting Applications

Applications can be submitted to a cluster of any type using the noithatvietphat.vn-submit script.The application submission guide describes how to do this.

MonitoringJob Scheduling

noithatvietphat.vn gives control over resource allocation both across applications (at the level of the clustermanager) and within applications (if multiple computations are happening on the same noithatvietphat.vnContext).The job scheduling overview describes this in more detail.


The following table summarizes terms you’ll see used to refer to cluster concepts:

Chuyên mục: chia sẻ

Thông báo chính thức: Vonggosua.com.vn thuộc Mapleshoes.vn (Mapleshoes) là trang duy nhất chia sẻ bài viết hay Facebook.

Xin cám ơn!

Trả lời

Email của bạn sẽ không được hiển thị công khai. Các trường bắt buộc được đánh dấu *