Hadoop RPC 源码领略

栏目: 编程工具 · 发布时间: 7年前

内容简介:In distributed computing, a当主机不可达时,通过远程调用可以使得终端操作目标机器成为可能底层的网络通信细节封装入 API,方便网络分布式系统的开发

In distributed computing, a remote procedure call ( RPC ) is when a computer program causes a procedure (subroutine) to execute in a different address space (commonly on another computer on a shared network), which is coded as if it were a normal (local) procedure call, without the programmer explicitly coding the details for the remote interaction. That is, the programmer writes essentially the same code whether the subroutine is local to the executing program, or remote. This is a form of client–server interaction (caller is client, executor is server), typically implemented via a request–response message-passing system.

为什么要有 RPC?

地域性

当主机不可达时,通过远程调用可以使得终端操作目标机器成为可能

含糖性

底层的网络通信细节封装入 API,方便网络分布式系统的开发

模块化

在 Hadoop 分布式系统中,上层的分布式子系统(MapReduce、YARN、HDFS …)能够共用这个网络通信模块

Hadoop 的 RPC 调用链

这里我们以 “从 HDFS 下载一个文件” 为例

启动 Hadoop 集群的 DFS、YARN

Hadoop RPC 源码领略

可以使用 Explorer 的 50070 端口,查看 NameNode

Hadoop RPC 源码领略


以上就是本文的全部内容,希望对大家的学习有所帮助,也希望大家多多支持 码农网

查看所有标签

本站部分资源来源于网络,本站转载出于传递更多信息之目的,版权归原作者或者来源机构所有,如转载稿涉及版权问题,请联系我们

Unreal Engine 4 Scripting with C++ Cookbook

Unreal Engine 4 Scripting with C++ Cookbook

Sherif, William、Stephen Whittle / 2016-10-24

Unreal Engine 4 (UE4) is a complete suite of game development tools made by game developers, for game developers. With more than 100 practical recipes, this book is a guide showcasing techniques to us......一起来看看 《Unreal Engine 4 Scripting with C++ Cookbook》 这本书的介绍吧!

MD5 加密
MD5 加密

MD5 加密工具

正则表达式在线测试
正则表达式在线测试

正则表达式在线测试

HEX HSV 转换工具
HEX HSV 转换工具

HEX HSV 互换工具