Code@Pig Home

喜欢背着一袋Code傻笑的Pig .. 忧美.欢笑.记忆.忘却 .之. 角落

日志

关于我

kasicass

gamecoder@work

文章分类

[ZeroMQ] 深入分析(2) -- 线程间通讯"inproc://"

2010-12-17 18:15:32| 分类： net_ZeroMQ | 标签： |举报 |字号大中小订阅

下载LOFTER 我的照片书 |

==== 基本原理 ====

mb, mailbox, 线程间的事件通知domain socket, 每次send的command_t都很小，认为此一定是原子的（< PIPE_BUF）

mq, msg queue, 线程间 zmq_msg_t 传递的 lock-free queue

[ZeroMQ] 深入分析(2) -- 线程间通讯inproc:// - kasicass - Code@Pig Home

"inproc://" thread 间通讯，通过 domain socket 连接 thread，告知 command_t 之类的信息。

而 zmq_msg_t 通过 reader_t/writer_t(ypipe) 的 lock-less queue 来直接传递 pointer。

push = zmq_socket(ctx, ZMQ_PUSH); // new push_t

zmq_bind(push, "inproc://xxx"); // 将 push 在 ctx.endpoints 注册

pull = zmq_socket(ctx, ZMQ_PULL); // new pull_t

zmq_connect(pull, "inproc://xxx"); // 从 ctx.endpoints 中找到 push, 创建 reader_t/writer_t

// reader_t 绑定到 pull, 发消息 'bind' to pull.mailbox

// push 收到 'bind' 消息, 绑定 writer_t

zmq_send(push, &msg, 0); // msg 丢给 writer_t

zmq_recv(pull, &msg, 0); // 从 reader_t 获取 msg

==== object_t 之间的消息通讯 ====

object_t ==> ctx.mailbox[tid] ==> [kernel pipe] ==> object_t

==== pipe.hpp ====

定义了 reader_t/writer_t, 一个 pipe 的两端；writer_t 还支持一个 swap_t (ypipe满了，则msg自动保存到磁盘)

create_pipe(), 创建一个 ypipe<zmq_msg_t> 给 reader_t/writer_t 使用。reader_t/writer_t 可以分别在不同的线程。

i_reader_events/i_writer_events, reader_t/writer_t 通过这两个 interface 知会上层 activated/terminated 等事件

==== push/pull pattern ====

通过 lb_t/fq_t (load balance/fair queue) 来实现：

-- one-push/multi-pull

/- writer_t/reader_t -> fq_t -> pull_t

push_t -> lb_t --- writer_t/reader_t -> fq_t -> pull_t

\- writer_t/reader_t -> fq_t -> pull_t

-- multi-push/one-pull

push_t -> lb_t -> writer_t/reader_t -\

push_t -> lb_t -> writer_t/reader_t --- fq_t -> pull_t

push_t -> lb_t -> writer_t/reader_t -/

==== fq.hpp ====

class fq_t : public i_reader_events

fair queue 实现 (round-robin)

fq_t ==> [r1|r2|...], 带一个 reader_t 的数组

recv() 时, 从 reader_t数组中选择一个 active 的来读

==== lb.hpp ====

class lb_t : public i_writer_events

load balance 实现 (round-robin)

lb_t ==> [w1|w2|...], writer_t的数组

send() 时, 从 writer_t数组中选择一个 active 来写

ps. ZeroMQ 还有个 "sys://"，内部实现和 "inproc://" 是一个东西，其用于 ZeroMQ kernel 给 app 发送内部的 log，由 app 自己 write to file。当然，2.1.0的 "sys://" 还没有向 app 发送任何具体的log内容。

评论这张

转发至微博

阅读(12264)| 评论(0)

历史上的今天

this.p={  m:2,
              b:2,
              loftPermalink:'',
              id:'fks_094065082082085067081082080095087095084069085095',
              blogTitle:'[ZeroMQ] 深入分析(2) -- 线程间通讯\"inproc://\"',
              blogAbstract:'<div\><b\>==== 基本原理 ====</b\></div\><div\><br\></div\><div\><div\>mb, mailbox, 线程间的事件通知domain socket, 每次send的command_t都很小，认为此一定是原子的（< PIPE_BUF）</div\><div\>mq, msg queue, 线程间 zmq_msg_t 传递的 lock-free queue</div\></div\><div\><br\></div\><div\><div\><img title=\"[ZeroMQ] 深入分析(2) -- 线程间通讯inproc:// - kasicass - Code@Pig Home\" alt=\"[ZeroMQ] 深入分析(2) -- 线程间通讯inproc:// - kasicass - Code@Pig Home\" style=\"margin:0 10px 0 0;\" src=\"http://img852.ph.126.net/mBgj2R7fUaTWdyt3R2VmWQ==/2729462849164268868.png\"\></div\> </div\><div\><br\></div\><div\>\"inproc://\" thread 间通讯，通过 domain socket 连接 thread，告知 command_t 之类的信息。</div\>',
              blogTag:'',
              blogUrl:'blog/static/3956192010111761532567',
              isPublished:1,
              istop:false,
              type:0,
              modifyTime:1292637196056,
              publishTime:1292580932567,
              permalink:'blog/static/3956192010111761532567',
              commentCount:0,
              mainCommentCount:0,
              recommendCount:0,
              bsrk:-100,
              publisherId:0,
              recomBlogHome:false,
              currentRecomBlog:false,
              attachmentsFileIds:[],
              vote:{},
              groupInfo:{},
              friendstatus:'none',
              followstatus:'unFollow',
              pubSucc:'',
              visitorProvince:'',
              visitorCity:'',
              visitorNewUser:false,
              postAddInfo:{},
              mset:'000',
              mcon:'',
              srk:-100,
              remindgoodnightblog:false,
              isBlackVisitor:false,
              isShowYodaoAd:false,
              hostIntro:'gamecoder@work',
              hmcon:'1',
              selfRecomBlogCount:'0',
              lofter_single:'<iframe width="140" height="560" style="overflow:hidden;" src="http://www.lofter.com/mailEntry.do?blogad=1&blog" frameBorder="0"></iframe>'
            }

{list a as x}
    {if !!x}
    <div class="iblock nbw-fce nbw-f40">
      <a class="fc03 noul" target="_blank" hidefocus="true" href="http://blog.163.com/${x.visitorName}/">
      {if x.visitorName==visitor.userName}
      <img alt="${x.visitorNickname|escape}" onerror="this.src=location.f40" class="cwd bdwa bdc0" src="${fn1(x.visitorName)}&r=${visitor.imageUpdateTime}"/>
      {else}
      <img alt="${x.visitorNickname|escape}" onerror="this.src=location.f40" class="cwd bdwa bdc0" src="${fn1(x.visitorName)}"/>
      {/if}
      </a>
      <div class="cwd vname thide">
        {if x.moveFrom=='wap'}
          <a class="noul pnt" target="_blank" href="http://blog.163.com/services/wapblog.html?frompersonalbloghome"><span title="来自网易手机博客" class="iblock wapIcon"> </span></a>
        {elseif x.moveFrom=='iphone'}
          <a class="noul pnt" target="_blank"><span title="来自iPhone客户端" class="iblock iphoneIcon"> </span></a>
        {elseif x.moveFrom=='android'}
          <a class="noul pnt" target="_blank"><span title="来自Android客户端" class="iblock androidIcon"> </span></a>
        {elseif x.moveFrom=='mobile'}
          <a class="noul pnt" target="_blank" href="http://blog.163.com/services/emsblog.html?frompersonalbloghome"><span title="来自网易短信写博" class="iblock wapIcon"> </span></a>
        {/if}
        <a class="fc03 m2a"  target="_blank" hidefocus="true" href="http://blog.163.com/${x.visitorName}/">
          ${fn(x.visitorNickname,8)|escape}
        </a>
      </div>
    </div>
    {/if}
    {/list}

<#--最新日志，群博日志--> <#--推荐日志-->

<p class="fc06">推荐过这篇日志的人：</p>
    <div>
      {list a as x}
      {if !!x}
      <div class="iblock nbw-fce nbw-f40">
        <a class="fc03 noul" target="_blank" hidefocus="true" href="http://blog.163.com/${x.recommenderName}/">
        <img alt="${x.recommenderNickname|escape}" onerror="this.src=location.f40" class="cwd bdwa bdc0" src="${fn1(x.recommenderName)}"/>
        </a>
        <div class="cwd thide">
          <a class="fc03 m2a" target="_blank" hidefocus="true" href="http://blog.163.com/${x.recommenderName}/">
            ${fn(x.recommenderNickname,6)|escape}
          </a>
        </div>
      </div>
      {/if}
      {/list}
    </div>
    {if !!b&&b.length>0}
    <p  class="fc06">他们还推荐了：</p>
    <ul>
    {list b as y}
      {if !!y}
        <li class="rrb"><span class="iblock">·</span><a class="fc03 m2a" target="_blank" href="http://blog.163.com/${y.recommendBlogPermalink}/?from=blog/static/3956192010111761532567">${y.recommendBlogTitle|escape}</a></li>
      {/if}
    {/list}
    </ul>
    {/if}

<#--引用记录--> <#--博主推荐--> <#--随机阅读--> <#--首页推荐--> <#--历史上的今天--> <#--被推荐日志--> <#--上一篇，下一篇--> <#-- 热度 -->

{list a as x}
    {if !!x}
    <div class="hotItem iblock nbw-fce nbw-f40">
      <a class="fc03 noul" target="_blank" hidefocus="true" href="http://blog.163.com/${x.publisherUsername}/">
      {if x.publisherUsername==visitor.userName}
      <img alt="${x.publisherNickname|escape}" onerror="this.src=location.f40" class="cwd bdwa bdc0" src="${fn1(x.publisherUsername)}&r=${visitor.imageUpdateTime}"/>
      {else}
      <img alt="${x.publisherNickname|escape}" onerror="this.src=location.f40" class="cwd bdwa bdc0" src="${fn1(x.publisherUsername)}"/>
      {/if}
      </a>
      <div class="cwd vname thide">
        <a class="fc03 m2a"  target="_blank" hidefocus="true" href="http://blog.163.com/${x.publisherUsername}/">
          ${fn(x.publisherNickname,8)|escape}
        </a>
      </div>
      <a class="f-myLikeIcons hottype {if x.type==1} js-liketype{elseif x.type==2} js-reblogtype{elseif x.type==3} js-sharetype{else}{/if}" target="_blank" hidefocus="true" href="http://blog.163.com/${x.publisherUsername}/"> </a>
    </div>
    {/if}
    {/list}

<#-- 网易新闻广告 --> <#--右边模块结构--> <#--评论模块结构--> <#--引用模块结构--> <#--博主发起的投票-->

页脚

我的照片书 - 手机博客 - 下载LOFTER APP - 订阅此博客

Code@Pig Home

导航

日志

[ZeroMQ] 深入分析(2) -- 线程间通讯"inproc://"

历史上的今天

最近读者

热度

评论

页脚