注冊(cè) | 登錄讀書好,好讀書,讀好書!
讀書網(wǎng)-DuShu.com
當(dāng)前位置: 首頁(yè)出版圖書科學(xué)技術(shù)工業(yè)技術(shù)自動(dòng)化技術(shù)、計(jì)算技術(shù)流式架構(gòu):Kafka與MapR Streams數(shù)據(jù)流處理

流式架構(gòu):Kafka與MapR Streams數(shù)據(jù)流處理

流式架構(gòu):Kafka與MapR Streams數(shù)據(jù)流處理

定 價(jià):¥55.00

作 者: [美] Ted Dunning(泰德-敦寧),Ellen Friedman 著;唐李洋 譯
出版社: 電子工業(yè)出版社
叢編項(xiàng):
標(biāo) 簽: 暫缺

ISBN: 9787121317224 出版時(shí)間: 2017-06-01 包裝: 平裝
開本: 16開 頁(yè)數(shù): 140 字?jǐn)?shù):  

內(nèi)容簡(jiǎn)介

  所有連續(xù)的事件流都可以稱為數(shù)據(jù)流。對(duì)連續(xù)數(shù)據(jù)流設(shè)計(jì)和構(gòu)建流式數(shù)據(jù)架構(gòu),能夠?qū)崿F(xiàn)實(shí)時(shí)或近實(shí)時(shí)應(yīng)用,提升整個(gè)組織的效率。本書以Apache Kafka 和MapRStreams為例,重點(diǎn)講解如何確定使用流數(shù)據(jù)的時(shí)機(jī)、如何為多用戶系統(tǒng)設(shè)計(jì)流式架構(gòu)、為什么要求消息傳遞層具備某些特定功能,以及為什么需要微服務(wù),并且描述了目前*符合流式設(shè)計(jì)需求的消息傳遞和流分析工具,適合架構(gòu)師、大數(shù)據(jù)科學(xué)家及IT工程師閱讀。

作者簡(jiǎn)介

  Ted Dunning,MapR Technologies首席應(yīng)用架構(gòu)師,開源社區(qū)的活躍成員?,F(xiàn)任Apache Foundation孵化器的VP,是大量項(xiàng)目的冠軍得主和導(dǎo)師,也是Apache ZooKeeper和Drill項(xiàng)目的貢獻(xiàn)者和PMC成員。Ellen Friedman,解決方案咨詢師,著名演講者和作家,目前主要撰寫大數(shù)據(jù)方面的著作。她是Apache Drill和Apache Mahout項(xiàng)目的貢獻(xiàn)者。唐李洋,博士,研究方向?yàn)樵朴?jì)算、并行計(jì)算、數(shù)據(jù)挖掘與分析等。曾經(jīng)在Cisco從事過數(shù)據(jù)架構(gòu)方面的設(shè)計(jì)與分析工作。

圖書目錄

目錄
第1 章 為什么使用流 ........................................................................................1
飛機(jī)、火車和汽車:車聯(lián)網(wǎng)和物聯(lián)網(wǎng) .......................................................................................3
流數(shù)據(jù):這才是現(xiàn)實(shí)世界 ...........................................................................................................6
什么時(shí)候需要流 ...........................................................................................................8
不止是實(shí)時(shí):流架構(gòu)的更多優(yōu)勢(shì) ..............................................................................................11
流架構(gòu)的最佳實(shí)踐 ......................................................................................................................13
醫(yī)療數(shù)據(jù)流案例 ..........................................................................................................................14
流數(shù)據(jù):架構(gòu)設(shè)計(jì)的核心 ..........................................................................................................17
第2 章 流式架構(gòu) ...............................................................................................19
狹義視角:實(shí)時(shí)應(yīng)用 ..................................................................................................................20
通用流式架構(gòu)的關(guān)鍵問題 ..........................................................................................................21
消息傳遞技術(shù)的重要性 ..............................................................................................................24
實(shí)時(shí)分析工具 ..............................................................................................................................28
Apache Storm ....................................................................................................................30
Apache Spark Streaming ................................................................................................31
Apache Flink ....................................................................................................................32
Apache Apex ....................................................................................................................33
流分析功能比較 ......................................................................................................................33
小結(jié) ..........................................................................................................................................36
第3 章 流架構(gòu):微服務(wù)的理想平臺(tái) ..............................................................37
為什么需要微服務(wù) ..................................................................................................................38
微服務(wù)需要哪些支撐 ..............................................................................................................41
關(guān)于微服務(wù)的更多詳情 ..........................................................................................................42
設(shè)計(jì)流架構(gòu):以在線視頻服務(wù)為例 ......................................................................................45
新設(shè)計(jì):支持消息傳遞的基礎(chǔ)設(shè)施 ...............................................................................47
通用微架構(gòu)的重要性 ..............................................................................................................49
命名問題 ..................................................................................................................................50
為什么使用分布式文件和NoSQL 數(shù)據(jù)庫(kù) ............................................................................52
視頻服務(wù)的新設(shè)計(jì) ..................................................................................................................52
小結(jié):綜合平臺(tái)視角 ..............................................................................................................54
第4 章 使用Kafka 進(jìn)行流傳輸 .....................................................................57
Kafka 的動(dòng)機(jī) ...........................................................................................................................57
Kafka 的創(chuàng)新 ...........................................................................................................................58
Kafka 的基本概念 ...................................................................................................................60
排序 ...............................................................................................................................61
持久化 ...........................................................................................................................62
Kafka API ....................................................................................................................................62
KafkaProducer API .............................................................................................................63
KafkaConsumer API ............................................................................................................66
遺留API ............................................................................................................................70
Kafka 實(shí)用程序 .......................................................................................................................71
負(fù)載均衡 ...........................................................................................................................71
鏡像 ...................................................................................................................................72
Kafka 的陷阱 ...........................................................................................................................73
產(chǎn)品環(huán)境下的Kafka .........................................................................................................73
主題和分區(qū)的數(shù)目有限 ...................................................................................................74
手動(dòng)均衡分區(qū)負(fù)載 ...........................................................................................................75
沒有固有的序列化機(jī)制 ..................................................................................................76
鏡像的不足 ......................................................................................................................77
小結(jié) ..........................................................................................................................................78
第5 章 MapR Streams .....................................................................................79
MapR Streams 的創(chuàng)新 .............................................................................................................79
MapR 流系統(tǒng)的歷史和情境 ....................................................................................................82
MapR Streams 的工作原理 ......................................................................................................84
配置MapR Streams ....................................................................................................................86
地理分布式復(fù)制 .......................................................................................................................89
MapR Streams 的陷阱 ...........................................................................................................91
第6 章 基于流數(shù)據(jù)的欺詐檢測(cè) ....................................................................93
刷卡速度 ................................................................................................................................94
快速響應(yīng)決策:“這是欺詐嗎” ...........................................................................................95
多用途流數(shù)據(jù) .........................................................................................................................98
欺詐檢測(cè)器的向上擴(kuò)展 .........................................................................................................99
小結(jié) .........................................................................................................................................101
第7 章 地理分布式數(shù)據(jù)流 .......................................................................... .103
利益相關(guān)者 .............................................................................................................................104
設(shè)計(jì)目標(biāo) .................................................................................................................................106
設(shè)計(jì)選擇 .................................................................................................................................106
我們的設(shè)計(jì) ....................................................................................................................108
數(shù)據(jù) ................................................................................................................................108
控制誰(shuí)能訪問流數(shù)據(jù) ....................................................................................................109
基于流的地理分布式復(fù)制的優(yōu)勢(shì) .........................................................................................110
第8 章 總結(jié) .................................................................................................113
流式架構(gòu)的優(yōu)勢(shì) .....................................................................................................................115
過渡到流架構(gòu) .........................................................................................................................116
小結(jié) .........................................................................................................................................119
附錄A 附加資源 ...........................................................................................121
作者簡(jiǎn)介 .......................................................................................................125

本目錄推薦

掃描二維碼
Copyright ? 讀書網(wǎng) m.ranfinancial.com 2005-2020, All Rights Reserved.
鄂ICP備15019699號(hào) 鄂公網(wǎng)安備 42010302001612號(hào)