Skip to content

Software Engineering Radio

The Podcast for Professional Software Developers

Archive

Tag: scale

Recording Venue: Oracle Java One 2010, San Francisco
Guest: Nati Shalom

Host: Robert

In this episode, Robert talks with Nati Shalom about the emergence of large-system architectures consisting of a grid of high-memory nodes. As memory has become faster and cheaper more rapidly than has disk storage, application state has increasingly migrated to memory in the form of caches. Memory grids take this one step further, using memory as the system of record and disk is used as a write-behind journal for recovery purposes.  Data and processing are colocated on the same node, which hosts what would be multiple tiers in the popular multi-tiered architectures. Data partitioning and distributed algorithms such as map-reduce become critical design decisions. Nati also discusses reliability and availability considerations of memory grids.

Links:

Play

Recording Venue: QCon San Francisco 2009
Guest(s): Philip Zeyliger


Host(s): Robert
Philip Zeyliger of Cloudera discusses the Hadoop project with Robert Blumen. The conversation covers the emergence of large data problems, the Hadoop file system, map-reduce, and a look under the hood at how it all works. The listener will also learn where and how Hadoop is being used to process large data sets.

Links:

Play