Making MapR’s Data-Centric Platform More Elastic with Mesos

[SIbinPhilip]

MapR has a new release today that provides some perspectives on the influences that are shaping data-centric architectures. In particular, it shows the importance of Yarn, Mesos and the continued value that Docker plays as the need increases for developing new patterns that reflect the forces of data gravity and container density.

That’s a lot to process, but it can be summed up in Myriad, a new open source project that MapR, eBay and Mesosphere launched last week. Myriad combines the orchestration of Mesos and the resource management of Yarn. It illustrates how data is dominating the way apps are developed. It shows there is a new thinking about how to make the platforms more elastic so analytics can be more accessible and widely available.

New Patterns

“Real-time” is the more common way to describe the way data is influencing the way we develop and manage apps. But for real-time to work, we need a better understanding of how data follows patterns that change according to the compute demands of the workload.

The concept speaks to why analytics is no longer one aspect of a business. Analytics is represented across a company’s entire operation and much more deeply in application development. The question becomes how compute resources are routed to make the analytics easy to do.

The need, therefore, is for the data to be as close to the user as possible. And that is why the concept of data gravity is so pertinent. With mass, the data gets too heavy to move. Instead, the compute resources will increasingly swarm to the data and then move to another task. “There is no separate analytics piece,” said Jack Norris, Chief Marketing Officer at MapR. Analytics “happens across the platform.”