InfoQ

InfoQ

Presentation

My Bookmarks

Login or Register to enable bookmarks for unlimited time.

The content has been bookmarked!

There was an error bookmarking this content! Please retry.

Recorded at:
Recorded at

Abstractions at Scale–Our Experiences at Twitter

Presented by Marius Eriksen on Dec 14, 2010 Length 00:56:36     Download: MP3
     Slides
Sections
Operations & Infrastructure,
Architecture & Design
Topics
Abstraction ,
OOP ,
QCon San Francisco 2010 ,
Object Oriented Design ,
BigTable ,
Design ,
Methodologies ,
NoSQL ,
QCon ,
Programming ,
Performance & Scalability ,
Architecture ,
Database ,
Twitter ,
MapReduce ,
Conferences
The next QCon is in New York June 18-22, Join us!
 

How would you like to view the presentation?

In case you are having issues watching this video, please follow these simple steps to help us investigate the issue:
1. Right click on the video player and select Copy log
2. Paste the copied information in an email to video-issue@infoq.com (clicking this link will fill in the default details in most email clients).
Note: in case your email client hasn't automatically picked up the email subject, please include in your email the URL of the video too.
3. Done.
We will investigate the issue and get back to you as soon as possible. Thanks for helping us improve our site!
Summary
Marius Eriksen considers that scalability problems appear when leaky abstractions are used, exemplifying with RDBMS, GC, and threads, presenting abstractions that help dealing with scalability issues: map-reduce, shared-nothing web applications, big table, all providing narrow access to explicit resources.

Bio
Marius Eriksen works on systems infrastructure at Twitter. Prior to that he architected Mixer Labs' GeoAPI.com database services, and worked on systems infrastructure at Google.

About the conference
QCon is a conference that is organized by the community, for the community.The result is a high quality conference experience where a tremendous amount of attention and investment has gone into having the best content on the most important topics presented by the leaders in our community.QCon is designed with the technical depth and enterprise focus of interest to technical team leads, architects, and project managers.

Related Sponsor

Neo4j is a robust, high-performance, scalable graph database. It is the only NOSQL database that solves the complex, connected data challenges that enterprises face today.

  • This article is part of a featured topic series on NoSQL and also QCon
JPA as 'dishonest abstraction' by Pinaki Poddar Posted
  1. Back to top

    JPA as 'dishonest abstraction'

    by Pinaki Poddar

    Interesting and insightful viewpoint in this talk. However, characterizing JPA as 'dishonest abstraction' is misguided.
    JPA is *not* an abstraction. It is a View in a classic MVC design pattern. The model being good, old RDBMS. A view is *not* an abstraction of a model. Nor is JPA or ORM is an abstraction of RDBMS.
    Like many other views, JPA presents the user an 'object-oriented' view of a relational database. Like any other views, JPA does not substitute or abstract the underlying model, just provides yet another perspective to a model and one takes (or rejects) a view purely based on their world view.
    For a Java developer dealing with a complex graph like domain model, yes, there is some definite advantage of taking a JPA view of a relational schema.
    For a batch upload of million flat records from a CSV file -- JPA brings nothing to the table.