InfoQ Homepage Performance & Scalability Content on InfoQ
-
LinkedIn's Data Infrastructure
Jay Kreps of LinkedIn presented some informative details of how they process data at the recent Hadoop Summit. Kreps described how LinkedIn crunches 120 billion relationships per day and blends large scale data computation with high volume, low latency site serving.
-
Measuring and Comparing the Performance of 5 Cloud Platforms
Bitcurrent and Webmetrics have run a number of tests for a month on 5 different cloud platforms - Amazon, Google, Rackspace, Salesforce.com, and Terremark -, attempting to measure the performance of each platform. One of their conclusions is that each platform works better for different application types.
-
BigPipe at Facebook: Optimizing Page Load Time
Changhao Jiang, Research Scientist at Facebook, describes a technique, called BigPipe, that contributed to making the Facebook site, "twice as fast." BigPipe is one of several innovations, a "secret weapon," used to achieve the reported performance gains. Another innovation mentioned is architectural in nature, the structuring of Web pages as "pagelets."
-
Facebook on Hadoop, Hive, HBase, and A/B Testing
The Hadoop Summit of 2010 included presentations from a number of large scale users of Hadoop and related technologies. Notably, Facebook presented a keynote and details information about their use of Hive for analytics. Mike Schroepfer, Facebook's VP of Engineering delivered a keynote describing the scale of their data processing with Hadoop.
-
Yahoo! Updates from Hadoop Summit 2010
The Hadoop Summit of 2010 started off with a vuvuzela blast from Blake Irving, Chief Product Officer for Yahoo. Yahoo delivered keynote addresses that outlined the scale of their use, technical directions for their contributions, and architectural patterns in how they apply the technology.
-
Membase, a new and heavyweight NoSQL family member
NorthScale solutions announced the availability of the open source NoSQL database Membase which was developed by core members of the Memcached team with contributions from Zynga and NHN. It is a protocol compatible persistent drop in for Memcached the widely used caching solution
-
Azul Releases Zing: Software-based JVM Virtualisation/Elastic Runtime for x86
Azul Systems, makers of specialist hardware for running Java applications, have announced Zing, a Virtualised implementation of their hardware stack. Zing uses RedHat's KVM and VMWare's vSphere to target a wide range of operating systems and is optimised for Intel's latest x86
-
Azul Systems To Open Source Significant Technology in Managed Runtime Initiative
Having just announced a record breaking quarter, Azul Systems are open sourcing a considerable part of their intellectual property under GPLV2, as part of a major new initiative to try and improve the performance of managed code on commodity platforms.
-
7 Lessons Learned at Reddit
Steve Huffman, co-founder of Reddit, shares the main lessons he learned scaling Reddit from a small web application to a large social website.
-
Microsoft’s Experiments with Software Transactional Memory Have Ended
Dana Groff has announced the end of Microsoft’s experiment with software transactional memory for the .NET Framework. Known as STM.NET, this research project was announced in 2008 as an alternative to explicit locks when dealing with concurrency issues.
-
ScaleUp Addresses Many of IIS’ File Uploading Limitations
LeanServer has created for IIS 7.0 an extension called ScaleUp, solving some of the problems related to file uploading and plaguing Microsoft’s web platform. According to its creators, ScaleUp increases upload speed, supports unlimited upload file sizes, scales up to thousands of uploads per server, and includes progress reporting, streaming and filtering.
-
What Color is your Backlog?
At the recent SDC conference in Wellington Prof Philippe Kruchten delivered a talk titled “What Color is Your Backlog”. The thrust of his talk is about bringing a focus on architecturally significant aspects of software into Agile projects, along with delivering the functional components of the system. He uses a color metaphor to illustrate the importance of addressing four types of work.
-
Patterns and Samples for .NET Parallel Extensions
Even though Microsoft has been working on .NET’s Parallel Extensions since 2007, there are still many features that they didn’t have time to fully implement for .NET 4.0. Some features were “too application-specific to be included in the core of the Framework” while others simply needed for testing and user feedback. So instead they are being released as a set of patterns and samples.
-
Keeping Garbage Collection Pauses Short with Growing Heap Sizes: Q&A With Dr. Cliff Click
The strong correlation between heap size and garbage collection pause time is becoming one of the major limitations to Java application scalability, and a great deal of R&D effort is going into trying to remedy the situation. InfoQ talked to Dr. Cliff Click, former architect and lead developer of the HotSpot Server Compiler and now chief JVM Architect at Azul Systems, about Azul's solution.
-
Improving the Performance of Web Applications with Google’s Native Client
In order to increase the performance of CPU-intensive web applications, Google is developing Native Client, a browser technology used to run native code. Unlike Netscape’s NPAPI or Microsoft’s ActiveX plug-in technologies, Native Client runs in a double sandbox prohibiting access to the underlying operating system.