Programming for Parrallelism: The Parallel Hierarchies Pattern

Posted by Sadek Drobi on Aug 29, 2007 05:00 AM

Community

Architecture

Topics

Design ,

Programming

Tags

Parallel Programming ,

Multi-threading ,

Concurrency

The advent of multi-core processors offers new performance opportunities. However, according to Ina Fried, this hardware trend is a big challenge for the software industry, since “most of today's software isn't built to handle that kind of advance”. Intel fellow Shekhar Borkar argues as well that “large software makers […] have not moved fast enough” and that time has come for the software to follow Moore's law, i.e. to double “the amount of parallelism that it can support every two years." (The notion of Moore’s law refers to the fact that the performance of chips is roughly doubled every two years). Borkar believes that software development practices have to be retooled in order to leverage potential performance improvement. 

In this vein, a new architectural pattern for parallel programming has been introduced (pdf) by Prof. Jorge L. Ortega-Arjona from the Mathematics Department of the National Autonomous University of Mexico.  The pattern attempts to increase performance of execution when:

It is necessary to perform an computation repeatedly, composed of a series of ordered operations on a set of ordered data.  Consider a program whose output may be the result of just a single complex computation as a series of conceptually ordered simple operations, executed not for value but for effect, at different levels. An operation at a high level requires the execution of one or more operations at lower levels. If this program is carried out serially, it could be viewed as a chain of subroutine calls, evaluated one after another.

His Parallel Hierarchies pattern is “an extension of the Layers pattern”, which partitions the problem into layers components responsible to “provide operations or functions to more complex level layers, and to delegate more simple subtasks to layers in less complex levels.” Elements of functional parallelism are “introduced by allowing “two or more components of a layer […] to simultaneously exist, normally performing the same operation”:

During the execution of operations in each layer, usually the higher layers have to wait for a result from lower layers. However, if each layer is represented by more than one component, they can be executed in parallel and service new requests. Therefore, at the same time, several ordered sets of operations can be carried out by the same system. Several computations can be overlapped in time.

Among the known uses of the pattern suggested by Prof Ortega are “Tree structure operations like search trees, where a search process is created for each node.”  Among the listed limitations are that “not every system computation can be efficiently structured as layers,” the pattern doesn’t work well when upper layers have too many dependencies on lower layers (eg: typical web based apps), and that desiging the right level of layers can be quite complex.

If you agree with Jon Erickson, who believes that “concurrency […] should be in the forefront of all developer's and architect's field of vision”, then it’s good to keep an eye on emerging research in this space. 

1. Back to top

   how much does this apply to server-based applications?

   Aug 29, 2007 8:37 AM by Tom Nichols

   If your application is server-based (i.e. a web application) then it is already a highly concurrent system. Assuming at any given time you will have multiple requests to the app, wouldn't it be safe to assume all of your parallelism is being used up anyway? I can see this benefiting desktop applications (since a desktop is more often doing a single operation) but what about servers?

   Reply

2. Back to top

   Re: how much does this apply to server-based applications?

   Aug 29, 2007 10:42 AM by Michael Nygard

   It mainly applies to numerical applications, not to request-processors.
   
   The main thrust here seems to be eliminating synchronization by creating multiple instances of key system objects, where those instances "live" close to the thread that will use them.

   Reply

3. Back to top

   Re: how much does this apply to server-based applications?

   Nov 24, 2008 12:38 PM by emrah okay

   With twenty-four members plus two spec leads, Java EE 6 -- or JSR-316 -- is officially underway, Roberto Chinnici presents a summary from the first meetings between the group sohbet oyun indirindir program chatanyone try to appropriate the IP and patent it without OpenID's consent.

   Reply

4. Back to top

   Re: how much does this apply to server-based applications?

   Dec 2, 2008 10:10 AM by deneme deneme

   The project's official name is "JVM Language Runtime",
   
   
   rather than "Java Language Runtime", and it's intended to target *all* varieties
   
   
   of languages for the JVM. And yes, the name is a direct nod to the DLR (Dynamic
   
   
   Language Runtime) for the CLR, which is both a good idea and a good name. But
   
   
   we'd like to be all-inclusive, providing tools and frameworks for all varieties
   
   
   of languages. And rather than starting right away building a common base all
   
   languges must conform to, we'll generalize existing solutions to common JVM
   
   language implementation challenges, drawing from the large existing base of
   
   already-implemented languages for the JVM.
   
   
   
   diyet
   astroloji
   magazin
   
   cinsellik liseli kızlar
   arkadaş
   bebek resimleri
   
   
   
   
   etek alti video 
   kadınlar 
   uzmanlar itiraf

   Reply

• Older >