Showing posts with label distributed systems. Show all posts
Showing posts with label distributed systems. Show all posts

Friday, February 8, 2008

The future of multi-core by CPU designers

The EE Times online has an interesting review of the International Solid State Circuits conference in San Jose (Feb 5). Senior staff at AMD, Renesas, IBM and Tilera shared their view on the design of the next multi-core systems. Here are some interesting extracts about the role of software following multi-core architecture developments:

Shekhar Borkar, director of Intel Corp.'s Microprocessor Technology Lab, said microprocessor cores will get increasingly simple, but software needs to evolve more quickly than in the past to catch up.

"A core will look like a NAND gate in the future. You won't want to mess with it," said Borkar. "As for software, the time to market has been long in the past, but we can't afford to let that be the case in the future," he added.

Dave Ditzel, former CPU architect at Sun and founder of Transmeta, agreed. A member of the audience, Ditzel told the panel he helped design Sun's first 64-bit CPU then waited nearly ten years before commercial 64-bit operating systems became available.

Ditzel borrowed a metaphor from Berkeley computer science professor Dave Patterson to describe the current situation.

"With multi-core it's like we are throwing this Hail Mary pass down the field and now we have to run down there as fast as we can to see if we can catch it," Ditzel said.



Technorati Tags:

Powered by ScribeFire.

Thursday, January 31, 2008

Open source off-shoring

Following a post in Enypher blog, I came across imatix.com, the company behind OpenAMQ. OpenAMQ is an open source implementation of AMQ, a messaging middleware protocol designed for low latency, critical applications. JPMorgan contributed to the project from 2004 and migrated trading desks globally over the last 3 years. iMatix claims zero downtime since 2006.

The middleware open source offering is spreading its wings. We are now seeing a number of projects challenging commercial applications: I mentioned RedHat MRG in an earlier post, OpenMPI is the product of years of research in multi-core systems and parallelism, Hadoop is a data management and clustering solution sponsored by Google, Yahoo and HP. 0MQ is the last open source initiative for very low-latency middleware, backed by FastMQ and Intel.

This prompts for the question: How much money has been saved by financial corporations sponsoring open-source initiatives vs. structural off-shoring?

For the last 10 years (ever since I got involved in trading systems development) the refrain of every business manager was about IT development going to India. Entire IT departments were counting their days and Bangalore was going to become the new mecca of finance IT development. Starting with back-office systems and gradually moving to the middle-office and desk applications, the future of IT management was in off-shoring. Keyword: cost-cutting. Ah..., the commoditization of finance IT...

Today Bangalore is the Silicon Valley of India and --guess what-- production costs there have risen. At the same time we have seen a number of open source projects emerging as the de-facto standard in finance: in the 90s, X11 and Motif were the state-of-the-art for front-office GUIs; Linux is now used in critical server applications; Cygwin X Server offers a no-cost alternative to Exceed; SOAP, XML and HTML are open standards; Samba and SVN are the best tools I know for remote file access and source code management in terms of price/quality (hint: price = 0). Is MySQL next?

In my view, the fundamental error lies in seeing software development as an industrial process, rather than a creative intellectual effort. Not surprisingly, the IT and the Business units in most investment banks have been organized as two separate entities, with the latter framed mainly as a support center rather than core-business. Today the move that saw venerable technology institutions (HP, IBM, DEC, SUN...) supporting academic efforts in the past might spread to financial institutions supporting open-source projects. After all, it's all about cost-cutting.


Powered by ScribeFire.



Technorati Tags:

Thursday, December 13, 2007

RedHat MRG

RedHat announced the beta release of MRG, an open source (GPLv2) messaging system based on AMQP. It supports a number of language bindings including Java, JMS, .NET, C++, Ruby, and Python. Download page here.

This is the first open source offer that could rival other commercial applications like Tibrv and 29West. I quickly checked the tutorials, they have some examples to illustrate point-to-point, multi-casting, persistent queues and transactions: MRG Messaging tutorial