3 comments

Dimitar

Could you expand a bit more about how the “so great performance” alleviates the need for transactions?

Are we talking about cluster-durable vs. database-durable?

04/02/08 @ 16:58
Comment from:

I just finished speaking to John about this. Here’s the basics. In a clustered environment, write the transactions as an XML blob to memory, using something like GigaSpaces and index it with something like MAPS. When necessary, convenient, practical, or whatever other criteria makes sense for you, persist the XML Blob by writing to disk. The banks are using openSolaris, so the file system is ZFS, which branches changes much like subversion, thus keeping an history of any changes and ensuring that the history is maintained. By cutting out the database and the huge overhead of the ORM layer, the performance increase is amazing. This is very broad brush. You can get more details by John Davies and sorting through the 137,000 results. ;-)

04/02/08 @ 17:44
John Davies

In answer to the question above, it’s quite complex but in essence because we get such high performance from in-memory “databases", we can start to serialise many of the transactions. Things that used to take 20 minutes now take a second or two and can usually be serialised. Transactions are not alleviated all together but we can vastly reduce the number of transactions and the impact of them on the data, this helps to further increase performance.

-John-

04/03/08 @ 12:10
May 2017
Mon Tue Wed Thu Fri Sat Sun
 << <   > >>
1 2 3 4 5 6 7
8 9 10 11 12 13 14
15 16 17 18 19 20 21
22 23 24 25 26 27 28
29 30 31        

The Open Source Solutions Blog is a companion to the Open Source Solutions for Business Intelligence Research Project, sponosred by InterActive Systems & Consulting, Inc. This Blog, a Wiki and Lens will be used to develop, support and publish the findings of our research into enterprise open source projects.

InterActive Systems & Consulting, Inc. (IASC) performs research in the areas of data analytics, collaboration and remote access.

InterASC Professional Services, a service mark of IASC, provides strategic consulting and project management for data warehousing, business intelligence and collaboration projects using proprietary and open source solutions. We formulate vendor-independent strategies and implement solutions for information management in an increasingly complex and distributed business environment, allowing secure data analysis and collaboration that provides enterprise information in the most valuable form to the right person, whenever and wherever needed.

TeleInterActive Networks, a service mark of IASC, hosts open source applications for small and medium enterprises including CMS, blogs, wikis, database applications, portals and mobile access. We provide the tools for SME to put their customer at the center of their business, and leverage information management in a way previously reserved for larger organizations.

37.540686772871 -122.516149406889

Search

Blogroll

  XML Feeds

mindmaps

Our current thinking on sensor analytics ecosystems (SAE) bringing together critical solution spaces best addressed by Internet of Things (IoT) and advances in Data Management and Analytics (DMA) is here.

Recent Posts

Website engine