19 December 2014

Karl Rieder

Karl Rieder - GFT

18Posts 78,936Views 1Comments

Innovation in Financial Services

A discussion of trends in innovation management within financial institutions, and the key processes, technology and cultural shifts driving innovation.

NoSQL to the Rescue

10 June 2014  |  2693 views  |  1

 

One of the most interesting, and potentially revolutionary, applications of big data technology in financial services has to be the schema-less trade repository. The best way to understand the solution is to first look at the problem.

In investment banks, there is a huge problem with data and system dispersion. By nature, the bank’s organization is highly siloed with the IT systems grouped by business lines and asset classes. An equities derivatives trader will trade on one system while a bond trader on another. Of course, since the data which has to be managed is particular to the asset traded, it makes sense that the trade capture systems and much of the front and middle office functions are specific for each asset class.

However, trades have to valued, P&L has to be calculated, risk has to be estimated, and accounting has to be completed for the whole bank in order to form a holistic view of the bank’s activity. So, the data from the different siloes have to be combined and forced into a universal model. Herein lies the problem.

To do this, investment banks have created ETL (extract-transform-load) processes throughout the IT architecture to move data from one system to another, modifying the data’s structure and granularity to fit the need of each downstream system. Over time, the banks have created a spider web of system-to-system links which is costly and inefficient to build and maintain.

This is where NoSQL can come to the rescue. Using NoSQL databases, data from different systems can be stored alongside one another, without the need to force them into a universal data model. This “schema-less” or “schema-on-read” architecture which underlies these databases removes the need to develop and maintain the multitude of ETL systems.

Moreover, a schema-less architecture also gives the platform flexibility to grow and evolve in time and thus enable quick innovation. In the old architecture, whenever there was a change in the upstream data format, the ETL layer, central data warehouse, and downstream systems had to be modified. Likewise, if the downstream system required new data (for new requirements), these data had to be added into the data stream with all systems requiring modification – alas, a very costly enterprise.

Working with products such as MarkLogic and HBase, we have implemented solutions for investment banking which have made first steps to revolutionize the business. By providing a flexibility and agility to improve the bank operations, rationalize the bank’s architecture, and reduce on-going IT costs, NoSQL allows us to tackle IT problems in a new, better way.

TagsPost-trade & opsInnovation

Comments: (1)

Tony Wenzel - Stratacache - New York | 10 June, 2014, 13:09

This may be the most cogent description of a practical use of Big Data yet.  Unstructured repositories and search capabilities definately have silo-smashing potential.  They might also address suspicious activities and finger fraud too. 

 1 thumb up! (Log in to thumb up)
Comment on this story (membership required)
Log in to receive notifications when someone posts a comment

Latest posts from Karl

The Truth About Hadoop

27 October 2014  |  4747 views  |  2  |  Recommends 0 TagsInnovationGroupInnovation in Financial Services

Still a Way to Go to Realise Big Data Benefits

14 July 2014  |  1086 views  |  0  |  Recommends 0 TagsInnovationGroupInnovation in Financial Services

NoSQL to the Rescue

10 June 2014  |  2693 views  |  1  |  Recommends 2 TagsPost-trade & opsInnovationGroupInnovation in Financial Services

From Evolution to Revolution

09 April 2014  |  1232 views  |  0  |  Recommends 0 TagsInnovationGroupInnovation in Financial Services

Volcker - The Ultimate Challenge

03 March 2014  |  1171 views  |  0  |  Recommends 0 TagsRisk & regulationGroupInnovation in Financial Services

Karl's profile

job title Executive Consultant
location London and Barcelona
member since 2011
Summary profile See full profile »
Executive Consultant, with extensive IT management experience, leading developments for large corporate clients, principally in the banking sector. Currently managing projects in investment banking, p...

Karl's expertise

What Karl reads
Karl writes about

Who is commenting on Karl's posts

Tony Wenzel
Ketharaman Swaminathan