23 November 2017
Ganeshbabu Annamalai


Ganeshbabu Annamalai - SCB

2Posts 14,369Views 2Comments

Top 10 challenges in building data warehouse for large banks

25 July 2014  |  10975 views  |  3

Lack of strategic focus to build Enterprise Data Warehouse (EDW)

Building EDW is a strategic initiative since it requires shift in culture, longer timescale & more importantly it is an expensive affaire. Hence, it should be one of the top agendas of the CXOs and they need to closely monitor the progress and also need to provide executive support to break any unwanted barriers.


Need of considerable Time, Effort & Cost

Typical time taken for a global bank to build an EDW varies from a couple of years to 5 years. It also requires substantial effort & eventually huge amount of money to build a data warehouse. Also, Evidence of successful ROI is very opaque in the existing data warehouse implementation.


Lack of cross divisional collaboration

Building EDW requires constructive collaboration from various teams like multiple business divisions, source system teams, architecture & design teams, project teams and vendor teams. 


Technological complexity

Mostly, source data is kept in multiple operating systems & multiple data base technologies. There are plenty of tools for data sourcing, data quality management, data integration, data ware housing, reporting & analytics. Choosing appropriate technology is not so simple and is complicated by various emerging techniques like data virtualisation,  self service BI, in-data base analytics, columnar data base, NOSQL database, massively parallel processing,  in-memory computing and etc,. Also, traditional data warehouse is required to be integrated with big data technologies & Internet of Things for gaining business insights.


Ill-defined, changing business data requirements & Insensitivity of technical team in understanding business requirements

Most of the time business finds difficulty in defining the data requirements, since data requirements keep evolving as the use of data increases. However, technical team wants finalised data requirements from business before designing & building a data warehouse.


Lack of clarity on true source of data

Most of the large banks have great legacy behind them and have been growing over decades through mergers & acquisition. They have widespread footprint across geographies and various customer segments. In this process, they have acquired many systems which are poorly integrated, less documented and data is scattered across multiple systems. It is nightmare for these banks to identify the true source of their data.


Lack of ability to manage data quality issues

Since data is an organisational asset it needs to be acquired & maintained well.

Many front office/customer facing systems don’t capture quality data at its origination. There is no unified data capturing process across organisation.

For example, last name of a personal customer would not have been captured in a front office system, since it is not a mandatory field, whereas it may be mandatory field for another system.

Sometimes there is lack of well defined processes & technologies to curtail the data quality issues.


Vested interest of vendors in promoting their own solution

Most of the top data warehousing vendors have their own suit of solutions/products in the entire data warehousing eco system. These vendors tend to promote their own solution rather than advocating what is best suited for the customer.


Comfort of using divisional data marts

Reporting is indispensable activity of banking. Many banks have built divisional data marts for fulfilling their own divisional needs. Though divisional marts do not provide enterprise wide view, many business users are comfortable in using divisional data mart assuming that “Known devil is better than unknown angel”.


Subordinate use of data ware house

Business users from various divisions need to use data warehouse for reporting, business intelligence, data analytics & advanced analytics to unleash full potential of the enterprise data asset. Under utilised data warehouse will not grow & will not yield the desired return on investment (ROI)


TagsRetail bankingInnovation

Comments: (3)

Balaji Venkatesan
Balaji Venkatesan - Bank - Singapore | 28 July, 2014, 14:21

Most of the points are rightly highlighted. Big banks like HSBC, Citi are building a common Retail Banking platform globally to overcome most of the points highlighted. 

Be the first to give this comment the thumbs up 0 thumb ups! (Log in to thumb up)
Simon Harper
Simon Harper - Morgan Harper - London | 28 July, 2014, 23:25

Sensible points above although should be recognised that global institutions have multiple businesses and drivers. Retail is different to trading environments that tend to be sadly driven from the board on regulatory goals....not revenue that would promote a proactive stance on business change - the  last 20% that makes 80% benefit. Shiny new boxes & reports dont deliver value add....

Be the first to give this comment the thumbs up 0 thumb ups! (Log in to thumb up)
Ketharaman Swaminathan
Ketharaman Swaminathan - GTM360 Marketing Solutions - Pune | 29 July, 2014, 16:34

Any large bank comprises of different businesses with different drivers and regulatory frameworks. Silos are a fact of life in the banking industry and, unlike any other industry, many silos in banking - e.g. investment banking and proprietary trading - are imposed by regulation. Banks have been happily running in this manner for ages. Many IT programs - especially the ones in DW - simply don't get this. If they stopped trying to harmonize what're intrinsically different businesses that cannot and should not be harmonized, many of these problems will vanish by themselves.

Be the first to give this comment the thumbs up 0 thumb ups! (Log in to thumb up)
Comment on this story (membership required)

Latest posts from Ganeshbabu

Top 10 challenges in building data warehouse for large banks

25 July 2014  |  10975 views  |  3 comments | recomends Recommends 1 TagsRetail bankingInnovation

Bigdata analytics to curb rate fixing scandal

22 July 2014  |  3395 views  |  1 comments | recomends Recommends 0 TagsTrade executionRisk & regulation

Ganeshbabu's profile

job title Manager - Enterprise Data Management
location Kualalumpur
member since 2014
Summary profile See full profile »
Have 12 years of experience in Information Technology with expertise in Consulting, Business Analysis, Solution Architecture, Account Management and Project Management - predominantly in banking domai...

Ganeshbabu's expertise

Member since 2013
2 posts2 comments
What Ganeshbabu reads
Ganeshbabu's blog archive
2014 (2)

Who's commenting on Ganeshbabu's posts