20 February 2018

Dave Lock

David Lock - Insider Technologies

12Posts 32,539Views 7Comments

Data hoarding - or Big Data

01 April 2014  |  1324 views  |  0

In the US there is a Big Data project to collect every life sign data from every patient. The idea is to monitor patients and their medical histories, then to review if any warning signs are consistent, say before a heart attack. Then if those signs appear in the future with patients they can be an indicator that there is an imminent heart attack and preventive measures can be taken and the heart attack can be averted.

In the IT world we have a world of data, but typically throw it away or consider it too expensive to collect or keep.

System logs tell us many valuable things, but most are overwritten and never kept. Running diagnostics or traces is considered too much of an 'overhead' in live systems. This approach is understandable in days gone by when disk and hardware were expensive. But Dr Moore was proven correct and hardware prices do continue to fall. So the question is has the time come where low level data is valuable and cost effective to collect on a long term basis? There are IT departments that are recovering from very public outages today that I'm sure if they had information to prevent those would consider it very valuable. The recent announcement by the FCA in the UK highlights this is no longer just a customer service issue.

Collecting data and keeping data is only part of the solution, it then needs to be analysed. But until it is collected as part of an all data strategy, that process cannot even begin.

What's your log and diagnostic archive strategy? Is it part of your Big Data strategy? It could be potentially as valuable as the transaction data.

TagsPaymentsRisk & regulation

Comments: (0)

Comment on this story (membership required)

Latest posts from David

There's one thing worse than being talked about.

07 April 2014  |  1917 views  |  0 comments | recomends Recommends 0 TagsInnovation

Data hoarding - or Big Data

01 April 2014  |  1324 views  |  0 comments | recomends Recommends 0 TagsPaymentsRisk & regulation

Prepaid cards: a maturing market?

20 November 2013  |  3221 views  |  0 comments | recomends Recommends 0 TagsCardsPayments

Little Big Data

20 September 2013  |  4321 views  |  2 comments | recomends Recommends 0 TagsPaymentsInnovation


05 July 2013  |  3442 views  |  2 comments | recomends Recommends 0 TagsPaymentsInnovation

David's profile

job title Business Solutions Manager
location Manchester
member since 2013
Summary profile See full profile »
Providing solutions and support with Insider Technologies Monitoring solutions

David's expertise

Member since 2013
12 posts7 comments
What David reads
David's blog archive
2014 (2)2013 (10)

Who's commenting on David's posts