01 October 2014

Dave Lock

David Lock - Insider Technologies

12 | posts 24,568 | views 7 | comments

Data hoarding - or Big Data

01 April 2014  |  710 views  |  0

In the US there is a Big Data project to collect every life sign data from every patient. The idea is to monitor patients and their medical histories, then to review if any warning signs are consistent, say before a heart attack. Then if those signs appear in the future with patients they can be an indicator that there is an imminent heart attack and preventive measures can be taken and the heart attack can be averted.

In the IT world we have a world of data, but typically throw it away or consider it too expensive to collect or keep.

System logs tell us many valuable things, but most are overwritten and never kept. Running diagnostics or traces is considered too much of an 'overhead' in live systems. This approach is understandable in days gone by when disk and hardware were expensive. But Dr Moore was proven correct and hardware prices do continue to fall. So the question is has the time come where low level data is valuable and cost effective to collect on a long term basis? There are IT departments that are recovering from very public outages today that I'm sure if they had information to prevent those would consider it very valuable. The recent announcement by the FCA in the UK highlights this is no longer just a customer service issue.

Collecting data and keeping data is only part of the solution, it then needs to be analysed. But until it is collected as part of an all data strategy, that process cannot even begin.

What's your log and diagnostic archive strategy? Is it part of your Big Data strategy? It could be potentially as valuable as the transaction data.

TagsPaymentsRisk & regulation

Comments: (0)

Comment on this story (membership required)
Log in to receive notifications when someone posts a comment

Latest posts from David

There's one thing worse than being talked about.

07 April 2014  |  1003 views  |  0  |  Recommends 0 TagsInnovation

Data hoarding - or Big Data

01 April 2014  |  710 views  |  0  |  Recommends 0 TagsPaymentsRisk & regulation

Prepaid cards: a maturing market?

20 November 2013  |  2403 views  |  0  |  Recommends 0 TagsCardsPayments

Little Big Data

20 September 2013  |  3670 views  |  2  |  Recommends 0 TagsPaymentsInnovation

NFC - KISS

05 July 2013  |  2862 views  |  2  |  Recommends 0 TagsPaymentsInnovation
name

David Lock

job title

Business Solutions Manager

company name

Insider Technologies

member since

2013

location

Manchester

Summary profile See full profile »
Providing solutions and support with Insider Technologies Monitoring solutions

David's expertise

What David reads
David writes about
David's blog archive
April 2014 (2)2013 (10)

Who is commenting on David's posts