The Data Scribe

  • Comments posted to this topic are about the item The Data Scribe

  • What is old is new again?

    This is what I have been doing for years - working in a team that gets requirements and produce reports.  We are the jack of all trades (& quite often, masters of none).  It is our job to understand where data comes from.  Its our job to form that data into useful outputs that can be used from the payments clerks through to the board of directors.

    We have been trying to sell the concept of a self service data warehouse and analytical models for nearly 3 years with not a lot of joy.  While those who make the big decisions understand the power of data, they would prefer that someone else does the work for them - they simply don't care.

  • This is basically the role of my team.
    In a non IT business, why try and force IT skills (some quite complicated) on an unwilling workforce.
    At best you're going to get inadequate or even completely incorrect results.
    Leave it to the people that understand the data and possess the skills to be able to verify the results.
    Given that we can fill a few full time posts dedicated to the role, imagine the time that non-experts might spend 'not' doing their day job trying to formulate that one-off report for their director.
    We've found that if you push this out to the business, all you end up with is pockets of semi-experts, all doing things in different ways, none talking to each other, and usually doing it because they've been volunteered by a manager, or shown an interest, but not because they are equipped to do it necessarily.
    And because it's seen a secondary function, it's not seen fit to properly train these people because it's seen as a secondary function, picked up only because someone else isn't doing it.
    Better to have it centralised (IMHO)

  • Isn't your suggested role pretty close to a data scientist Steve? Seems fairly congruent to me if not exactly the same. Perhaps more of a data engineer?

    BTW our most senior execs are still not inclined to type their own emails - or at least not all the time...

  • There is a lot of scope for improvement of data input absolutely. Manual input is highly inefficient. For health care we need active monitoring of patients I have a friend who is a surgeon working on linking up with IBM and Samsung to do just that.

    AI being used to collect information from things like face to face meetings must be something on the cards as well. I would be surprised if someone is not working on it.

    Scribes will come back but it will probably be AI driven.

    As for the article really excellent article a lot of us are facing up to the fact that not all changes in software are universal improvements for everyone while at the same time demands and amount of information wanting to be collected is increasing.  Its a balancing act but that is the job.

    I think web applications will improve this. Its easier to get new applications in which reduces the risk to changing systems out if they are not performing - designing systems is still important but at least there is the potential for vendors to distribute them easily and cheaply if they do a good job. Also vendors are becoming more specific more focused and seem to be combining domain knowledge with technical knowledge.

    As seen by companies such as Babylon Health who are a good example of domain driven technical improvement of ground up system redesign which could not exist without VOIP/ResponsiveDesign and on demand flexible cloud capacity.
    https://www.babylonhealth.com/blog

  • This describes a fair portion of my daily duties. As the DBA for a rather old project, my first hour of each day is spent checking on the health of the system, and most of the rest of my time is spent gathering and organizing data directly from the databases. A lot of times it makes more sense for me to spend a few days figuring out a set of queries for a report, then running it when my customers need it, rather than having some middle manager dig through his records and killing off a day at a time for him. I'm usually the best person to dig through the data because I'm familiar with it

  • Being a data scribe is a really cool job. I've enjoyed every chance I've had to dig into the technical and the business side of that problem.

    412-977-3526 call/text

  • I heartily agree that this is an area that could be improved.  When we as senior citizens go to our doctors and PA's who are 30 to 40 years our juniors, they do spend a considerable amount of the time reviewing data and entering responses to questions, probably more than time actually spent on exam.  Of course, I realize they are also thinking about our responses, but I agree they could and should be relieved of the busywork.   Our regular GP does in fact have a person to do the initial questioning and data entry, but then that person leaves the exam room when the doc arrives.  

    I recall 30 to 40 years ago introducing business people then in their 50's and 60's to the old dumb terminals, well before there were cell phones and PA's so they had absolutely no background for technology.  And they did not even have past experience even using printed reports.   We went from totally manual systems to interactive querying.  This was definitely a struggle for them, and for us as their technical mentors, which consumed too much of our time also. 

    We are currently re-watching the TV series called ER ( Emergency Room ) and it stands out that when patients are transported by paramedics, they are technically and visually collecting lots of data that they they 'spout' quickly to ER doctors and technicians.   

    Obviously we should not make many professionals overly dependent on another person for their data, but there is probably a middle ground we could improve.

    Rick
    Disaster Recovery = Backup ( Backup ( Your Backup ) )

  • Fascinating thread so far.  Though my title is DBA at our company, that is only semi-related to my job responsibilities.  I'm more frequently dealing with reporting, visualization, and being a "data scribe" that Steve describes.

  • If we compare it to a medical scribe, a data scribe would be someone doing data entry as a replacement for an automated integration between two or more systems(one of which might be a piece of paper or audio recording).

  • ...Perhaps we need data scribes in more industries. Not a single employee dedicated to one person, but a specialist in the gathering and cleaning of data, preparing it in tools that business people then use to perform their analysis, working for multiple people. Need more data? Ping your data scribe, someone that knows the structure, meaning, and location of data...

    OK, I had to double check the original publish date on this article to make sure it wasn't a re-post from 1992. 🙂
    Maybe I'm missing the point, but w
    e do have these people working in practically every mid to large organization and across all industries; they're called data analysts, ETL / BI developers, and data stewards. It's not the norm, but a lot of them are specialized and report directly to C-level executives.

    "Do not seek to follow in the footsteps of the wise. Instead, seek what they sought." - Matsuo Basho

  • "Maybe I'm missing the point, but we do have these people working in practically every mid to large organization and across all industries; they're called data analysts, ETL / BI developers, and data stewards. It's not the norm, but a lot of them are specialized and report directly to C-level executives."

    I think there is a difference here between the function we are discussing and what we think of as a Data Analyst.  I think of this much like the function of a court reporter who is focused on the capture of data as opposed to use of the data.  I recently participated in several legal deposition sessions, and in those situations there were actually people whose entire function and focus was on COLLECTING and preserving information for LATER analysis and use.  And further, I think it is important that these functions of collection of data be as unbiased as is humanly possible.  I think bias in data collection is, as the Donald says, a 'UGE' issue.

    Rick
    Disaster Recovery = Backup ( Backup ( Your Backup ) )

  • skeleton567 - Tuesday, November 20, 2018 8:49 AM

    "Maybe I'm missing the point, but we do have these people working in practically every mid to large organization and across all industries; they're called data analysts, ETL / BI developers, and data stewards. It's not the norm, but a lot of them are specialized and report directly to C-level executives."

    I think there is a difference here between the function we are discussing and what we think of as a Data Analyst.  I think of this much like the function of a court reporter who is focused on the capture of data as opposed to use of the data.  I recently participated in several legal deposition sessions, and in those situations there were actually people whose entire function and focus was on COLLECTING and preserving information for LATER analysis and use.  And further, I think it is important that these functions of collection of data be as unbiased as is humanly possible.  I think bias in data collection is, as the Donald says, a 'UGE' issue.

    So, it's unclear what type of data we're talking about transcribing here. C-level executives are rarely the source of data. They request data and are presented with reports and dashboards, so they can then provide feedback in the form of business directives. Of course there is a need to officially record and communicate those directives, but there have always been people who do that. It still just seems like we're trying to talk about Data Governance.

    "... Data governance is a data management concept concerning the capability that enables an organization to ensure that high data quality exists throughout the complete lifecycle of the data. The key focus areas of data governance include availability, usability, consistency[1], data integrity and data security and includes establishing processes to ensure effective data management throughout the enterprise such as accountability for the adverse effects of poor data quality and ensuring that the data which an enterprise has can be used by the entire organization. A data steward is a role that ensures that data governance processes are followed, guidelines enforced, and recommends improvements to data governance processes..."


    https://en.wikipedia.org/wiki/Data_governance

    "Do not seek to follow in the footsteps of the wise. Instead, seek what they sought." - Matsuo Basho

  • call.copse - Tuesday, November 20, 2018 2:37 AM

    Isn't your suggested role pretty close to a data scientist Steve? Seems fairly congruent to me if not exactly the same. Perhaps more of a data engineer?

    BTW our most senior execs are still not inclined to type their own emails - or at least not all the time...

    Probably something different. The Data Scientist, in my view, are thinking and focused on specific problems. They're a kind of user all on their own. This is more like  a data engineer, but I almost see this as a intermediate role, maybe junior that learns where things are, how to assemble them and lets people that need to analyze do analysis.

  • I would love that job.  I love mucking around in data.  It was my job until one person who loved reports, etc...left and the new guy doesn't care about them at all.  Days are long and boring now.....

Viewing 15 posts - 1 through 15 (of 21 total)

You must be logged in to reply to this topic. Login to reply