Powered by Blogger.
Showing posts with label mission hostile user experience. Show all posts
Showing posts with label mission hostile user experience. Show all posts

At the HisTALK blog 5/31/10 update, a site with thousands of readers involved in all aspects of health IT, the following anonymous (at this point) report appeared:

From Tabula Rosa: “Re: EMR usability. At one of the ONC Policy Committee meetings, [founder and CEO] Judy Faulkner of Epic supposedly declared that ‘usability would be part of certification over her dead body.’ I wonder if she has similar sentiments about making software accessible to people with disabilities?” Unverified. This inspired my new poll question – keep reading below.

Epic Systems Corporation is one of the largest health IT vendors in the U.S.

If this report is true, it would have very, very serious implications towards the healthcare IT industry's attitudes about the usability - and ultimately the safety - of its products.

The essential nature of usability and the relationship to safety is not an issue for debate - period. It was settled long ago in relation not only to IT, but also to devices and machinery that use IT. For instance, see the mid 1980's wisdom written for the U.S. Air Force on user interfaces at my eight part series on mission hostile health IT user experiences at http://tinyurl.com/hostileuserexper. Microsoft and other responsible IT vendors spend billions on usability research.

I think it incumbent of the U.S. Office of the National Coordinator for Health IT, and its leader Dr. David Blumenthal, to confirm or deny that such a statement was made, on or off-record, at an ONC policy committee meeting, and if it was made, its exact context.

If it was made, it would raise the following questions:

  • Would its utterer be saying this out of concern that their products have usability deficiencies that competitors do not, and that are not correctable in a short time frame?
  • How much concern would such a statement indicate for the complex jobs of physicians, nurses and other clinicians whose safe conduct of their medical obligations depends on health IT?
  • How much concern would such a statement imply towards the injured and dead bodies of patients affected by health IT of deficient usability?
  • Since the CEO sets the tone for their company and has the ultimate responsibility for its conduct (and its Board of Directors as well), would such a statement reflect willful negligence and perhaps criminal conduct?

The last question is pertinent, for if, say, the CEO of Boeing were to relate that "usability of the control systems of its aircraft would be an FAA certification requirement over his or her dead body", or the CEO of oil drilling companies said same about their instrumentation that helps avoid underwater blowouts, I believe it would rise to the level of criminally negligent conduct.

This is all the more pertinent to me, as my mother was just seriously injured by a medication error that appears to have started with the med list in an EMR.

I am seriously wondering, in fact, if the average hospital has the gravitas and political and technologic maturity to truly implement health IT so that the technology is uniformly beneficial, instead of spontaneously harmful, to meet the needs of the grandiose plans for national health IT.

The lack of seriousness, petty political fights, and technological dyscompetence and incompetence I have noted in my 20 years in this field do not seem surmountable in any time frame I consider "soon."

Here seems to be the health IT industry and hospital MIS department view of healthcare IT, as some sort of game to be played for profit, power and political advantage:


I present another health IT problem case from the FDA's voluntary MAUDE (Manufacturer and User Facility Device Experience) database below.

From FDA's description of MAUDE:

  • MAUDE data represents reports of adverse events involving medical devices. The data consists of voluntary reports since June 1993, user facility reports since 1991, distributor reports since 1993, and manufacturer reports since August 1996. MAUDE may not include reports made according to exemptions, variances, or alternative reporting requirements granted under 21 CFR 803.19.
  • The on-line search allows you to search CDRH database information on medical devices which may have malfunctioned or caused a death or serious injury. MAUDE is scheduled to be updated monthly and the search page reflects the date of the most recent update. FDA seeks to include all reports received prior to the update. However, the inclusion of some reports may be delayed by technical or clerical difficulties.
  • MAUDE data is not intended to be used either to evaluate rates of adverse events or to compare adverse event occurrence rates across devices. Please be aware that reports regarding device trade names may have been submitted under different manufacturer names. Searches only retrieve records that contain the search term(s) provided by the requester.

I somehow missed the following case when I wrote the Oct. 2009 post 'Our Policy Is To Always Have Unabashed Faith In The Computer ... Except When It Screws Up, And Then It's The Doctor's Fault' but I have added it there as well:

http://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfmaude/detail.cfm?mdrfoi__id=1656460
CERNER MILLENIUM POWERCHART CPOE
Event Date 11/19/2006
Event Type: Death
Patient Outcome: Death

The medication review screen of the subject device does not specify the exact dose in milligrams of combination medications. For example, narcotics are combined with tylenol in at least two strengths. Liquid narcotic tylenol-oxycodone combination is reported in ml, not mg. The exact dose of tylenol is not specified and requires knowledge of the combination medication dose in the volume specified.

Certain fields of the grid do not specify the volume, but rather state "date/time" requiring another click or pop up screen. The immediate knowledge of tylenol dosage in mg is directly related to understanding and preventing excessive doses. In the subject, 10 ml of acetaminophen-oxycodone is indicated as having been given 3 times over 4 hours. That means that 1950 mg of tylenol was administered in 4 hours while the patient was in a state of starvation and receiving other medication that increase the effects of tylenol.

This dose would equate to 11,700 mg of tylenol over 24 hours, nearly 3 times the maximum daily dose in otherwise health people. In the ensuing days, the patient developed acute renal failure, presumably acute tubular necrosis, and died. In the absence of other etiology, the excess tylenol was the culprit. This was not considered as etiology ante-mortem. The counterintuitive screen impaired the professionals. The pharmacist did not recognize and stop the medication, the nurses administered it, and the excessive dose, clinically meaninglessly listed as a volume of 10 ml -given 3 times in 4 hours- of acetaminophen-oxycodone, was missed by the physicians. Adverse events have been ascribed to "user error" by vendors.

The device offers a potent propensity to life endangering oversights. There are other screens on this device which present information that interfere with clinically useful visualization of data.
[Who designed these screens, I ask? Clinicians, or business IT personnel used to designing inventory systems for widget control? - ed.] The data does not flow to the professionals. It is not represented in a meaningfully useful manner.

The professionals need to hunt for it. As such, the user unfriendly screens [see this link on mission hostile HIT - ed.] impair safe medical care consistent with the impediment to expedient professional understanding of what, exactly, is the dose of medication and how much was administered to the patient. This sentinel case of death is directly attributed to user unfriendly screens on this device.

How many cases like this, as well as "near misses" related to health IT go unreported, nationwide and worldwide?

As in my paper "Remediating an Unintended Consequence of Healthcare IT: A Dearth of Data on Unintended Consequences of Healthcare IT", nobody really knows; these devices are unregulated with no requirements for reporting.

However, let's roll it out nationally anyway, because HIT will deterministically "revolutionize" medicine. Just ignore those spoil-the-party, man-behind-the-curtain prattle from writers like these.

We can safely ignore all contrarian research and literature, of course, as we all know HIT will revolutionize medicine from the definitive certainty of HHS in "The 'Meaningful Use' Regulation for Electronic Health Records", NEJM, Blumenthal and Tavenner (10.1056/NEJMp1006114, July 13, 2010):

The widespread use of electronic health records (EHRs) in the United States is inevitable. EHRs will improve caregivers’ decisions and patients’ outcomes. Once patients experience the benefits of this technology, they will demand nothing less from their providers. Hundreds of thousands of physicians have already seen these benefits in their clinical practice.

[Except for those who
haven't - ed.]


And our government's called BP Energy Company cavalier?

I offer no additional comments.

I recently downloaded the public beta (incomplete trial version) of Apple's new web browser Safari 4.

I like its user experience and features, presenting a main page "posterboard" of most visited or user-selected sites, a searchable, flip-panel history of visited pages (using the Macintosh OS X Spotlight and Cover Flow paradigms), top located tabs, and other useful features. (Note: I use both Macs and PC's, and hold no financial stakes in Apple whatsoever.)

What struck me was the vociferous online discussions and debates about every facet of the new browser version, down to the level of minutiae. The following review particularly struck me for its level of detail - Observations, Complaints, Quibbles, and Suggestions Regarding the Safari 4 Public Beta Released One Week Ago, Roughly in Order of Importance by John Gruber. It includes minutiae such as this:

... THE TABS

Safari’s new tab layout, placing the tabs directly in the window title bar, is a radical change. There’s no use addressing the specific details — good and bad — of this new arrangement, without first trying to figure out why Apple did this. Again, the designers are behind Apple’s wall of silence, so we’re left to speculate.

Rule out the notion that Safari’s designers undertook this change lightly. This is a major change to an important feature that many users feel strongly about. My guess is that this is an attempt to bring tabbed browsing to the masses. The biggest and most important change is that the interface for the tabs is now far more prominent. In fact, previously, the entire interface for tabbed browsing was not visible in Safari by default — in a window with just one tab, Safari’s default settings were such that the tab bar was not shown.

In Safari 4, there’s a prominent and unique “+” button that is always visible in the top right corner of every window, where the standard tic-tac button for toggling the display of the toolbar usually resides.1 Because the interface to create new tabs is now obvious, I can only assume that the point of this redesign is to encourage more people to use, or at least try, tabbed browsing.

But the problems with this new tab layout are significant.

Conceptually, the basic idea is sound. Browser tabs are, effectively, a collection of separate browser windows grouped together in a single parent window. Safari’s new tab layout makes this a tab is like a sub-window metaphor more explicit. The anchor, the conceptual root, of a standard Mac OS window is the title bar, and in Safari 4, the tabs aren’t just in the title bar, they are the title bar ...

Etcetera and so forth, on and on, as in other reviews easily found online.

In Electronic Health Records and other clinical IT, by way of contrast, reviews at this level of detail are ... nearly nonexistent (I use the term "nearly" because I authored such a review, in general terms, starting here). One reason EHR and other clinical IT user experience and performance debates are so rare is because customers are contractually forbidden to engage in them publicly. Koppel's and Kreda's JAMA paper makes that clear:

Health Care Information Technology Vendors' "Hold Harmless" Clause - Implications for Patients and Clinicians, Ross Koppel and David Kreda, Journal of the American Medical Association, 2009; 301(12):1276-1278

Vendors claim they are protecting their "intellectual property." I'm not exactly sure what IP they are holding as closely as the crown jewels.

Is it their:

  • Earth shaking, 22nd century user interfaces?
  • Secretive and ingenious widgets that revolutionize user selection from choice lists?
  • Hyper-efficient, never before seen data structures and algorithms?
  • Artificial intelligence routines that would make Captain Picard and his android sidekick Mr. Data envious?

In other words, what, exactly, is being protected by shielding commercial EHR's from external scrutiny and debate?


Is this the Secret Sauce the commercial EHR vendors seek to conceal?

The loss engendered by such policies is the reduced feedback from, and reduced interaction among endusers. This interaction occurs commonly on the Internet in 2009 on a great number of topics, but EHR user experiences are not one of them.

Companies like Apple and Microsoft, strongly user centric, encourage such debates through release of their beta's, both of enduser tools and of operating systems e.g., Windows 7 Beta. I should note that with these pieces of software, lives are not at stake, unlike with electronic health records systems.

The Veterans Health Administration makes a full working copy of VistA Computerized Patient Record System (CPRS) available as a free public download to anyone in the world here. I use it in my teaching (and am forced to do so, as commercial EHR demos are as available as, say, demos of the National Security Agency's spy and decryption software).

What, exactly, is the commercial EHR vendors' real excuse for the levels of product secrecy they maintain?

Could it be embarrassment and fear of exposure of defects, ill conceived design features and a mission hostile user experience?

"Gentlemen, we can rebuild him. We have the technology. We have the capability to build the world's first bionic doctor. Dr. Data will be that doctor; better worse than he was before. Better, stronger, faster Worse, weaker, slower." -- parody of Oscar Goldman from the 1970's scifi series The Six Million Dollar Man.


"Gentlemen, we can rebuild him."


The EMR is a technology that was supposed to improve clinical medicine (revolutionize it, some say). It was supposed to facilitate clinical medicine. It was not supposed to slow physicians and others down to the point of impairing their ability to practice medicine.

However, the rosy predictions are not proving to be the case. Instead, we have the ultimate workaround to the health IT mission hostile user experience:

Los Angeles Times
September 6, 2010

This brings real meaning to the observation that "you should not have to work around something that is not in the way."

Just one screen from a Cerner product (from a presentation touting recent addition of a simple database "search" feature that should/could have been present eons ago). Each menu item leads to even more screens, subscreens, menus and pick lists, in labyrinthine fashion. Click to enlarge.

In a domain as complex as medicine, ever-increasing demands for fine grained data on clinical encounters now outstrip the 2010-style human-computer interface's abilities to allow capture of the data without massive interference in the process of medicine itself.

This mismatch is due largely to the limitations of the GUI as the primary user interface (UI) metaphor, especially the widget-centric UI currently in vogue, characterized by massive numbers of screens and GUI widgets, labyrinthine navigation, and forced data entry of artificially and needlessly "atomized" data through interaction with multiple widgets.

CPOE as an example has become a Rube Goldberg contraption (def: "deliberately over-engineered machine that performs a very simple task in a very complex fashion"), the furthest thing from a straightforward "typewriter for orders" as can be.

For instance, a simple order requires interaction with search boxes, multiple drop down lists, scroll bars, check boxes, and other widgets to capture each micro-component of the order, wasting much time compared to writing "Sotalol hydrochloride 120 mg PO BID, first dose now." There are alternatives to "data atomization" and "widget-centricity" in the health IT user interface, apart from simply cleaning up the current interaction disorganization and other weaknesses, but the health IT industry seems largely oblivious to alternatives.


Professor Butts and the Self-Operating Napkin: EMR's have become machines that perform simple tasks in a very complex fashion


Unfortunately, it's difficult to show this complexity using actual EMR images, as most health IT vendors avoid posting screen images and user manuals online, and forbid customers from doing so. They are excessively secretive about their products. Try a Google image search on 'Cerner Millenium' as an example (click here), then compare to an image search on, say, Microsoft Word (click here).

The inappropriate-for-medicine, management information systems (MIS)-derived business model of the healthcare IT vendors and HIT ecosystem also contributes to the, at best, stuck-in-the-1980's health IT user interface. (As an example of these issues, the industry wouldn't even listen to aforementioned UI alternatives even if I served them up on a silver platter, because using the advice would require significant investments on their part to incorporate alternative UI approaches into their products, meaning lower short and medium term profits. Unlike pharma and tangible medical devices, interest in advanced R&D in the health IT industry seems nil. Instead, complacency rules.)

An important question to ponder is whether the dream of the health IT pioneers back in the 1950's and 1960's was too idealistic and indeed unrealistic to begin with. Was it based on "2001, A Space Odyssey"-style overoptimism, and the lack of foreknowledge of how little true progress would be made in the commercial IT market in human computer interaction, artificial intelligence, natural language processing, voice recognition, and other innovations by the 21st century?

Doctors have embraced the scribes as well. "The physicians were spending too much time documenting and not enough time with the patient," said Dr. Robert Steele, chief of Loma Linda's emergency department, which began using scribes in November. "The solution was to take the doctors off the computer, put them at the bedside, and let the scribe do the transcription. It's been a huge success. The physicians love it.

It is not hard to understand why physicians, with their years of training and expertise, would welcome relief from extremely tedious clerical tasks.

Leaders of the three biggest companies providing scribes estimate that about 200 emergency departments in community hospitals and academic medical centers currently use them. More scribes are on the way. Ronald Reagan UCLA Medical Center, Emory University Hospital in Atlanta and Beth Israel Medical Center in New York City said they are exploring the idea. Physicians in other specialties, including urology and family practice, also are starting to adopt scribes.

Still, some physicians question whether college students are equipped to handle the complicated task of charting patients after only two to four months of training. Others wonder why it's necessary to hire additional staff to fill out computerized records that were supposed to be simpler and more efficient than paper.

The key phrase is "were supposed to be simpler and more efficient" than paper. I'd likely be hard-pressed to find robust research supporting that assertion in the scientific literature. I'd be more likely find the origins of this meme in vendor marketing materials.

"It will be interesting to watch whether the need for scribes goes away as the next generation of physicians who grew up with computers and electronic medical records comes in," said Dr. Ann O'Malley, a senior researcher at the Center for Studying Health System Change in Washington, D.C.

This passage implies the bottleneck is those physicians who need to "get used to the IT", whereas a major component of the problem is the health IT user interface itself. Scribes might "go away" if the health IT user experience was vastly improved. The IT needs to become more physician and medicine-friendly.

At Loma Linda [Hospital], Steele said doctors used to spend two minutes with a patient, then take four minutes typing the information into a computer. Now the doctor talks to the patient with the scribe present and summarizes the encounter to the scribe in 30 seconds. While the scribe spends three minutes entering the information into an ever-present laptop, the doctor can spend extra time with the patient.

Afterward, the doctor checks the accuracy of the scribe's chart, makes any necessary additions or corrections, and signs off. Although novice scribes sometimes need the doctor's help in understanding terminology, those with several months' experience usually are spot-on, Steele said.

Again, clerical work is a very poor use of a physician's time. Scribes are a good idea considering 2010's EMR technology, at least from the time/skills perspective.

... [Dr. Michael] Murphy of ScribeAmerica estimates that doctors can see eight additional patients over a 10-hour shift, hiking Medicare revenues alone by $91 an hour.

The companies that develop and sell electronic medical records systems are "in total denial" about how complicated they are for doctors to use, [Dr. David] Strumpf said. "They know these systems need scribes," he said. "They work with us to train our scribes on their systems, but they don't want to be public about it."

(One wonders how much in "denial" the companies are and just who is truly in denial; after all, purchase of these systems just became a governmental priority.)

Here, of course, is the major drawback to scribes: money. Scribes "typically cost $20 to $26 an hour" today, and that number is likely to rise. While the article's contributors maintain that physicians can boost their revenues by "$50 to $60 an hour" using scribes, I wonder if the overall economic impact of the generalized use of tens or hundreds of thousands of EMR scribes would be in the "wrong" direction (i.e., from the payor and government perspective). The billions spent on EMR's were supposed to reduce the costs of healthcare, not increase the expenses associated with it.

I also wonder what could happen when a scribe is not available.

At the University of Virginia Medical Center in Charlottesville, Va., emergency room physicians can complete electronic charts just as fast as scribes, most of whom are pre-med students at UVA. But doctors would rebel if the scribes disappeared, said Dr. Robert Reiser, medical director of the scribe program, which the university runs itself.

Sept. 10 Addendum:

See an interesting financial analysis by Doug Perednia here.