Full Transcript

·YouTLDR

AI in Health Care - Promises and Concerns of Artificial Intelligence and Health | UC Davis Health

39:08EnglishTranscribed Jul 26, 2026
0:00

(gentle music)

0:07

- Hello, and thanks for joining us

0:09

for this discussion on the topic of health care

0:11

and artificial intelligence or AI.

0:14

I'm Pamela Wu, Director of News

0:16

and Media Relations here at UC Davis Health.

0:19

Today we are joined by two experts on the topic

0:22

of AI in healthcare, Dr. David Lubarsky, CEO of UC

0:26

Davis Health and Vice Chancellor of Human Health Sciences,

0:29

and Dennis Chornenky, former advisor

0:31

to the White House on AI

0:33

who joined UC Davis Health this year

0:35

as our first AI advisor.

0:38

Dr. Lubarsky and Dennis, welcome. Thanks for being with us.

0:41

- Thank you. It's a pleasure. - Yep.

0:44

- I sort of want this to be a free flowing conversation.

0:46

I know both of you have a lot

0:47

of really interesting thoughts on AI

0:49

and I wanna start by saying

0:51

that if you ask the average person what comes

0:52

to mind when you say AI in healthcare,

0:54

they're probably thinking of analyzing patient data,

0:57

helping to make diagnoses,

0:59

but there is so much more than that.

1:01

How is UC Davis Health approaching AI's role in

1:05

patient care and health?

1:07

- Well, I think the first

1:08

and most important thing to say, Pamela, is

1:10

that doctors and nurses are in charge.

1:13

Doctors and nurses will always be in charge of

1:17

not only the decision making,

1:18

but in being the partner

1:20

to the patient in the decision making.

1:22

And, you know, AI is artificial intelligence, but it's not.

1:25

In healthcare, it's really augmented intelligence.

1:27

It's about giving your doctor

1:30

and your nurse more tools to make better

1:33

decisions for the patient.

1:35

- Yeah, there are a lot of areas

1:39

where AI can make a big difference, of course.

1:40

So the patient provider relationship,

1:44

but also on the administrative side,

1:47

operations business side, how health systems,

1:51

large academic medical centers think about

1:54

workforce transformation, creating better recruiting,

1:58

retention career paths for people in all the different roles

2:03

that are involved in patient care

2:05

administration and everything else.

2:06

So I think we're looking at all of those things very broadly

2:09

and looking to advance a holistic AI strategy

2:13

that helps us really answer kind of key questions

2:15

of why we wanna adopt AI in the first place.

2:18

Whom will it really be benefiting,

2:19

and in what ways can we do that.

2:21

How do we ensure safety when we are adopting it?

2:24

And then which use cases and applications

2:26

and in which areas do we really wanna pursue and prioritize?

2:30

- Patients want their care personalized to them.

2:33

We hear this over and over, we aim to deliver that.

2:37

How big of a role could AI have in personalizing medicine?

2:41

- Well, I think AI is actually the route

2:45

to getting truly personalized recommendations.

2:47

And we are using AI already, just, we don't know it.

2:52

When Amazon sells you the reading lamp that goes along

2:57

with your book purchase, it knows you know

2:59

what you want, right?

3:01

And then it recommends a movie

3:02

that might be along the same lines, right?

3:04

It's running algorithms in the background all the time.

3:07

So number one, those personalized recommendations

3:11

foundationally are from AI.

3:13

There's no reason we can't apply,

3:15

and we are trying to, that same thinking, if you will,

3:20

to make all the past decisions and all the past diseases

3:24

and all the past labs that have ever shown up

3:26

on a patient's chart help inform

3:28

what the next step should be for that patient

3:31

in their journey towards wellness.

3:33

And so I think that when you take a step back

3:37

and you realize that self-service is the future, right?

3:42

I don't know the last time you called a travel agent,

3:44

my memory doesn't go back that far, right?

3:46

Everything is now computerized and organized for us

3:50

and recommended for us.

3:51

So it's the same thing.

3:53

So we're used to self-service,

3:55

especially the younger age group.

3:57

And there's a study that came out recently that said 44%

4:01

of young adults, 18 to 34 believe that by using the internet

4:05

and chat GBT, they can know as much

4:08

as their doctor about a disease process.

4:10

- Okay. - A little scary, right?

4:12

- Yeah. - I'm just telling you

4:13

that that's- - Not really true.

4:15

- No, it's not true. But the point is, we are evolving to

4:19

where people expect to quickly master a topic

4:23

and become a true partner in their care.

4:25

And I think that's where this is going.

4:27

Self identification of a problem, self-diagnosis,

4:31

self triage, and self-treatment, if guided correctly

4:35

by health professionals, could truly extend our ability

4:40

to serve what is an ever burgeoning need,

4:42

and questions about personal healthcare.

4:44

- So that's what I was going to ask, right?

4:45

Like, what does self-service healthcare look like?

4:49

But also that sort of becomes our job, if you will, to sort

4:52

of thread that needle to ensure

4:54

that we are providing the service,

4:56

the self-service opportunities that patients want,

4:59

but also ensuring that the care they receive is sound.

5:02

- Right, and so that means that you can't just,

5:06

it's just like anything else, right?

5:07

You just do a, a search on the internet today

5:09

or in chat GPT, you can get a bunch

5:10

of stuff that isn't right.

5:12

So the databases to which,

5:14

and the large language models that generate stuff

5:17

for patients have to be vetted

5:19

or constructed in such a way that erroneous

5:22

and errant information won't show up.

5:24

It has to be carefully tested.

5:26

And that's why that's last on the list.

5:28

What's first on the list? I have my iPhone here on purpose.

5:31

It's a prop, right? Why is it a prop?

5:33

There's a one out a million chance, a one out

5:35

of a million chance it will open up

5:37

for another face other than mine.

5:39

Now, facial recognition is great. I dunno about you.

5:42

It's incredibly reduced my need

5:45

for passwords and everything else.

5:47

It is computer vision, that's part of AI.

5:51

It can read chest x-rays as well

5:53

as it can read the lines on my face.

5:55

We need to be employing that. It's very, very accurate.

5:59

It also can be used for evil.

6:01

The Chinese government does a tremendous amount

6:03

of facial recognition software all around looking

6:06

for protestors and whatever.

6:07

That's not okay. That doesn't mean we shouldn't use facial

6:11

recognition on our iPhones, and it is the control of,

6:14

the direction of, and the positive social

6:17

good by mastering technology

6:19

that will drive AI to the forefront.

6:22

- Dennis, what are your thoughts in terms of

6:24

personalizing medicine, in terms of self-service,

6:27

especially since you've worked in like the regulatory space

6:30

and in terms of government?

6:31

What goes through your mind when you think about people sort

6:34

of helping themselves to diagnoses, if you will,

6:37

talking to, right chat GPT about their own care

6:41

and what concerns might regulators have about that?

6:46

- Yeah, I think certainly there's a reason why, you know,

6:50

we have medical schools and licensing.

6:53

- Yes please. - Residencies and all

6:55

of these things, so I think it's very important that

7:00

we build off of that infrastructure,

7:02

that value infrastructure and that responsibility

7:05

and those guardrails that we do have in place.

7:07

At the same time, at least personally,

7:10

I feel like we haven't always done a great job as a society

7:13

of educating consumers and patients

7:16

about how to really achieve wellbeing

7:19

and wellness in their lives.

7:21

There is a little bit of a mentality

7:22

that if the tiniest thing is wrong with you, you go

7:25

to your doctor and your doctor's gonna fix it.

7:26

That it's, you know, your wellness

7:28

is your doctor's responsibility in some ways.

7:31

And of course, it's primarily our responsibility starting,

7:34

you know, as patients, as consumers.

7:37

And so to the extent that, you know, AI,

7:40

especially generative AI technologies can help consumers

7:43

can help direct them to live healthier lives.

7:46

They're gonna need less care.

7:48

And when they do need care, they will have better guidance,

7:51

I think, on the kind of care that they might need,

7:53

how to connect with the right professionals

7:56

and how to stay on course, you know,

7:57

with the right recommendations

7:58

and why it's important to listen to medical professionals.

8:02

- When it comes to AI and healthcare and its implications,

8:05

what else are regulators keeping a close eye on?

8:08

- Yeah, the regulatory environment's very interesting.

8:10

That conversation has rapidly accelerated,

8:13

especially in the last few months.

8:14

You know, there've been a lot of discussions

8:16

and things over the last few years,

8:17

but over the last few months we've

8:19

seen some really interesting things happening.

8:21

Of course, we had the AI executive order coming out

8:24

of the White House towards the end of October

8:28

that builds on some previous executive actions,

8:31

but really takes it further now,

8:33

looking at more specific requirement for the private sector.

8:38

Not just directing government to ensure AI safety

8:40

and government AI systems and government use,

8:44

but how our markets in the private sector can help

8:49

ensure consumer safety and patient safety

8:51

with the use of AI technology.

8:52

So things like watermarking AI generated content,

8:56

for example, or other forms of disclosure so that folks know

9:00

that they're speaking to an AI chat bot rather than,

9:04

you know, a chat bot pretending to be a human, to try

9:06

to create a more human experience or something like that.

9:09

I think it's very important that we always help make people

9:12

aware of what exactly they're interacting

9:14

with and in what ways.

9:16

And there are a lot of implications from

9:21

these regulations that are coming out, including the AI Act

9:24

and the EU that's still kind of being discussed

9:26

and advanced that health systems,

9:30

academic medical centers are really gonna have to, you know,

9:33

get more thoughtful about their adoption of AI

9:36

and how we think about governing AI.

9:40

Another thing that's coming out of,

9:42

in the regulatory environment, at least

9:43

for the federal government, is that federal agencies are

9:45

gonna be required to have AI governance boards

9:48

to ensure safety, efficacy, ethics of AI systems,

9:52

and also the requirement to have chief AI officers

9:55

or advisors, somebody leading that function.

9:58

You know, I think currently in academic medical centers,

10:01

health systems, you know, kind of large enterprises broadly,

10:04

we have technology groups, we have IT departments,

10:08

and there's typically some people

10:09

with some AI expertise within there.

10:11

And there are some budgets for AI applications

10:14

or vendors kind of within larger IT or software budgets.

10:19

But we're really getting to a point where we have

10:21

to start looking at AI, you know, more specifically

10:26

and creating more specific mechanisms

10:27

and groups with that expertise to help guide prioritization,

10:33

adoption, monitoring of those kinds of technologies

10:37

for different organizations.

10:38

And so I think that regulation is trying to go in

10:41

that direction, but it's very important, you know, policy

10:43

and lawmakers I think are doing their best

10:46

considering they do have kind

10:48

of a gap in understanding these technologies,

10:50

but they're listening to a lot of people in the private

10:52

sector, and they're doing their best to try

10:54

to strike a balance between ensuring safety

10:57

and allowing innovation.

10:59

- A common thread that I'm hearing in your comments is that

11:05

it's about shared responsibility, right?

11:07

So much shared responsibility and agency as well.

11:10

And you actually started off this conversation,

11:12

Dr. Lubarsky, by saying the humans are still in charge.

11:14

- Yep. - Your doctor, your clinical

11:16

staff is still in charge.

11:20

And so that was sort of, you know,

11:22

what I was thinking in terms of like,

11:23

who is ultimately responsible when AI is used

11:26

to support decision making and patient care.

11:27

You've made it clear it's the people.

11:29

- It's the people. - But like, what is

11:30

the relationship between artificial intelligence

11:33

and human intelligence in terms of

11:35

how they reinforce one another?

11:37

- You know, so that's a great question.

11:38

A lot of people think that AI exists.

11:40

It's a magic thing, right? It's not a magic thing.

11:43

It's ability as a computer.

11:46

- It's a tool. - It's a tool.

11:48

Just we used to, right, not be able

11:51

to copy and paste from Microsoft Word to PowerPoint, right?

11:55

I mean, it's about integrating data and information

11:59

and then, but someone still has to make up

12:01

the PowerPoint presentation, but it's easier now, right?

12:04

It's the same thing. So we're working with a company

12:06

that does remote patient monitoring,

12:08

and right now it has eight different vital signs

12:13

that it collects every minute of the day.

12:16

That's 1,440 minutes, eight vital signs each minute.

12:22

Okay, that's 11,500

12:26

or so data points per patient.

12:29

Right, and it can, in beginning you applying AI,

12:34

which looks at patterns of these vital signs can very, very,

12:38

very early on detect who might be deteriorating,

12:43

allowing the doctor and the nurse to keep a closer eye on

12:47

that patient, to intervene earlier,

12:49

to be prepared for a deterioration.

12:52

It's not telling the doctor what to do,

12:54

and then they're gonna eventually expand it to 16 variables.

12:57

Now there'll be 24,000 data points per day per patient.

13:03

A human being can't process that.

13:06

And they can't say, oh, you know, this variable moved here.

13:11

And then in relation to this one, it moved here.

13:12

It's just too complicated for the human brain.

13:14

But AI is built to analyze those patterns.

13:18

So number one is pattern identification.

13:22

Extremely well developed in AI.

13:25

The decision making that stems

13:27

from that pattern identification,

13:28

that we are not yet ready, right, to seed at all,

13:32

because there's bad data, there's incorrect information.

13:36

AI doesn't generate any new thought.

13:38

It just looks at all the stuff that's been done before,

13:42

including vital signs that have been taken

13:43

before to identify things.

13:46

So we have to understand what AI is really doing for us.

13:50

And I'll say another thing.

13:52

Two thirds of patients would like the doctor

13:55

and their medical record to know all the information

13:58

collected on this prop my, iWatch, okay,

14:01

or your Fitbit or whatever.

14:04

There's too many data points. - [Pamela] Yeah.

14:06

- You can't, how well I slept,

14:08

how many minutes did I toss and did I turn?

14:11

- It's like everything about you all the time.

14:13

- Right. - Yeah.

14:14

- But it could be incredibly valuable if an AI engine

14:18

was running behind it and said

14:19

I've looked at your sleep pattern

14:21

and you're not sleeping through the night anymore.

14:25

What are the causes of that? Are you drinking alcohol?

14:28

Are you anxious? Have you changed your pillows?

14:32

Are you having allergy attacks in the middle of the night?

14:34

It prompts your doctor to ask the right question.

14:38

They can't possibly, them or the nurse,

14:40

have time to parse through all that data.

14:42

- [Pamela] Right. - AI will make your

14:44

care more personalized.

14:46

And it doesn't have to mean it's making the decisions either

14:49

for you or for your doctor. It just is packaging ideas

14:54

and information in a way that prompts

14:57

that personalized attention.

14:59

- So you talked about pattern identification.

15:01

It's excellent at that.

15:03

Dennis mentioned earlier, another important type of AI,

15:06

generative AI, and this is the AI

15:08

that generates new data, text or other

15:11

kinds of media stuff like chat GPT.

15:13

- Yes.

15:14

- What is the...

15:15

- I have that on here too. - (laughs) Okay.

15:17

Of course you do.

15:18

What is the role of generative AI in

15:21

healthcare and where do you see that headed?

15:23

- Well, more than 40, oftentimes more than 50%

15:28

of the time that nurses spend are spent writing notes

15:31

and documenting what they've done.

15:35

None of that is necessary.

15:37

For physicians, their biggest complaint

15:39

is filling stuff in about patient

15:42

visits into the electronic medical record.

15:44

We have added very low value interactive time

15:49

with keyboards to the most expensive labor like

15:53

in the United States, right?

15:55

We've turned our brightest and best

15:58

and most compassionate healthcare providers into typists.

16:01

And so what generative AI will do is free them.

16:04

It doesn't mean that we will let AI write the notes.

16:07

I mean, they will write the notes.

16:08

We'll still be responsible for what's in the note, right?

16:10

- Right 'cause it's a tool. - Because it's a tool.

16:12

But that tool can erase the burden.

16:16

It can eliminate, right, the contribution of overzealous

16:22

documentation leading to burnout.

16:24

It's not a fun thing to do. It's repetitive.

16:27

It is thankless, and to be honest with you,

16:29

it so often is populated with irrelevant things

16:33

that it's a true waste of your time.

16:35

So I can't wait and that, by the way,

16:37

is the number one initiative that

16:39

we are pursuing here at UC Davis Health,

16:41

because we care about our providers.

16:44

Because when we care about them,

16:45

they're able to care for their patients.

16:47

- That's right.

16:48

- What a time saver, right.

16:50

- Huge. - And just like the

16:51

mental energy too.

16:52

- Yeah. - Yeah.

16:53

- And if you imagine, I dunno, when the last time you

16:56

or anybody out there might be watching this went

16:58

to a doctor's office, there's always a keyboard

17:01

and a screen either between you and the doc.

17:03

- Yes, yes, yes. - And the nurse

17:04

or off to the side,

17:05

so they're constantly talking to you,

17:07

and then they turn around and-

17:08

- Typing. - Exactly.

17:10

We're gonna eliminate that.

17:11

We're gonna eliminate the electronic barrier

17:14

that we have placed between patients and providers.

17:16

And that means- - And generative AI

17:17

is gonna do it,. - And that means better care.

17:19

- Yes.

17:19

- Yeah, the really interesting thing

17:21

with generative AI is that, you know, it's just one

17:25

of many different AI ML methodologies,

17:28

but it's really having its day right now,

17:30

it's had a huge leap in terms

17:31

of its technological capability

17:33

and the public, you know,

17:35

our society has just been enamored

17:37

with what this can do.

17:38

And one of the reasons is that it's very versatile.

17:41

It's very powerful. It can write code, it can, you know,

17:44

help your child do their homework.

17:47

It can help a physician, you know, diagnose a disease

17:51

or come up with a treatment plan.

17:52

It can, the same foundation models can do

17:54

all these different things, right?

17:56

So it's a tremendously exciting time.

17:57

And I think generative AI will have more transformative

17:59

impact on healthcare in, let's say the short

18:03

to medium term than any other type of

18:05

AI machine learning methodology.

18:07

I think others will probably have their day in the next

18:10

10, 20, 30 years, very difficult to predict

18:12

which ones exactly those will be.

18:14

But right now is really the time of generative AI.

18:17

And to that, thanks to Dr. Lubarsky's vision

18:20

and our CIO and Chief Digital Officer,

18:22

Dr. Ashish Atreja, we just launched,

18:26

had a very successful launch

18:28

of a new collaborative bringing health systems together.

18:30

We've now got, I think around 40 health systems

18:33

and leading health systems

18:34

and payers, academic medical centers,

18:36

covering the entire country that have come together

18:38

to help advance the responsible adoption

18:40

of generative AI technologies.

18:42

So really focused on execution, valid identification,

18:45

discovery, validation of use cases across

18:49

our member organizations to help build

18:51

that capacity mutually together, because in isolation,

18:55

these technologies are just moving too quickly for us

18:58

to be able to, I think, for any one organization

19:01

to really be able to figure it out on its own.

19:03

You know, there's so many research papers coming out

19:09

on generative AI right now.

19:10

You know, it was near zero, you know, per month

19:14

in certain publication databases,

19:16

you know, even a year and a half ago.

19:18

But now it's getting to hundreds per month

19:20

and, you know, very quickly climbing,

19:22

it seems like it's doubling every few months.

19:24

And so the joke is that we're gonna need generative AI

19:26

to help us understand research on generative AI.

19:28

And it's actually maybe not so much a joke.

19:30

- That's so meta. - It's just true.

19:31

- So it's- - Well you know, again,

19:33

I always like to say where am I seeing

19:35

generative AI being used and is it useful, right?

19:38

And so now if you go to Amazon,

19:40

sorry, I spend a lot of time on Amazon, right?

19:42

And you wanna parse through 14,000 reviews,

19:45

how do you do that? Amazon doesn't even make you do that.

19:48

Now at the top of the review section-

19:50

- That's right. There's a blurb.

19:51

- There's a blurb. - AI generated.

19:52

- AI generated.

19:53

Now that doesn't always mean

19:55

that all the information you're seeking,

19:57

but it's a pretty good summary.

19:58

It's a pretty good summary and it's very pertinent.

20:01

And it's the same thing we've done,

20:03

like I'm a little worried about the patient's hemoglobin,

20:05

and you can ask the record,

20:07

please provide all the hemoglobins

20:09

that have ever been drawn on this patient

20:11

for the last 10 years.

20:13

Date, time, and you can have

20:15

a table generated for you, right?

20:18

Where it would previously take a long time for a doctor

20:21

to parse through all the individual labs drawn, right?

20:25

The capability of, again, personalizing the care by

20:29

extracting with a simple query

20:32

all the pertinent information that you need.

20:34

And then you could ask chat GPT,

20:38

although talk about this, okay, what are all the causes

20:41

of a low blood count, a low hemoglobin in a patient?

20:44

And, you know, you've thought about 39 of the 40

20:46

and go, you know what, I hadn't thought about

20:48

that 40th one, it's not saying what you should do.

20:51

It's saying it's doing a complete information search for you

20:55

so that you don't ever forget anything.

20:58

You know, when the iPhone came out, people,

21:02

well, who needs all this stuff?

21:02

Well, we do, right and I have to say, I had a sort

21:06

of photographic memory for medical stuff when I was young,

21:09

and that was very special, but it's not special anymore

21:13

because it's not needed anymore.

21:15

In a second, you can get the information

21:17

you want on a good Google search, let alone chat.

21:19

Chat GPT can give you some false information.

21:21

- Right, it's not always, evidence isn't always sound.

21:24

- But the next generation of Chat GPT will provide

21:29

references if you want them for each

21:31

of its recommendations or statements.

21:33

Once that happens, we can now get the validation

21:36

and verification that it was a correct interpretation.

21:39

You have to do some work.

21:40

Eventually we'll get to the point where

21:43

that validation verification will be monitored

21:45

by another AI program.

21:46

- Right. - Right.

21:48

Just to make sure, right, that it's not

21:50

just making this stuff up.

21:51

- Right, that's that shared responsibility again.

21:53

- Right, so again the future of healthcare,

21:57

and I'm gonna say this again, is not

21:59

to do low value repetitive work

22:01

that is about information searches

22:03

across large databases.

22:05

It is about understanding the implications of a disease,

22:09

the treatment pathways, there's always more than one,

22:12

the preference trade-offs, right?

22:14

Some more aggressive treatments lead to a poorer life,

22:17

but a longer life, right?

22:19

Those discussions will never be run by AI.

22:22

Doctors will become the partners

22:24

for personalized healthcare decision making,

22:26

'cause they are freed from spending all their time trying

22:29

to find out some arcane information.

22:33

- So I've heard from both of you what you're excited about,

22:36

what the best potential benefits are of AI in healthcare for

22:41

patients, for providers, for employees and employers too.

22:46

But let's talk about the cons.

22:48

What do you think warrants skepticism

22:51

as we see more AI in healthcare?

22:53

What issues and challenges are you keeping an eye on?

22:56

- I think one of the biggest dangers with AI, especially

23:00

with chat GPT, it's too easy to use.

23:03

I mean, it really is.

23:05

- It's so easy. - Yes.

23:06

- It's stupid easy. - And you might be

23:08

tempted as a care provider

23:10

to say, I'm not sure what to do.

23:11

I'll just look it up on Chat GPT.

23:14

And because it's so easy to use

23:16

and you're always so busy, you might actually

23:21

accidentally or shortcut it and say,

23:23

yeah, that sounds right.

23:25

And so we made it really clear actually,

23:27

that our healthcare providers cannot, should not,

23:30

and will not ever see judgment

23:33

or courses of treatment to what's suggested on the internet,

23:38

and specifically with chat GPT.

23:40

- [Pamela] Is this formalized somewhere?

23:42

- It is. We actually added an AI paragraph

23:45

to our medical staff bylaws about, you know,

23:48

what constitutes the responsibility

23:50

of the physician to the patient.

23:52

And we made it really clear that they were not

23:55

to ever rely on that in terms of driving

23:58

their decision making.

23:59

- Well, and sometimes the training data in these models

24:01

will get actually mixed up when it's producing answers.

24:05

And I mean, I've had instances

24:07

where I've asked about whether

24:09

or not there are current clinical trials happening,

24:11

or recent clinical trials in a very specific area

24:14

that I had interest in and Chat GPT would come back

24:18

and say, oh yes, there's four trials that are ongoing.

24:21

And they were completely made up.

24:22

It looked like it drew from 12 different trials

24:24

and conflated them into somehow being in

24:27

the category of what I asked about.

24:29

And I was surprised at first 'cause

24:30

I'm not aware of these trials,

24:32

you know, going on in these areas.

24:33

And when I looked it up, surely-

24:35

- Because they don't exist. - None of them existed.

24:36

None of them existed.

24:37

So, there is this potential for, you know,

24:39

what are called hallucinations, these kind

24:41

of fake responses and so this is one

24:45

of the reasons it's so important

24:46

to double check everything for human beings.

24:48

We're just not at the point where, you know,

24:50

the large language models failure rate, you know,

24:54

is one in a million or one in a billion.

24:56

It can be a lot more frequent.

24:57

And it's also a bit of a social choice

25:00

or choice for us in terms of technology

25:04

and how we want to use it.

25:06

Because in some ways, hallucinations actually

25:09

can be a measure of creativity in a model.

25:12

So if you completely want to eliminate the potential

25:16

for hallucinations, and maybe we want

25:19

that in certain environments, right?

25:21

You're really reducing that model's ability only

25:23

to very precisely and almost verbatim kind

25:25

of spit back things that it's gotten from its training data.

25:28

But if we want to give it a little bit more flexibility

25:30

for interpretation or for suggestions, right,

25:33

or for creative solutions to certain problems,

25:37

we sort of have to set the

25:38

parameters a little bit differently.

25:39

And this is where we may have a higher likelihood

25:42

of slightly unusual or crazy responses or hallucinations.

25:45

But I think it's the same way with human beings, actually.

25:47

You know, when we want creativity-

25:49

- Yeah, thinking outside of the box.

25:50

- For human beings, yeah we want

25:51

a bunch of different ideas thrown on the table-

25:53

- Including wild ones. - Yes including the wild ones.

25:55

Sometimes there may be some kernel, you know, of truth

25:57

or insight that's, you know,

25:58

that can come from unexpected places.

26:00

And so, you know, that's I think a social conversation

26:03

and how our interaction with this technology

26:06

will evolve over time.

26:08

But I think for, you know, environments like ours

26:11

in healthcare, especially now in the earlier kind of stages

26:15

of these technologies, we really

26:16

need to err on the side of caution.

26:17

- Right and I think the key here is like, the part

26:21

that worries us is way down the road.

26:23

It's five years, 10 years

26:25

before we'll have the right level of insight into data

26:30

to really let AI really suggest treatment suggestions.

26:34

But all the rest of it's really worked out

26:36

and we're just not employing it.

26:38

Vision computing, ambient computing, listening,

26:41

generative AI which says, just says, you've just talked

26:44

for 17 minutes here, let me summarize what you said.

26:47

And I can do that in four sentences,

26:50

'cause you've really been talking a lot

26:53

and not saying a lot, but right,

26:55

and so all those, all of that already exists

26:58

and summarizing not always perfectly what has been written

27:01

by others like Amazon on the review sessions, right?

27:04

All that stuff exists and pattern recognition, that's great.

27:08

And facial recognition.

27:10

We can do all of that and not seed one ounce

27:14

of responsibility or decision making to computers.

27:17

We can make doctors more efficient.

27:19

And give you an example, breast mammograms, right?

27:24

You really need a trained breast radiologist

27:27

to get the best possible result when to get them read.

27:30

Well, when they added AI into the mix

27:32

with breast trained radiologists,

27:34

they were able to actually

27:37

cut the number of people required

27:39

to do a day's worth of readings in half.

27:41

You may say, oh, someone's gonna lose their job.

27:43

And I'm like, no, no, actually only half

27:46

the women in America who should have their breasts done

27:50

for mammograms get them read.

27:52

Imagine if we, without adding one penny

27:55

to the labor workforce, we can now get to 100% of women

27:59

and have their breast mammograms read

28:02

by professional- - Spending access to care.

28:05

- Yeah. - Yeah, doing more

28:07

on behalf of the patient.

28:08

- Right, we will never, ever be able

28:10

to catch up with the demand right now

28:12

because of the aging of the population,

28:14

the expansion of the possibilities,

28:17

and hopefully a continuing journey towards wellness

28:19

for a much longer period of time in life,

28:22

we need to change how we work.

28:25

We will never be able to fill the

28:26

gap by just training more people.

28:28

AI allows us to change the work that we're doing.

28:31

So we're all working at the very top of our capabilities

28:34

and all the low level stuff like a normal

28:37

breast mammogram can be read by the computer

28:40

and you don't, all you need is the doctor to say,

28:42

yeah, yeah, there's nothing there, right,

28:44

as opposed to them doing the full reading.

28:46

It is gonna make us better at treating people

28:50

who need to be treated.

28:51

- Such an important point too about not

28:54

reducing the workforce, but rather expanding

28:57

the access and the care.

28:58

- Yes. - Expanding possibilities.

29:00

- Yes. - Yeah.

29:01

- Okay. Let's talk about the equity piece too,

29:05

because as AI is looking at existing historical data,

29:11

there are patient populations that historically

29:13

and now still are not receiving the level of care

29:18

that they should, that medicine has not served

29:23

as well as it should.

29:25

How do we make sure that we're not perpetuating inequities,

29:29

right, by looking at old patterns

29:31

to inform new ones?

29:33

- That is an incredibly important topic.

29:35

And I will use a couple concrete examples.

29:38

We know for a fact that when black

29:40

and brown children come to the emergency room,

29:42

they don't give them as much pain meds as a white child.

29:45

I mean, there you can't find a doctor

29:47

or nurse who is saying, I'm purposefully not giving,

29:50

you know, someone who looks different less medicine.

29:53

But that's what you do when you...

29:55

So how does AI help that?

29:56

- Right so when you look at the data,

29:59

there's implicit bias.

30:01

- Correct, so if you just said to an AI driven engine,

30:04

how much pain medicine should I,

30:06

seating responsibility, give to this child?

30:09

If it just looked at all the medical records

30:10

in the United States and said,

30:12

well, on average this child would need three

30:15

milligrams of morphine and this white child would need

30:17

four milligrams of morphine.

30:18

'Cause that's all that exists in the database.

30:21

- Right so it's like just as little as before.

30:23

- Yes. - Do that again.

30:24

- So, right, and so we have to be very, very careful

30:27

that we don't institutionalize the biases.

30:30

And, but here's the thing.

30:32

The way out of that, it also turns out

30:34

that it turns out it's often not the

30:36

color of someone's skin.

30:37

It's their familiarity with English.

30:40

That if you don't speak English as a first language,

30:42

you're unable to communicate as well the desires

30:46

for additional treatment or a different expectation.

30:49

And so that leads to undertreatment and inequity in care.

30:53

Well now what can AI do?

30:55

It can say, this person,

30:57

they're listening, doesn't speak English that well,

31:00

let me do simultaneously automatic translation from their

31:04

native tongue to your native tongue.

31:07

So that that expectation and that of care

31:11

and the ability to be concrete about

31:14

or nuanced rather not just concrete nuanced about do I

31:16

need more pain medicine or not?

31:18

That discussion can occur in that patient's own language.

31:21

So AI could fix the very problem

31:23

that if you depended on it for

31:25

just a treatment recommendation, that would be bad.

31:27

But it also has the opportunity to literally

31:30

eliminate the problems in my, you know,

31:33

with translation needs.

31:35

- It's making it work for you.

31:36

- Yes. - Yeah.

31:36

- Yeah, so in order to enable more

31:38

and more of exactly these kinds of examples

31:41

that you just gave, what we really need to do is provide

31:44

machine learning models and technology companies

31:48

that want to train models and create models

31:51

better access to more diverse,

31:52

more equitable data sets.

31:54

So here at UC Davis Health, we have, I think,

31:56

one of the most diverse patient populations

31:59

communities in the country that we serve.

32:02

And that makes our data sets actually very valuable

32:05

in that regard and there are certainly

32:07

other academic medical centers

32:09

that also have a lot of very valuable data,

32:12

but historically healthcare data has been so siloed

32:14

and so difficult to access

32:16

and even difficult to discover to begin with, even knowing

32:18

who has what or how you would get access, even internally

32:21

within your own organization.

32:23

You know, you may be trying to build a model

32:25

to better serve a particular patient population,

32:27

but it's very hard to get access to the data that you need.

32:29

So one very interesting thing that I think is going to help

32:33

with this that was actually mentioned in the executive

32:34

order, the federal government is really trying to promote

32:39

the use of what's called privacy preserving technologies.

32:43

And this is something that's mentioned

32:46

that we should get more investment in this, we should try

32:48

to accelerate the development of these technologies

32:50

that the executive order specifically talks about.

32:52

Because what it allows us to do is it

32:54

actually allows us to do machine learning modeling on

32:56

data that stays encrypted.

32:58

So the data never has to actually get exposed or unencrypted

33:02

or you know, sometimes we try to de-identify data,

33:05

but there's always the risk of it being

33:06

re-identified in some ways.

33:08

We can kind of skip all those risks

33:11

and still be able to essentially provide better access

33:16

for folks that want advanced medical science using these

33:18

more diverse set of...

33:20

Because what's happened historically

33:21

with encryption, just as a very quick bit of background,

33:23

you know, we used to have no encryption

33:25

when it came to data.

33:26

Then we got encryption at rest while data's sitting there.

33:28

Okay, and that was great. And then we got encryption in

33:30

transit while we're transferring it place to place.

33:32

For example, if we're doing a telehealth consultation, all

33:34

that data is encrypted now, right?

33:36

As it should be. And now we've got encryption

33:39

and modeling or what people are referring to

33:41

as confidential computing or the application

33:43

of these privacy preserving technologies.

33:45

And so as healthcare executives, administrators,

33:50

I think we all have a certain obligation

33:53

to keep data private and protected,

33:55

legal obligations, ethical obligations.

33:56

And so we very much view ourselves as stewards of this data,

34:00

and we're always, you know, very concerned

34:02

about the potential risks of, you know,

34:05

patient data being exposed somehow.

34:08

But at the same time, we know that this data

34:09

can be very valuable in advancing medical science

34:11

and research and innovation.

34:13

And so we're stuck with this dilemma of

34:15

how do we make this data accessible,

34:17

but without sacrificing safety

34:19

and privacy, privacy preserving technologies can help us

34:23

significantly advance in that regard.

34:25

One more thing I'll mention that I think will also be

34:27

helpful is over the last couple

34:30

of years there's been a special task force out of

34:34

the White House and a couple of other agencies

34:36

to provide recommendations on creating a new national

34:39

AI research resource that is intended

34:43

to help make AI research

34:45

and more data sets accessible, including in healthcare

34:50

to help advance more equitable AI models and applications.

34:55

And so that task force produced some,

34:57

put out some recommendations in January of this year

34:59

that have since actually been approved

35:01

through legislative action in Congress.

35:03

So we're getting a national AI research resource

35:06

that is intended to help actually democratize AI research

35:09

and model building by bringing together more public

35:12

and private data sets that are relevant in an

35:14

environment where they can be used.

35:15

And also providing access to compute resources,

35:19

computing resources that can be very expensive sometimes,

35:22

especially for smaller institutions

35:23

or individual researchers.

35:25

You know, things that are usually more available

35:28

to larger institutions, but this national AI

35:30

research resource is really trying

35:31

to create an environment that's gonna allow more research

35:35

and innovation, including in medicine more broadly,

35:37

all across all types of researchers and institutions.

35:40

- Right, I think that's really critically important.

35:41

Again the guidance and thinking the large thoughts,

35:45

you know, make the small stuff possible to do

35:48

in an ethical manner, and you know, one of the things

35:53

that people don't realize about AI is that it's application

35:56

to both populations and real-time care

35:59

of individual patients that we can be analyzing

36:02

every single thing we're doing,

36:03

every dose we're giving.

36:05

And we talked about differences in pain medicine

36:07

application, you know, we spend a lot

36:10

of time hammering away at our care providers

36:12

and administrators about eliminating

36:15

all the implicit biases.

36:16

You know, we're in California.

36:17

We're a little more aggressive about that.

36:19

But there are implicit biases that really govern a lot

36:22

of attitudes and actions across the United States.

36:25

Healthcare being no exception.

36:27

And so if you had an AI engine running in the background

36:30

and saying, for every physician, for every type of patient,

36:33

for every nurse, right, were they delivering

36:37

the right type of care?

36:39

And not to harm the provider, but to educate the provider.

36:44

Like we are seeing this difference, you know,

36:46

in how you're treating people.

36:48

And you know, right now it takes an

36:50

amazing amount of effort.

36:51

Like we have a major population health effort to make sure

36:55

that our underserved communities who see us for primary care

36:59

and have their blood pressure being controlled,

37:01

are getting the same outcomes

37:02

with the same level of control.

37:04

And we're almost there.

37:06

And that, I mean, we started out with like a 10% difference

37:08

in the amount of control because

37:10

we weren't looking at the data.

37:12

Now we've got all these people, right,

37:14

but if AI were doing it, it would've

37:15

been telling us you are separated.

37:17

You need to not only give people the same treatments,

37:20

you need to start doing a different line of questioning

37:22

around their diet or their family or their stress

37:26

or whatever else might be driving up their blood pressures

37:28

and not just giving 'em the same medicines.

37:30

Maybe giving them different advice

37:32

or different medicine, right?

37:34

Now we'll stop doing that study

37:36

and then things might sink back to the same way or

37:38

'cause people are not being culturally sensitive

37:40

or not asking the right questions.

37:42

If we have AI running in the background,

37:44

it can never go back without someone pointing it out

37:47

to the doc or the nurse saying,

37:49

you're seeing a divergence in how people are responding

37:51

to your well-intentioned treatments.

37:54

And there's not a single healthcare provider

37:56

who wouldn't stop, take a look, reassess,

37:58

and get things back on track.

38:00

- That's great for issue spotting.

38:02

- Issue spotting.

38:03

That's a great, that's... Yes.

38:08

- One last question. I'll ask it of you, Dr. Lubarsky,

38:11

this is sort of our final word.

38:14

What is one takeaway, if there's just one takeaway

38:17

from this conversation that you want our patients to know

38:19

and one takeaway that you want our employees

38:21

to know, what would those be?

38:23

- AI is augmented intelligence.

38:25

It's for every employee, every nurse, every doctor to use

38:31

on behalf of their patients for whom

38:33

they are solely responsible.

38:36

And we will never seed control of our care

38:39

for human beings to computers.

38:42

- Thank you. Dr. Lubarsky, CEO of UC Davis Health.

38:45

Dennis Chornenky, our first Chief AI Advisor

38:48

at US Davis Health.

38:50

This has been a discussion on artificial intelligence

38:52

or AI in healthcare.

38:54

Find more interviews on our UC Davis Health YouTube channel,

38:58

and more information at our website,

39:00

health.ucdavis.edu.

39:03

Thanks for joining us.

39:05

(gentle music)

More transcripts

Explore other videos transcribed with YouTLDR.

Get the TLDR of any YouTube video

Transcribe, summarize, and repurpose videos in 125+ languages — free, no signup required.

Try YouTLDR Free