Is ChatGPT smarter than a Doctor ?

The advent of artificial intelligence (AI) in healthcare has raised both eyebrows and expectations. While AI offers promise for automating routine tasks and data analysis, questions about its applicability in nuanced medical practices persist. A recent study presented at the Royal College of General Practitioners (RCGP) Annual Conference 2023 brought these questions into sharp focus. The research revealed that ChatGPT failed the UK's National Primary Care examinations. So, what does this mean for the future of AI in healthcare, particularly in the complex realm of primary care?

Shathar Mahmood and Arun James Thirunavukarasu, two Indian junior doctors from UK, led a team to examine ChatGPT's performance using the Membership of the Royal College of General Practitioners Applied Knowledge Test. This is a part of the UK’s specialty training for becoming a general practitioner (GP). It's a multiple-choice assessment that tests the knowledge required for general practice within the context of the UK's National Health Service (NHS). The algorithm's overall performance was slightly below par, scoring 10% less than the average RCGP pass mark in recent years.

The study highlights the limitations of AI when it comes to making complex medical decisions. Sandip Pramanik, a GP from Watford, noted that the study "clearly showed ChatGPT's struggle to deal with the complexity of the exam questions." In essence, the limitations of ChatGPT lie in its inability to grasp the intricate web of human factors involved in medical decision-making, something that general practitioners are trained extensively to handle. 

Interestingly, the study also found that ChatGPT can generate 'hallucinations,' or novel explanations, which are inaccurate but presented as factual. This is concerning as non-experts would not be able to discern these hallucinations from actual facts. Hence, the risk of misinformation increases, particularly in an age when medical advice is frequently sought online. 

My Concluding Thoughts

So, does AI have a future in healthcare? Certainly. But replacing human clinicians in primary care? Probably not anytime soon. Mahmood succinctly stated that larger and more medically specific datasets are needed to improve AI systems' accuracy in this field. This suggests that while AI has its place in healthcare, that place is not in the replacement of human decision-making complexity and nuance. Instead, it serves as a tool that can assist but not usurp the role of healthcare professionals.

Let's remember, healthcare is not just about data points and binary answers; it’s about understanding the intricate nuances of human emotions, conditions, and complexities, something AI is far from mastering.

-  Krishna Nair

Is the Nurses' Strike Over? RCN To Recommend New Pay Offer to Members

The Royal College of Nursing (RCN) has announced that they have received a new pay offer from NHS England, which it says it will recommend to members in a forthcoming vote. If accepted, this would bring an end to industrial action by nurses, 3 months after the strikes began.

The offer from the Government, which was made to all healthcare staff striking, including nurses, paramedics, 999 call handlers, midwives, security guards, and cleaners, includes a one-off payment for the 2022-23 financial year worth between £1655 and £3789, and a 5% consolidated pay increase for the 2023-24 financial year, according to the RCN.

New Pay Structure and Policy Framework on Safe Staffing

The deal also includes a new pay structure for nursing staff, which would come into force for 2024-2025. In addition, the Government had made a commitment – for the first time – to a national evidence-based policy framework on safe staffing, focusing on registered nurses, that "will draw on legislation in the rest of the UK and internationally", according to the RCN.

RCN General Secretary and Chief Executive Pat Cullen sees the deal as a win for nurses.

"The Government was forced into these negotiations and to reopen the pay award as a result of the historic pressure from nursing staff. Members took the hardest of decisions to go on strike and I believe they have been vindicated today," she said.

"It is not a panacea, but it is real tangible progress and the RCN's member leaders are asking fellow nursing staff to support what our negotiations have secured."

If Members Accept the Deal: 'No More Strikes'

The RCN's elected council met Thursday morning and decided that it will recommend that members vote to accept the offer in a forthcoming consultation. If members accept it, the dispute with Government and the NHS over pay will formally end. 

Negotiations with the RCN started 3 weeks ago, and all NHS unions took part in the last 10 days of talks. Aside from the RCN, UNISON, GMB, the Chartered Society of Physiotherapy, and the British Dietetic Association will also recommend the offer to their members in consultations that will be held over the coming weeks, according to the Department of Health and Social Care. Strike action will continue to be paused while they are consulted.
Prime Minister Rishi Sunak said of the deal: "It is right that we reward our hardworking NHS staff, who showed bravery and dedication throughout the pandemic and continue to make phenomenal progress to tackle waiting lists. Importantly this deal is also affordable for the taxpayer and continues to deliver on my promise to halve inflation.

"We have taken a reasonable approach throughout and this offer is good for NHS staff, it’s good for the taxpayer, and most importantly it is good news for patients whose care will no longer be disrupted by strike action."

Health and Social Care Secretary Steve Barclay said: "This offer will give nurses, paramedics, physiotherapists and other non-medical staff a fair pay rise while protecting our commitment to halve inflation."

Next Up: Junior Doctors

Responding to news that a pay deal has been reached in principle between the Government and unions, the Chief Executive of NHS Providers, Sir Julian Hartley said: "This is hugely positive development after months of strike action, which has seen NHS staff out on picket lines and widespread disruption to patient care, with tens of thousands of appointments postponed.
"We are very encouraged by the guarantee from the Government that there will be no impact on frontline services or the quality of care that patients receive as a result of this offer. We take this to mean that the deal is fully funded rather than relying on raids on NHS budgets, taking money away from key services. This is crucial to the success of the deal.

"It is also good to see that as a result of this deal all staff will be lifted above the real living wage, something we have long called for.

"We now need to see today's progress matched by urgent movement on talks between the Government and unions representing junior doctors. As trust leaders assess the full extent of the disruption caused by this week's 72-hour walkout, their message is loud and clear: Redouble your efforts to find a way through. No more strikes."