Clinical Trial Tips: Practical and Actionable

Over the years, attendees of MAGI Clinical Research Conferences have collected a set of practical, actionable suggestions for improving clinical trials. More than eighty such tips appear in the July 2019 edition of Journal of Clinical Research Best Practices*.  In this post, Polaris auditors weigh in on some of their favorite MAGI suggestions. Surprising no one, they also were eager to share some of their own.

Our Favorites Tips from MAGI

So how does a clinical trial tip earn a spot on our exalted Faves List?  First, it must be something we don’t see too often, or not as much as we’d like.(If most organizations already do a useful thing, it doesn’t really qualify as a helpful tip; it’s really just a common practice.) Second, the effort to implement the tip can’t be too onerous. If a practice requires too much interdepartmental coordination, change management, training, money, or resources, it’s not a tip. It’s a full-blown initiative.

So here they are. Each tip from MAGI attendees is in bold font. Our accompanying commentary is in plain text:

• To help ensure quality study conduct, clinical sites should prepare protocol-specific quality checklists for each study. We’ve written about quality checklists from the auditing perspective before. They’re not a panacea, certainly, but that doesn’t mean they can’t be very useful.
  
  
• After study close-out, sponsors and CROs should consider holding conference calls with groups of sites to capture lessons learned. This in turn could be used to improve training, SOPs, SIVs, etc.
  
  
• As a recruitment aid, clinical sites should create pocket-sized, laminated study cards that list the inclusion/exclusion criteria for a study.  Site staff members can keep these cards in their lab coat pockets and quickly refer to them when treating a patient who could be a potential subject.
  
  
• CROs should share risk assessments and mitigation plans with Sponsors. We agree, but would also encourage CROs to keep the sites involved and aware of risks so they can anticipate them and proceed accordingly.
  
  
• Sponsors/CROs should ensure proper qualifications of vendors prior to executing contracts. It’s hard to argue with this logic, but we don’t see it as much as we should. Too often qualification audits come after the paperwork has been signed. Should the audit uncover noncompliance or quality risks at the vendor site, it’s much harder to get the vendor to make necessary changes after the contract is in place.
  
  
• CROs should align 3rd party contracts with the Sponsor/CRO contract and the Clinical Trial Agreement. Yep.

Additional Tips from Polaris QA/Compliance Auditors

The MAGI list of clinical trial tips brought others to mind that we wanted to share. We applied the same criteria to these suggestions as we did to the MAGI contributions: (1) not necessarily rare, but not as common as it could be, and (2) not overly complex or expensive to implement.

• When evaluating outsourcing partners and clinical sites, Sponsors and CROs should make sure to look at personnel turnover rates. Frequent turnovers may suggest underlying problems that could jeopardize study conduct and quality.
  
  
• Sponsors and CROs should make sure their Monitoring Report templates are consistent with the Clinical Monitoring Plan (CMP). For example:
  
  
• The CMP calls for a focus on a particular set of critical variables, but the report template only has a place for recording that 100% SDV was completed. This means that there’s no way to document that the monitor put special emphasis on anything.
• The CMP requires bi-direction review of study data – a confirmation that what is in the CRF can be verified in the source, and all pertinent data in the source can be found in the CRF – but the report template only allows for the former to be documented.
  
  
• Every member of the site team has valuable input. It’s important to include the study PI, CRC, pharmacist, and other key personnel in the discussions. In 2017, we wrote an article about the important, yet often overlooked, input that the pharmacist on site can provide.
  
  
• There are many reasons that trial participants leave a study, many of which can’t be remedied with improved site practices. But sites that demonstrate they value the participation of their study volunteers, and honor the time they’re spending and contribution they’re making, tend to have better retention results. To that end:
  
  
• To help participants schedule their time, sites can prepare calendars that include all study visit dates and indicate the activities and procedures they entail. (This, of course, needs to be approved by the IRB).
• When participants arrive, they shouldn’t have to sit in a waiting room or empty exam room; they should be seen immediately so they don’t feel their time is being wasted.
• Sites can provide beverages and light snacks to their study participants who especially appreciate them immediately after a fasting blood draw (protocol permitting, naturally). It’s a small courtesy, and not difficult to do. Whose day isn’t brightened by a proffered nosh?**

Uh oh. Now we got you all thinking about mini muffins and cheddar popcorn. Go ahead. Grab a treat. We'll talk later.

________________________________________________________________
 * Journal of Clinical Research Best Practices, July 2019

** Proffered Nosh™ would be a really great name for a restaurant. Or a fictional Scotland Yard Inspector -- legendary for his wit, brilliance, wine pairings, and fashion sense.

Getting The Most From Your GMP Supplier Audit

Guest Blogger: Greg Weilersbacher
Founder & President, Eastlake Quality Consulting

All companies outsource. It’s a humbling fact that you simply can’t do it all yourself. This often has to do with resource allocation; your company may allocate dollars to build and sustain some activities in-house while choosing to contract higher-cost operations to qualified suppliers who already have the expertise and equipment. 

You may outsource the manufacturing of tablets, sterile injectable, or topical dosage form, or the GMP release and stability testing of your product. Once the production and testing is complete, the product may need to be stored under controlled temperature and humidity conditions and then distributed to locations around the globe. The Contract Development and Management Organizations (CDMOs) who execute these critical operations are of paramount importance to your company’s success. Choosing the right suppliers will also help to minimize stress-induced headaches throughout your organization. Here are the top five ways to get the most out of a supplier audit.

When Sites, eSystems, and Inspections Meet

Q: Do study site personnel need to be able to answer questions about sponsor-provided computer systems during an inspection?

A: Yes, and there’s a simple thing that sponsors and CROs can do to prepare their sites.

This excerpt was lifted from an online, interactive course entitled “Developing a Part 11 Compliance Plan in Clinical Research.” While the course mainly targeted sponsors and CROs, who have the heaviest regulatory burden in this area, sites also have Part 11 and validation concerns, as demonstrated by this question.

Presenter Lisa Olson, a CSV/Part 11 expert with Polaris Compliance Consultants, briefly described her recommendation, which is both simple and effective. (And since that is total catnip to a compliance blogger, I interviewed her after her presentation to develop the following piece.)

So here it is. Here’s what she said...

FDA Puts Santa on the Naughty List!

        WARNING LETTER

VIA UNITED PARCEL SERVICE
SIGNATURE REQUIRED

December 1, 2018

Mr. Kris Kringle, Owner
Santa’s Workshop, LLC
1225 Santa Clause Way
North Pole, Arctic Circle
 
Dear Mr. Kringle:

The U.S. FDA inspected your manufacturing facility, Santa’s Workshop, LLC at
1225 Santa Claus Way, North Pole Arctic Circle, from April 2 to April 20, 2018.

This warning letter summarizes significant violations of CGMP regulations for finished product. See 21 CFR, parts 210 and 211. During our inspection, our investigators observed specific violations including, but not limited to, the following.

CGMP Violations

1.    Your firm failed to ensure that each person engaged in the manufacture, processing, packing, or holding of product has the education, training, and experience, or any combination thereof, to enable that person to perform his or her assigned functions (21 CFR 211.25(a) and 211.28).

Many members of your Enterprise Labor Force (ELF) unit lacked sufficient prior experience for designing and assembling (b)(4). At the time of our inspection, no ELF members had received training on CGMPs, and most were unaware of their responsibilities in the areas of cleanliness and proper attire. Hands and faces were often coated with chocolate, and bells on hats and shoes prevented protective apparel from attaining a proper fit. More generally, factory staff demonstrated an undisciplined, almost gleeful disregard for quality procedures. On three separate occasions, at critical stages of the manufacturing process, floor workers erupted into spontaneous song and dance.

The One-Hour Study Site Audit

In an effort to tease out the priorities of a clinical study site audit, I asked six of our most experienced GCP auditors the following question:

If you only had one hour to conduct a study site audit,
what would you look at?
[Obligatory warnings:  Do not try this at home. This is just a simulation. Caveat lectorem. Dinosaurs in the mirror are bigger than they appear. Et cetera.]

Of course it’s not possible to conduct any kind of meaningful audit in so short a time, but it’s an interesting thought exercise because it gets to the heart of study site risk.

What Suprises GCP Auditors?

Last month, I scheduled one-on-one discussions with our most experienced GCP auditors to ask each of them the same question: What surprises you most about the audits you conduct?

I guess you could say that I was the one who was surprised. I’m not sure exactly what I was expecting to hear, but I thought my teammates were going to talk about things that were new. Instead, I heard a lot more about things that have been around for a long time. To a person, my colleagues said they were surprised to be observing some of the same audit findings they were observing 30 years ago...which *is* surprising when you consider most of them were mere children at the time. ;-)  It seems we have some stubbornly persistent quality and compliance issues in the biopharma industry that decades of neither experience nor technology have seemed to remedy. And the problems are not just persistent; they’re interrelated.

Hackin' the GDPR

Trying to comply with the GDPR got you down?
Maybe our parody will cheer you up.

(Sung to the tune of Lennon-McCartney's "Back in the U.S.S.R.")

eSource Terminology Untangled

True or False:

(1) eSource in clinical trials means eliminating the possibility for transcription errors.

(2) Data collected in Electronic Data Capture (EDC) systems is eSource.

Strictly speaking, both statements are false. If that surprises you, it’s probably because many casual uses of the term “eSource” actually differ from the formal definition laid out by FDA. If the participants in any discussion share the same interpretation of “eSource”, or if it’s clear from context how “eSource” is being used, then no harm, no foul. (Contemporary translation: “Meh.”) BUT…and you know where we’re going with this…when a term can be interpreted in multiple ways, there’s always a possibility for miscommunication and cross talk.

Delegation of Authority Log: Tips for Monitors

We may call them “site inspections”, but it’s not the site that’s being inspected when a regulator visits; it’s the Principal Investigator. Though a PI typically delegates study tasks to other staff members, he or she remains solely responsible for the conduct of the study. In fact, the ICH E6(R2) addendum adds two new sections to the international guidance that emphasize PI supervision.

That’s what makes the Delegation of Authority (DoA) log so important and why regulatory inspectors care about it so much. A DoA log serves as evidence that a PI has assigned study tasks only to those staff members with the education, training, and experience to carry them out. If delegates are unqualified to perform their tasks, subject safety could be at risk and it’s highly likely that the study data would be unusable.

Study Sites: Show 'Em Your QC!

Sites frequently want to know how they can stand out to Sponsors and CROs to win more studies.
Our advice: Implement internal QC procedures.

Sponsors and CROs we work with consider a tight quality control program to be evidence that a site can be counted on to produce reliable data. It shows that managing quality at your site is a continual process, and doesn’t wait for monitors to arrive. In a risk-based monitoring environment, this is an increasingly compelling attribute.

Where to Start: The Usual Suspects
It makes sense for you to focus your QC efforts on those areas where you’ve historically had the most problems. If the phrase “trend analysis” makes you want to jump through a window -- it's okay -- you can climb back inside. You don't have to do a trend analysis. We've identified 3 areas in which audit findings are common and how you can avoid them.

Love at First "Site": Early Signs of Strong PI Oversight

When I was a teenager, my grandfather would invite my new boyfriends to run short, pointless errands with him, just so he could watch them drive. He said he could tell a lot about a boy’s character simply by observing his actions behind the wheel. Did he stay under the speed limit? Did he use his signal when he was switching lanes? Did he slow down when children were playing near the road? If so, it was a good sign that the boy was generally a careful and attentive fellow. If not, it was an early indication of reckless tendencies, and I would do well to be on my guard.

What does this have to do with PI oversight?

Anticipating Tensions Between Clinical Care and Study Protocol

Protocol trumps practice. This principle seems clear enough, but complying with it is not always as straight-forward as it sounds. Years of practicing medicine has reinforced the way a physician responds to medical situations. But do these responses run counter to the investigational plan? Can a site’s commitment to standard of care affect its ability to meet enrollment targets?


There’s a lot to consider.

Coping with Scoping Your CSV/Part 11 Audit

You know you need a computer systems audit, but that’s literally the extent of what you know.
Has this ever been you?

Yes, you use computers on a daily basis, and you may even use the system that needs to be audited. But you don’t spend your day thinking about where all the system components are located, how services and software are combined, and what Part 11 requirements apply. Terms like “cloud computing” make you feel slightly queasy. You’d rather get a root canal than discuss “distributed processing.” Your expertise is in manufacturing. Or clinical research. Or non-clinical lab operations. And somehow it’s your job to make sure an effective and properly-sized system audit is conducted. Great.

Notes 2 Fix Your Notes 2 File

Q: If Notes to File can be regulatory red flags, should we quit using them?
A: No, and here's why...

Regulatory inspections are often conducted long after the conclusion of the study. When an FDA investigator asks you a question about an anomaly five years after it’s happened, will anyone recall the circumstances well enough to satisfy the regulator’s concerns? You’ll be doing yourself a huge favor if you write NTFs that answer the questions regulators might one day be asking you.

When GCP & GMP Meet

Developing safe and effective drugs requires a coordinated effort across a diverse set of disciplines. This is easier to observe at some points in the process than at others. Once a product is well into human trials, it can be easy to forget that developments on the manufacturing side of the house can affect the clinicians who are conducting the studies.

Site Selection: Don't Forget About the Study Drug

As a sponsor or CRO, you understand the importance of a thorough site selection process. A site needs to be able to meet enrollment targets and time frames, protect the rights and safety of study participants, execute the protocol, deliver quality data, and maintain GCP compliance. That’s what your site feasibility surveys and pre-study visits are designed to evaluate. And as you’re assessing a site’s abilities, the site is conducting its own feasibility process. They’re mining their patient database and assessing inclusion/exclusion criteria. They’re reviewing staff credentials and ensuring they have adequate resources to manage the number of subject visits and collect the data the protocol requires.

But when we conduct GCP audits, we find there’s one perspective that is sometimes overlooked by both sides: the needs of the study drug itself.

When is a Customer NOT a Customer?

While patients are consumers of healthcare services, they can’t be considered customers in the traditional sense. The same is true of students. Over many years of teaching, I’ve noticed this parallel between the healthcare and education professions; both require significantly more “customer participation” to achieve desired outcomes than other industries do. That’s one reason it’s difficult to measure the quality of these institutions and the skills of their practitioners. That’s also why both industries focus so intently on engaging our communities; we simply can’t be successful unless we do.

“Can You Hear Me Now?”
As the old joke goes, there are 3 types of people in this world: those who are good at math and those who aren’t. Many students believe themselves to be permanent denizens of the 2nd camp. They find mathematical concepts confusing and the terminology inscrutable, so they tend not to ask questions. They’re afraid they’re being judged, so they’re not always truthful. Tests and exams fill them with anxiety, and sometimes even panic (no doubt waking to nightmares of trains leaving stations at varying rates of speed). These are the students who need my help the most. Our success in overcoming these challenges together will depend heavily on the student/teacher connection we can establish, yet few students are actually able to choose the teacher with whom they are asked to connect. Sound like healthcare yet?

Avoiding Protocol Deviations

Year in and year out, protocol deviations are the most common FDA Site Inspection finding. Why does this keep happening?

If you’ve seen FDA’s Inspectional Observation Summaries, you know that in 2015 the most frequently cited violation in clinical research by far was “failure to conduct research in accordance with the investigational plan.”  Do you know this finding also topped the list the year before that?  And the year before that?  In fact, deviating from the protocol has been the most common observation every year for the last decade.

Why does this keep happening?

Optimizing Outsourcing Options for Small Sponsors

What can small sponsors do to secure the outsourcing resources they need as large CROs form strategic alliances with Big Pharma?

Partenships between large pharmaceutical companies and large CROs have become the norm.  The advantages for sponsor companies include shared risk, knowledge transfer, dedicated resources, shorter time to market, and the ability to implement the massive data integration that clinical development requires.  Strategic alliances are arguably as advantageous for their outsourcing partners, providing a steady pipeline of work that’s larger in scope and longer in duration than is typical under traditional arrangements.

FDA Site Inspections: 5 Tips for Success

Anx·i·ety (noun)
The state of uneasiness caused by apprehension of possible misfortune.

Yep.  That’s the word that comes to mind whenever anyone mentions FDA inspections.

But anxiety often stems from a lack of control, and in a regulatory inspection, you have more control than you might think.  There are many steps you can take -- before, during, and even after an inspection is over -- that can give you a fair degree of control over the outcome.   Here, Polaris auditors Lauren Kelley and Michele Commins share some of those steps with you.