Alvin M. Matsumoto, MD

Testosterone therapy is administered following pragmatic diagnostic evaluation and workup to assess whether an adult male is hypogonadal, based on symptoms consistent with androgen deficiency and low morning serum testosterone concentrations on ≥ 2 occasions. Effects of testosterone administration include the development or maintenance of secondary sexual characteristics and increases in libido, muscle strength, fat-free mass, and bone density.

Testosterone prescriptions have markedly increased in the past 20 years, including within the US Department of Veterans Affairs (VA) health care system.^1-3 This trend may be influenced by various factors, including patient perceptions of benefit, an increase in marketing, and the availability of more user-friendly formulations. 

Since 2006, evidence-based clinical practice guidelines have recommended specific clinical and laboratory evaluation and counseling prior to starting testosterone replacement therapy (TRT).^4-8 However, research has shown poor adherence to these recommendations, including at the VA, which raises concerns about inappropriate TRT initiation without proper diagnostic evaluation.^9,10 Observational research has suggested a possible link between testosterone therapy and increased risk of cardiovascular (CV) events. The US Food and Drug Administration prescribing information includes boxed warnings about potential risks of high blood pressure, myocardial infarction, stroke, and CV-related mortality with testosterone treatment, contact transfer of transdermal testosterone, and pulmonary oil microembolism with testosterone undecanoate injections.^11-15

A VA Office of Inspector General (OIG) review of VA clinician adherence to clinical and laboratory evaluation guidelines for testosterone deficiency found poor adherence among VA practitioners and made recommendations for improvement.^4,15 These focused on establishing clinical signs and symptoms consistent with testosterone deficiency, confirming hypogonadism by repeated testosterone testing, determining the etiology of hypogonadism by measuring gonadotropins, initiating a discussion of risks and benefits of TRT, and assessing clinical improvement and obtaining an updated hematocrit test within 3 to 6 months of initiation.

The VA Puget Sound Health Care System (VAPSHCS) developed a local prior authorization template to assist health care practitioners (HCPs) to address the OIG recommendations. This testosterone order template (TOT) aimed to improve the diagnosis, evaluation, and monitoring of TRT in males with hypogonadism, combined with existing VA pharmacy criteria for the use of testosterone based on Endocrine Society guidelines. A version of the VAPSHCS TOT was approved as the national VA Computerized Patient Record System (CPRS) template.

Preliminary evaluation of the TOT suggested improved short-term adherence to guideline recommendations following implementation.¹⁶ This quality improvement study sought to assess the long-term effectiveness of the TOT with respect to clinical practice guideline adherence. The OIG did not address prostate-specific antigen (PSA) monitoring because understanding of the relationship between TRT and the risks of elevated PSA levels remains incomplete.^6,17 This project hypothesized that implementation of a pharmacy-managed TOT incorporated into CPRS would result in higher adherence rates to guideline-recommended clinical and laboratory evaluation, in addition to counseling of men with hypogonadism prior to initiation of TRT.

Methods

Eligible participants were cisgender males who received a new testosterone prescription, had ≥ 2 clinic visits at VAPSHCS, and no previous testosterone prescription in the previous 2 years. Individuals were excluded if they had testosterone administered at VAPSHCS; were prescribed testosterone at another facility (VA or community-based); pilot tested an initial version of the TOT prior to November 30, 2019; or had an International Classification of Diseases, Tenth Revision codes for hypopituitarism, gender identity disorder, history of sexual assignment, or Klinefelter syndrome for which testosterone therapy was already approved. Patients who met the inclusion criteria were identified by an algorithm developed by the VAPSHCS pharmacoeconomist.

This quality improvement project used a retrospective, pre-post experimental design. Electronic chart review and systematic manual review of all eligible patient charts were performed for the pretemplate period (December 1, 2018, to November 30, 2019) and after the template implementation, (December 1, 2021, to November 30, 2022).

An initial version of the TOT was implemented on July 1, 2019, but was not fully integrated into CPRS until early 2020; individuals in whom the TOT was used prior to November 30, 2019, were excluded. Data from the initial period of the COVID-19 pandemic were avoided because of alterations in clinic and prescribing practices. As a quality improvement project, the TOT evaluation was exempt from formal review by the VAPSHCS Institutional Review Board, as determined by the Director of the Office of Transformation/Quality/Safety/Value.

Interventions

Testosterone is a Schedule III controlled substance with potential risks and a propensity for varied prescribing practices. It was designated as a restricted drug requiring a prior authorization drug request (PADR) for which a specific TOT was developed, approved by the VAPSHCS Pharmacy and Therapeutics Committee, and incorporated into CPRS. A team of pharmacists, primary care physicians, geriatricians, endocrinologists, and health informatics experts created and developed the TOT. Pharmacists managed and monitored its completion.

The process for prescribing testosterone via the TOT is outlined in the eAppendix. When an HCP orders testosterone in CPRS, reminders prompt them to use the TOT and indicate required laboratory measurements (an order set is provided). Completion of TOT is not necessary to order testosterone for patients with an existing diagnosis of an organic cause of hypogonadism (eg, Klinefelter syndrome or hypopituitarism) or transgender women (assigned male at birth). In the TOT, the prescriber must also indicate signs and symptoms of testosterone deficiency; required laboratory tests; and counseling regarding potential risks and benefits of TRT. A pharmacist reviews the TOT and either approves or rejects the testosterone prescription and provides follow-up guidance to the prescriber. The completed TOT serves as documentation of guideline adherence in CPRS. The TOT also includes sections for first renewal testosterone prescriptions, addressing guideline recommendations for follow-up laboratory evaluation and clinical response to TRT. Due to limited completion of this section in the posttemplate period, evaluating adherence to follow-up recommendations was not feasible.

Measures

This project assessed the percentage of patients in the posttemplate period vs pretemplate period with an approved PADR. Documentation of specific guideline-recommended measures was assessed: signs and symptoms of testosterone deficiency; ≥ 2 serum testosterone measurements (≥ 2 total, free and total, or 2 free testosterone levels, and ≥ 1 testosterone level before 10 am); serum follicle-stimulating hormone (FSH) and luteinizing hormone (LH) tests; discussion of the benefits and risks of testosterone treatment; and hematocrit measurement.

The project also assessed the proportion of patients in the posttemplate period vs pretemplate period who had all hormone tests (≥ 2 serum testosterone and LH and FSH concentrations), all laboratory tests (hormone tests and hematocrit), and all 5 guideline-recommended measures.

Analysis

Statistical comparisons between the proportions of patients in the pretemplate and posttemplate periods for each measure were performed using a χ² test, without correction for multiple comparisons. All analyses were conducted using Stata version 10.0. A P value < .05 was considered significant for all comparisons.

Results

Chart review identified 189 patients in the pretemplate period and 113 patients in the posttemplate period with a new testosterone prescription (Figure). After exclusions, 91 and 49 patients, respectively, met eligibility criteria (Table 1). Fifty-six patients (62%) pretemplate and 40 patients (82%) posttemplate (P = .015) had approved PADRs and comprised the groups that were analyzed (Table 2).

The mean age and body mass index were similar in the pretemplate and posttemplate periods, but there was variation in the proportions of patients aged < 70 years and those with a body mass index < 30 between the groups. The most common diagnosis in both groups was testicular hypofunction, and the most common comorbidity was type 2 diabetes mellitus. Concomitant use of opioids or glucocorticoids that can lower testosterone levels was rare. Most testosterone prescriptions originated from primary care clinics in both periods: 68 (75%) in the pretemplate period and 35 (71%) in the posttemplate period. Most testosterone treatment was delivered by intramuscular injection. 

In the posttemplate period vs pretemplate period, the proportion of patients with an approved PADR (82% vs 62%, P = .02), and documentation of signs and symptoms of hypogonadism (93% vs 71%, P = .002) prior to starting TRT were higher, while the percentage of patients having ≥ 2 testosterone measurements (85% vs 89%, P = .53), ≥ 1 testosterone level before 10 AM (78% vs 75%, P = .70), and hematocrit measured (95% vs 91%, P = .47) were similar. Rates of LH and FSH testing were higher in the posttemplate period (80%) vs the pretemplate period (63%) but did not achieve statistical significance (P = .07), and discussion of the risks and benefits of TRT was higher in the posttemplate period (58%) vs the pretemplate period (34%) (P = .02). The percentage of patients who had all hormone measurements (total and/or free testosterone, LH, and FSH) was higher in the posttemplate period (78%) vs the pretemplate period (59%) but did not achieve statistical significance (P = .06). The rates of all guideline-recommended laboratory test orders were higher in the posttemplate period (78%) vs the pretemplate period (55%) (P = .03), and all 5 guideline-recommended clinical and laboratory measures were higher in the posttemplate period (45%) vs the pretemplate period (18%) (P = .004).

Discussion

The implementation of a pharmacy-managed TOT in CPRS demonstrated higher adherence to evidence-based guidelines for diagnosing and evaluating hypogonadism before TRT. After TOT implementation, a higher proportion of patients had documented signs and symptoms of testosterone deficiency, underwent all recommended laboratory tests, and had discussions about the risks and benefits of TRT. Adherence to 5 clinical and laboratory measures recommended by Endocrine Society guidelines was higher after TOT implementation, indicating improved prescribing practices.⁴

The requirement for TOT completion before testosterone prescription and its management by trained pharmacists likely contributed to higher adherence to guideline recommendations than previously reported. Integration of the TOT into CPRS with pharmacy oversight may have enhanced adherence by summarizing and codifying evidence-based guideline recommendations for clinical and biochemical evaluation prior to TRT initiation, offering relevant education to clinicians and pharmacists, automatically importing pertinent clinical information and laboratory results, and generating CPRS documentation to reduce clinician burden during patient care. 

The proportion of patients with documented signs and symptoms of testosterone deficiency before TRT increased from the pretemplate period (71%) to the posttemplate period (93%), indicating that most patients receiving TRT had clinical manifestations of hypogonadism. This aligns with Endocrine Society guidelines, which define hypogonadism as a clinical disorder characterized by clinical manifestations of testosterone deficiency and persistently low serum testosterone levels on ≥ 2 separate occasions.^4,6 However, recent trends in direct-to-consumer advertising for testosterone and the rise of “low T” clinics may contribute to increased testing, varied practices, and inappropriate testosterone therapy initiation (eg, in men with low testosterone levels who lack symptoms of hypogonadism).¹⁸ Improved adherence in documenting clinical hypogonadism with implementation of the TOT reinforces the value of incorporating educational material, as previously reported.¹¹

Adherence to guideline recommendations following implementation of the TOT in this project was higher than those previously reported. In a study of 111,631 outpatient veterans prescribed testosterone from 2009 to 2012, only 18.3% had ≥ 2 testosterone prescriptions, and 3.5% had ≥ 2 testosterone, LH, and FSH levels measured prior to the initiation of a TRT.⁹ In a report of 63,534 insured patients who received TRT from 2010 to 2012, 40.3% had ≥ 2 testosterone prescriptions, and 12% had LH and/or FSH measured prior to the initiation.⁸

Low rates of guideline-recommended laboratory tests prior to initiation of testosterone treatment were reported in prior non-VA studies.^19,20 Poor guideline adherence reinforces the need for clinician education or other methods to improve TRT and ensure appropriate prescribing practices across health care systems. The TOT described in this project is a sustainable clinical tool with the potential to improve testosterone prescribing practices. 

The high rates of adherence to guideline recommendations at VAPSHCS likely stem from local endocrine expertise and ongoing educational initiatives, as well as the requirement for template completion before testosterone prescription. However, most testosterone prescriptions were initiated by primary care and monitored by pharmacists with varying degrees of training and clinical experience in hypogonadism and TRT.

However, adherence to guideline recommendations was modest, suggesting there is still an opportunity for improvement. The decision to initiate therapy should be made only after appropriate counseling with patients regarding its potential benefits and risks. Reports on the CV risk of TRT have been mixed. The 2023 TRAVERSE study found no increase in major adverse CV events among older men with hypogonadism and pre-existing CV risks undergoing TRT, but noted higher instances of pulmonary embolism, atrial fibrillation, and acute kidney injury.²¹ This highlights the need for clinicians to continue to engage in informed decision-making with patients. Effective pretreatment counseling is important but time-consuming; future TOT monitoring and modifications could consider mandatory checkboxes to document counseling on TRT risks and benefits.

The TOT described in this study could be adapted and incorporated into the prescribing process and electronic health record of larger health care systems. Use of an electronic template allows for automatic real-time dashboard monitoring of organization performance. The TOT described could be modified or simplified for specialty or primary care clinics or individual practitioners to improve adherence to evidence-based guideline recommendations and quality of care.

Strengths

A strength of this study is the multidisciplinary team (composed of stakeholders with experience in VA health care system and subject matter experts in hypogonadism) that developed and incorporated a user-friendly template for testosterone prescriptions; the use of evidence-based guideline recommendations; and the use of a structured chart review permitted accurate assessment of adherence to recommendations to document signs and symptoms of testosterone deficiency and a discussion of potential risks and benefits prior to TRT. To our knowledge, these recommendations have not been assessed in previous reports.

Limitations

The retrospective pre-post design of this study precludes a conclusion that implementation of the TOT caused the increase in adherence to guideline recommendations. Improved adherence could have resulted from the ongoing development of the preauthorization process for testosterone prescriptions or other changes over time. However, the preauthorization process had already been established for many years prior to template implementation. Forty-nine patients had new prescriptions for testosterone in the posttemplate period compared to 91 in the pretemplate period, but TRT was initiated in accordance with guideline recommendations more appropriately in the posttemplate period. The study’s sample size was small, and many eligible patients were excluded; however, exclusions were necessary to evaluate men who had new testosterone prescriptions for which the template was designed. Most men excluded were already taking testosterone.

Conclusions

The implementation of a CPRS-based TOT improved adherence to evidence-based guidelines for the diagnosis, evaluation, and counseling of patients with hypogonadism before starting TRT. While there were improvements in adherence with the TOT, the relatively low proportion of patients with documentation of TRT risks and benefits and all guideline recommendations highlights the need for additional efforts to further strengthen adherence to guideline recommendations and ensure appropriate evaluation, counseling, and prescribing practices before initiating TRT.

Testosterone therapy is administered following pragmatic diagnostic evaluation and workup to assess whether an adult male is hypogonadal, based on symptoms consistent with androgen deficiency and low morning serum testosterone concentrations on ≥ 2 occasions. Effects of testosterone administration include the development or maintenance of secondary sexual characteristics and increases in libido, muscle strength, fat-free mass, and bone density.

Testosterone prescriptions have markedly increased in the past 20 years, including within the US Department of Veterans Affairs (VA) health care system.^1-3 This trend may be influenced by various factors, including patient perceptions of benefit, an increase in marketing, and the availability of more user-friendly formulations. 

Since 2006, evidence-based clinical practice guidelines have recommended specific clinical and laboratory evaluation and counseling prior to starting testosterone replacement therapy (TRT).^4-8 However, research has shown poor adherence to these recommendations, including at the VA, which raises concerns about inappropriate TRT initiation without proper diagnostic evaluation.^9,10 Observational research has suggested a possible link between testosterone therapy and increased risk of cardiovascular (CV) events. The US Food and Drug Administration prescribing information includes boxed warnings about potential risks of high blood pressure, myocardial infarction, stroke, and CV-related mortality with testosterone treatment, contact transfer of transdermal testosterone, and pulmonary oil microembolism with testosterone undecanoate injections.^11-15

A VA Office of Inspector General (OIG) review of VA clinician adherence to clinical and laboratory evaluation guidelines for testosterone deficiency found poor adherence among VA practitioners and made recommendations for improvement.^4,15 These focused on establishing clinical signs and symptoms consistent with testosterone deficiency, confirming hypogonadism by repeated testosterone testing, determining the etiology of hypogonadism by measuring gonadotropins, initiating a discussion of risks and benefits of TRT, and assessing clinical improvement and obtaining an updated hematocrit test within 3 to 6 months of initiation.

The VA Puget Sound Health Care System (VAPSHCS) developed a local prior authorization template to assist health care practitioners (HCPs) to address the OIG recommendations. This testosterone order template (TOT) aimed to improve the diagnosis, evaluation, and monitoring of TRT in males with hypogonadism, combined with existing VA pharmacy criteria for the use of testosterone based on Endocrine Society guidelines. A version of the VAPSHCS TOT was approved as the national VA Computerized Patient Record System (CPRS) template.

Preliminary evaluation of the TOT suggested improved short-term adherence to guideline recommendations following implementation.¹⁶ This quality improvement study sought to assess the long-term effectiveness of the TOT with respect to clinical practice guideline adherence. The OIG did not address prostate-specific antigen (PSA) monitoring because understanding of the relationship between TRT and the risks of elevated PSA levels remains incomplete.^6,17 This project hypothesized that implementation of a pharmacy-managed TOT incorporated into CPRS would result in higher adherence rates to guideline-recommended clinical and laboratory evaluation, in addition to counseling of men with hypogonadism prior to initiation of TRT.

Methods

Eligible participants were cisgender males who received a new testosterone prescription, had ≥ 2 clinic visits at VAPSHCS, and no previous testosterone prescription in the previous 2 years. Individuals were excluded if they had testosterone administered at VAPSHCS; were prescribed testosterone at another facility (VA or community-based); pilot tested an initial version of the TOT prior to November 30, 2019; or had an International Classification of Diseases, Tenth Revision codes for hypopituitarism, gender identity disorder, history of sexual assignment, or Klinefelter syndrome for which testosterone therapy was already approved. Patients who met the inclusion criteria were identified by an algorithm developed by the VAPSHCS pharmacoeconomist.

This quality improvement project used a retrospective, pre-post experimental design. Electronic chart review and systematic manual review of all eligible patient charts were performed for the pretemplate period (December 1, 2018, to November 30, 2019) and after the template implementation, (December 1, 2021, to November 30, 2022).

An initial version of the TOT was implemented on July 1, 2019, but was not fully integrated into CPRS until early 2020; individuals in whom the TOT was used prior to November 30, 2019, were excluded. Data from the initial period of the COVID-19 pandemic were avoided because of alterations in clinic and prescribing practices. As a quality improvement project, the TOT evaluation was exempt from formal review by the VAPSHCS Institutional Review Board, as determined by the Director of the Office of Transformation/Quality/Safety/Value.

Interventions

Testosterone is a Schedule III controlled substance with potential risks and a propensity for varied prescribing practices. It was designated as a restricted drug requiring a prior authorization drug request (PADR) for which a specific TOT was developed, approved by the VAPSHCS Pharmacy and Therapeutics Committee, and incorporated into CPRS. A team of pharmacists, primary care physicians, geriatricians, endocrinologists, and health informatics experts created and developed the TOT. Pharmacists managed and monitored its completion.

The process for prescribing testosterone via the TOT is outlined in the eAppendix. When an HCP orders testosterone in CPRS, reminders prompt them to use the TOT and indicate required laboratory measurements (an order set is provided). Completion of TOT is not necessary to order testosterone for patients with an existing diagnosis of an organic cause of hypogonadism (eg, Klinefelter syndrome or hypopituitarism) or transgender women (assigned male at birth). In the TOT, the prescriber must also indicate signs and symptoms of testosterone deficiency; required laboratory tests; and counseling regarding potential risks and benefits of TRT. A pharmacist reviews the TOT and either approves or rejects the testosterone prescription and provides follow-up guidance to the prescriber. The completed TOT serves as documentation of guideline adherence in CPRS. The TOT also includes sections for first renewal testosterone prescriptions, addressing guideline recommendations for follow-up laboratory evaluation and clinical response to TRT. Due to limited completion of this section in the posttemplate period, evaluating adherence to follow-up recommendations was not feasible.

Measures

This project assessed the percentage of patients in the posttemplate period vs pretemplate period with an approved PADR. Documentation of specific guideline-recommended measures was assessed: signs and symptoms of testosterone deficiency; ≥ 2 serum testosterone measurements (≥ 2 total, free and total, or 2 free testosterone levels, and ≥ 1 testosterone level before 10 am); serum follicle-stimulating hormone (FSH) and luteinizing hormone (LH) tests; discussion of the benefits and risks of testosterone treatment; and hematocrit measurement.

The project also assessed the proportion of patients in the posttemplate period vs pretemplate period who had all hormone tests (≥ 2 serum testosterone and LH and FSH concentrations), all laboratory tests (hormone tests and hematocrit), and all 5 guideline-recommended measures.

Analysis

Statistical comparisons between the proportions of patients in the pretemplate and posttemplate periods for each measure were performed using a χ² test, without correction for multiple comparisons. All analyses were conducted using Stata version 10.0. A P value < .05 was considered significant for all comparisons.

Results

Chart review identified 189 patients in the pretemplate period and 113 patients in the posttemplate period with a new testosterone prescription (Figure). After exclusions, 91 and 49 patients, respectively, met eligibility criteria (Table 1). Fifty-six patients (62%) pretemplate and 40 patients (82%) posttemplate (P = .015) had approved PADRs and comprised the groups that were analyzed (Table 2).

The mean age and body mass index were similar in the pretemplate and posttemplate periods, but there was variation in the proportions of patients aged < 70 years and those with a body mass index < 30 between the groups. The most common diagnosis in both groups was testicular hypofunction, and the most common comorbidity was type 2 diabetes mellitus. Concomitant use of opioids or glucocorticoids that can lower testosterone levels was rare. Most testosterone prescriptions originated from primary care clinics in both periods: 68 (75%) in the pretemplate period and 35 (71%) in the posttemplate period. Most testosterone treatment was delivered by intramuscular injection. 

In the posttemplate period vs pretemplate period, the proportion of patients with an approved PADR (82% vs 62%, P = .02), and documentation of signs and symptoms of hypogonadism (93% vs 71%, P = .002) prior to starting TRT were higher, while the percentage of patients having ≥ 2 testosterone measurements (85% vs 89%, P = .53), ≥ 1 testosterone level before 10 AM (78% vs 75%, P = .70), and hematocrit measured (95% vs 91%, P = .47) were similar. Rates of LH and FSH testing were higher in the posttemplate period (80%) vs the pretemplate period (63%) but did not achieve statistical significance (P = .07), and discussion of the risks and benefits of TRT was higher in the posttemplate period (58%) vs the pretemplate period (34%) (P = .02). The percentage of patients who had all hormone measurements (total and/or free testosterone, LH, and FSH) was higher in the posttemplate period (78%) vs the pretemplate period (59%) but did not achieve statistical significance (P = .06). The rates of all guideline-recommended laboratory test orders were higher in the posttemplate period (78%) vs the pretemplate period (55%) (P = .03), and all 5 guideline-recommended clinical and laboratory measures were higher in the posttemplate period (45%) vs the pretemplate period (18%) (P = .004).

Discussion

The implementation of a pharmacy-managed TOT in CPRS demonstrated higher adherence to evidence-based guidelines for diagnosing and evaluating hypogonadism before TRT. After TOT implementation, a higher proportion of patients had documented signs and symptoms of testosterone deficiency, underwent all recommended laboratory tests, and had discussions about the risks and benefits of TRT. Adherence to 5 clinical and laboratory measures recommended by Endocrine Society guidelines was higher after TOT implementation, indicating improved prescribing practices.⁴

The requirement for TOT completion before testosterone prescription and its management by trained pharmacists likely contributed to higher adherence to guideline recommendations than previously reported. Integration of the TOT into CPRS with pharmacy oversight may have enhanced adherence by summarizing and codifying evidence-based guideline recommendations for clinical and biochemical evaluation prior to TRT initiation, offering relevant education to clinicians and pharmacists, automatically importing pertinent clinical information and laboratory results, and generating CPRS documentation to reduce clinician burden during patient care. 

The proportion of patients with documented signs and symptoms of testosterone deficiency before TRT increased from the pretemplate period (71%) to the posttemplate period (93%), indicating that most patients receiving TRT had clinical manifestations of hypogonadism. This aligns with Endocrine Society guidelines, which define hypogonadism as a clinical disorder characterized by clinical manifestations of testosterone deficiency and persistently low serum testosterone levels on ≥ 2 separate occasions.^4,6 However, recent trends in direct-to-consumer advertising for testosterone and the rise of “low T” clinics may contribute to increased testing, varied practices, and inappropriate testosterone therapy initiation (eg, in men with low testosterone levels who lack symptoms of hypogonadism).¹⁸ Improved adherence in documenting clinical hypogonadism with implementation of the TOT reinforces the value of incorporating educational material, as previously reported.¹¹

Adherence to guideline recommendations following implementation of the TOT in this project was higher than those previously reported. In a study of 111,631 outpatient veterans prescribed testosterone from 2009 to 2012, only 18.3% had ≥ 2 testosterone prescriptions, and 3.5% had ≥ 2 testosterone, LH, and FSH levels measured prior to the initiation of a TRT.⁹ In a report of 63,534 insured patients who received TRT from 2010 to 2012, 40.3% had ≥ 2 testosterone prescriptions, and 12% had LH and/or FSH measured prior to the initiation.⁸

Low rates of guideline-recommended laboratory tests prior to initiation of testosterone treatment were reported in prior non-VA studies.^19,20 Poor guideline adherence reinforces the need for clinician education or other methods to improve TRT and ensure appropriate prescribing practices across health care systems. The TOT described in this project is a sustainable clinical tool with the potential to improve testosterone prescribing practices. 

The high rates of adherence to guideline recommendations at VAPSHCS likely stem from local endocrine expertise and ongoing educational initiatives, as well as the requirement for template completion before testosterone prescription. However, most testosterone prescriptions were initiated by primary care and monitored by pharmacists with varying degrees of training and clinical experience in hypogonadism and TRT.

However, adherence to guideline recommendations was modest, suggesting there is still an opportunity for improvement. The decision to initiate therapy should be made only after appropriate counseling with patients regarding its potential benefits and risks. Reports on the CV risk of TRT have been mixed. The 2023 TRAVERSE study found no increase in major adverse CV events among older men with hypogonadism and pre-existing CV risks undergoing TRT, but noted higher instances of pulmonary embolism, atrial fibrillation, and acute kidney injury.²¹ This highlights the need for clinicians to continue to engage in informed decision-making with patients. Effective pretreatment counseling is important but time-consuming; future TOT monitoring and modifications could consider mandatory checkboxes to document counseling on TRT risks and benefits.

The TOT described in this study could be adapted and incorporated into the prescribing process and electronic health record of larger health care systems. Use of an electronic template allows for automatic real-time dashboard monitoring of organization performance. The TOT described could be modified or simplified for specialty or primary care clinics or individual practitioners to improve adherence to evidence-based guideline recommendations and quality of care.

Strengths

A strength of this study is the multidisciplinary team (composed of stakeholders with experience in VA health care system and subject matter experts in hypogonadism) that developed and incorporated a user-friendly template for testosterone prescriptions; the use of evidence-based guideline recommendations; and the use of a structured chart review permitted accurate assessment of adherence to recommendations to document signs and symptoms of testosterone deficiency and a discussion of potential risks and benefits prior to TRT. To our knowledge, these recommendations have not been assessed in previous reports.

Limitations

The retrospective pre-post design of this study precludes a conclusion that implementation of the TOT caused the increase in adherence to guideline recommendations. Improved adherence could have resulted from the ongoing development of the preauthorization process for testosterone prescriptions or other changes over time. However, the preauthorization process had already been established for many years prior to template implementation. Forty-nine patients had new prescriptions for testosterone in the posttemplate period compared to 91 in the pretemplate period, but TRT was initiated in accordance with guideline recommendations more appropriately in the posttemplate period. The study’s sample size was small, and many eligible patients were excluded; however, exclusions were necessary to evaluate men who had new testosterone prescriptions for which the template was designed. Most men excluded were already taking testosterone.

Conclusions

The implementation of a CPRS-based TOT improved adherence to evidence-based guidelines for the diagnosis, evaluation, and counseling of patients with hypogonadism before starting TRT. While there were improvements in adherence with the TOT, the relatively low proportion of patients with documentation of TRT risks and benefits and all guideline recommendations highlights the need for additional efforts to further strengthen adherence to guideline recommendations and ensure appropriate evaluation, counseling, and prescribing practices before initiating TRT.

Testosterone therapy is administered following pragmatic diagnostic evaluation and workup to assess whether an adult male is hypogonadal, based on symptoms consistent with androgen deficiency and low morning serum testosterone concentrations on ≥ 2 occasions. Effects of testosterone administration include the development or maintenance of secondary sexual characteristics and increases in libido, muscle strength, fat-free mass, and bone density.

Testosterone prescriptions have markedly increased in the past 20 years, including within the US Department of Veterans Affairs (VA) health care system.^1-3 This trend may be influenced by various factors, including patient perceptions of benefit, an increase in marketing, and the availability of more user-friendly formulations. 

Since 2006, evidence-based clinical practice guidelines have recommended specific clinical and laboratory evaluation and counseling prior to starting testosterone replacement therapy (TRT).^4-8 However, research has shown poor adherence to these recommendations, including at the VA, which raises concerns about inappropriate TRT initiation without proper diagnostic evaluation.^9,10 Observational research has suggested a possible link between testosterone therapy and increased risk of cardiovascular (CV) events. The US Food and Drug Administration prescribing information includes boxed warnings about potential risks of high blood pressure, myocardial infarction, stroke, and CV-related mortality with testosterone treatment, contact transfer of transdermal testosterone, and pulmonary oil microembolism with testosterone undecanoate injections.^11-15

A VA Office of Inspector General (OIG) review of VA clinician adherence to clinical and laboratory evaluation guidelines for testosterone deficiency found poor adherence among VA practitioners and made recommendations for improvement.^4,15 These focused on establishing clinical signs and symptoms consistent with testosterone deficiency, confirming hypogonadism by repeated testosterone testing, determining the etiology of hypogonadism by measuring gonadotropins, initiating a discussion of risks and benefits of TRT, and assessing clinical improvement and obtaining an updated hematocrit test within 3 to 6 months of initiation.

The VA Puget Sound Health Care System (VAPSHCS) developed a local prior authorization template to assist health care practitioners (HCPs) to address the OIG recommendations. This testosterone order template (TOT) aimed to improve the diagnosis, evaluation, and monitoring of TRT in males with hypogonadism, combined with existing VA pharmacy criteria for the use of testosterone based on Endocrine Society guidelines. A version of the VAPSHCS TOT was approved as the national VA Computerized Patient Record System (CPRS) template.

Preliminary evaluation of the TOT suggested improved short-term adherence to guideline recommendations following implementation.¹⁶ This quality improvement study sought to assess the long-term effectiveness of the TOT with respect to clinical practice guideline adherence. The OIG did not address prostate-specific antigen (PSA) monitoring because understanding of the relationship between TRT and the risks of elevated PSA levels remains incomplete.^6,17 This project hypothesized that implementation of a pharmacy-managed TOT incorporated into CPRS would result in higher adherence rates to guideline-recommended clinical and laboratory evaluation, in addition to counseling of men with hypogonadism prior to initiation of TRT.

Methods

Eligible participants were cisgender males who received a new testosterone prescription, had ≥ 2 clinic visits at VAPSHCS, and no previous testosterone prescription in the previous 2 years. Individuals were excluded if they had testosterone administered at VAPSHCS; were prescribed testosterone at another facility (VA or community-based); pilot tested an initial version of the TOT prior to November 30, 2019; or had an International Classification of Diseases, Tenth Revision codes for hypopituitarism, gender identity disorder, history of sexual assignment, or Klinefelter syndrome for which testosterone therapy was already approved. Patients who met the inclusion criteria were identified by an algorithm developed by the VAPSHCS pharmacoeconomist.

This quality improvement project used a retrospective, pre-post experimental design. Electronic chart review and systematic manual review of all eligible patient charts were performed for the pretemplate period (December 1, 2018, to November 30, 2019) and after the template implementation, (December 1, 2021, to November 30, 2022).

An initial version of the TOT was implemented on July 1, 2019, but was not fully integrated into CPRS until early 2020; individuals in whom the TOT was used prior to November 30, 2019, were excluded. Data from the initial period of the COVID-19 pandemic were avoided because of alterations in clinic and prescribing practices. As a quality improvement project, the TOT evaluation was exempt from formal review by the VAPSHCS Institutional Review Board, as determined by the Director of the Office of Transformation/Quality/Safety/Value.

Interventions

Testosterone is a Schedule III controlled substance with potential risks and a propensity for varied prescribing practices. It was designated as a restricted drug requiring a prior authorization drug request (PADR) for which a specific TOT was developed, approved by the VAPSHCS Pharmacy and Therapeutics Committee, and incorporated into CPRS. A team of pharmacists, primary care physicians, geriatricians, endocrinologists, and health informatics experts created and developed the TOT. Pharmacists managed and monitored its completion.

The process for prescribing testosterone via the TOT is outlined in the eAppendix. When an HCP orders testosterone in CPRS, reminders prompt them to use the TOT and indicate required laboratory measurements (an order set is provided). Completion of TOT is not necessary to order testosterone for patients with an existing diagnosis of an organic cause of hypogonadism (eg, Klinefelter syndrome or hypopituitarism) or transgender women (assigned male at birth). In the TOT, the prescriber must also indicate signs and symptoms of testosterone deficiency; required laboratory tests; and counseling regarding potential risks and benefits of TRT. A pharmacist reviews the TOT and either approves or rejects the testosterone prescription and provides follow-up guidance to the prescriber. The completed TOT serves as documentation of guideline adherence in CPRS. The TOT also includes sections for first renewal testosterone prescriptions, addressing guideline recommendations for follow-up laboratory evaluation and clinical response to TRT. Due to limited completion of this section in the posttemplate period, evaluating adherence to follow-up recommendations was not feasible.

Measures

This project assessed the percentage of patients in the posttemplate period vs pretemplate period with an approved PADR. Documentation of specific guideline-recommended measures was assessed: signs and symptoms of testosterone deficiency; ≥ 2 serum testosterone measurements (≥ 2 total, free and total, or 2 free testosterone levels, and ≥ 1 testosterone level before 10 am); serum follicle-stimulating hormone (FSH) and luteinizing hormone (LH) tests; discussion of the benefits and risks of testosterone treatment; and hematocrit measurement.

The project also assessed the proportion of patients in the posttemplate period vs pretemplate period who had all hormone tests (≥ 2 serum testosterone and LH and FSH concentrations), all laboratory tests (hormone tests and hematocrit), and all 5 guideline-recommended measures.

Analysis

Statistical comparisons between the proportions of patients in the pretemplate and posttemplate periods for each measure were performed using a χ² test, without correction for multiple comparisons. All analyses were conducted using Stata version 10.0. A P value < .05 was considered significant for all comparisons.

Results

Chart review identified 189 patients in the pretemplate period and 113 patients in the posttemplate period with a new testosterone prescription (Figure). After exclusions, 91 and 49 patients, respectively, met eligibility criteria (Table 1). Fifty-six patients (62%) pretemplate and 40 patients (82%) posttemplate (P = .015) had approved PADRs and comprised the groups that were analyzed (Table 2).

The mean age and body mass index were similar in the pretemplate and posttemplate periods, but there was variation in the proportions of patients aged < 70 years and those with a body mass index < 30 between the groups. The most common diagnosis in both groups was testicular hypofunction, and the most common comorbidity was type 2 diabetes mellitus. Concomitant use of opioids or glucocorticoids that can lower testosterone levels was rare. Most testosterone prescriptions originated from primary care clinics in both periods: 68 (75%) in the pretemplate period and 35 (71%) in the posttemplate period. Most testosterone treatment was delivered by intramuscular injection. 

In the posttemplate period vs pretemplate period, the proportion of patients with an approved PADR (82% vs 62%, P = .02), and documentation of signs and symptoms of hypogonadism (93% vs 71%, P = .002) prior to starting TRT were higher, while the percentage of patients having ≥ 2 testosterone measurements (85% vs 89%, P = .53), ≥ 1 testosterone level before 10 AM (78% vs 75%, P = .70), and hematocrit measured (95% vs 91%, P = .47) were similar. Rates of LH and FSH testing were higher in the posttemplate period (80%) vs the pretemplate period (63%) but did not achieve statistical significance (P = .07), and discussion of the risks and benefits of TRT was higher in the posttemplate period (58%) vs the pretemplate period (34%) (P = .02). The percentage of patients who had all hormone measurements (total and/or free testosterone, LH, and FSH) was higher in the posttemplate period (78%) vs the pretemplate period (59%) but did not achieve statistical significance (P = .06). The rates of all guideline-recommended laboratory test orders were higher in the posttemplate period (78%) vs the pretemplate period (55%) (P = .03), and all 5 guideline-recommended clinical and laboratory measures were higher in the posttemplate period (45%) vs the pretemplate period (18%) (P = .004).

Discussion

The implementation of a pharmacy-managed TOT in CPRS demonstrated higher adherence to evidence-based guidelines for diagnosing and evaluating hypogonadism before TRT. After TOT implementation, a higher proportion of patients had documented signs and symptoms of testosterone deficiency, underwent all recommended laboratory tests, and had discussions about the risks and benefits of TRT. Adherence to 5 clinical and laboratory measures recommended by Endocrine Society guidelines was higher after TOT implementation, indicating improved prescribing practices.⁴

The requirement for TOT completion before testosterone prescription and its management by trained pharmacists likely contributed to higher adherence to guideline recommendations than previously reported. Integration of the TOT into CPRS with pharmacy oversight may have enhanced adherence by summarizing and codifying evidence-based guideline recommendations for clinical and biochemical evaluation prior to TRT initiation, offering relevant education to clinicians and pharmacists, automatically importing pertinent clinical information and laboratory results, and generating CPRS documentation to reduce clinician burden during patient care. 

The proportion of patients with documented signs and symptoms of testosterone deficiency before TRT increased from the pretemplate period (71%) to the posttemplate period (93%), indicating that most patients receiving TRT had clinical manifestations of hypogonadism. This aligns with Endocrine Society guidelines, which define hypogonadism as a clinical disorder characterized by clinical manifestations of testosterone deficiency and persistently low serum testosterone levels on ≥ 2 separate occasions.^4,6 However, recent trends in direct-to-consumer advertising for testosterone and the rise of “low T” clinics may contribute to increased testing, varied practices, and inappropriate testosterone therapy initiation (eg, in men with low testosterone levels who lack symptoms of hypogonadism).¹⁸ Improved adherence in documenting clinical hypogonadism with implementation of the TOT reinforces the value of incorporating educational material, as previously reported.¹¹

Adherence to guideline recommendations following implementation of the TOT in this project was higher than those previously reported. In a study of 111,631 outpatient veterans prescribed testosterone from 2009 to 2012, only 18.3% had ≥ 2 testosterone prescriptions, and 3.5% had ≥ 2 testosterone, LH, and FSH levels measured prior to the initiation of a TRT.⁹ In a report of 63,534 insured patients who received TRT from 2010 to 2012, 40.3% had ≥ 2 testosterone prescriptions, and 12% had LH and/or FSH measured prior to the initiation.⁸

Low rates of guideline-recommended laboratory tests prior to initiation of testosterone treatment were reported in prior non-VA studies.^19,20 Poor guideline adherence reinforces the need for clinician education or other methods to improve TRT and ensure appropriate prescribing practices across health care systems. The TOT described in this project is a sustainable clinical tool with the potential to improve testosterone prescribing practices. 

The high rates of adherence to guideline recommendations at VAPSHCS likely stem from local endocrine expertise and ongoing educational initiatives, as well as the requirement for template completion before testosterone prescription. However, most testosterone prescriptions were initiated by primary care and monitored by pharmacists with varying degrees of training and clinical experience in hypogonadism and TRT.

However, adherence to guideline recommendations was modest, suggesting there is still an opportunity for improvement. The decision to initiate therapy should be made only after appropriate counseling with patients regarding its potential benefits and risks. Reports on the CV risk of TRT have been mixed. The 2023 TRAVERSE study found no increase in major adverse CV events among older men with hypogonadism and pre-existing CV risks undergoing TRT, but noted higher instances of pulmonary embolism, atrial fibrillation, and acute kidney injury.²¹ This highlights the need for clinicians to continue to engage in informed decision-making with patients. Effective pretreatment counseling is important but time-consuming; future TOT monitoring and modifications could consider mandatory checkboxes to document counseling on TRT risks and benefits.

The TOT described in this study could be adapted and incorporated into the prescribing process and electronic health record of larger health care systems. Use of an electronic template allows for automatic real-time dashboard monitoring of organization performance. The TOT described could be modified or simplified for specialty or primary care clinics or individual practitioners to improve adherence to evidence-based guideline recommendations and quality of care.

Strengths

A strength of this study is the multidisciplinary team (composed of stakeholders with experience in VA health care system and subject matter experts in hypogonadism) that developed and incorporated a user-friendly template for testosterone prescriptions; the use of evidence-based guideline recommendations; and the use of a structured chart review permitted accurate assessment of adherence to recommendations to document signs and symptoms of testosterone deficiency and a discussion of potential risks and benefits prior to TRT. To our knowledge, these recommendations have not been assessed in previous reports.

Limitations

The retrospective pre-post design of this study precludes a conclusion that implementation of the TOT caused the increase in adherence to guideline recommendations. Improved adherence could have resulted from the ongoing development of the preauthorization process for testosterone prescriptions or other changes over time. However, the preauthorization process had already been established for many years prior to template implementation. Forty-nine patients had new prescriptions for testosterone in the posttemplate period compared to 91 in the pretemplate period, but TRT was initiated in accordance with guideline recommendations more appropriately in the posttemplate period. The study’s sample size was small, and many eligible patients were excluded; however, exclusions were necessary to evaluate men who had new testosterone prescriptions for which the template was designed. Most men excluded were already taking testosterone.

Conclusions

The implementation of a CPRS-based TOT improved adherence to evidence-based guidelines for the diagnosis, evaluation, and counseling of patients with hypogonadism before starting TRT. While there were improvements in adherence with the TOT, the relatively low proportion of patients with documentation of TRT risks and benefits and all guideline recommendations highlights the need for additional efforts to further strengthen adherence to guideline recommendations and ensure appropriate evaluation, counseling, and prescribing practices before initiating TRT.

Testosterone treatment is clinically indicated when a patient presents with symptoms and signs and biochemical evidence of testosterone deficiency, ie, male hypogonadism. Laboratory confirmation of hypogonadism requires repeatedly low serum testosterone concentrations; between 8 am and 10 am on ≥ 2 separate occasions, and evaluation should include measurement of gonadotropin, follicle-stimulating hormone (FSH), and luteinizing hormone (LH) concentrations. If the diagnosis of hypogonadism is established, it is important to determine whether the etiology is due to a structural or congenital disorder of the hypothalamic-pituitary-testicular (HPT) axis (organic hypogonadism) or a comorbid condition that results in suppressed function of an intact HPT axis and that is potentially reversible or treatable (functional hypogonadism).^1,2 Prior to initiation of treatment, clinicians should discuss potential benefits and risks of testosterone and monitoring during treatment, using a shared decision-making process with the patient.¹

Recent studies have reported an increase in testosterone prescriptions and raised concerns regarding health care provider (HCP) prescribing practices despite current clinical practice guidelines from major societies, such as the Endocrine Society. In the US from 2001 to 2011, testosterone use among men aged ≥ 40 years increased more than 3-fold in all age groups.³ Subsequently in the years from 2013 to 2016, prescription rates declined perhaps due to the cardiovascular and stroke concerns.⁴

In the US Department of Veterans Affairs (VA), new testosterone prescriptions across VA medical centers increased from 20,437 in fiscal year (FY) 2009 to 36,394 in FY 2012. Yet only 3.1% of men who received testosterone therapy had 2 or more low morning total or free testosterone concentrations measured; LH and/or FSH levels assessed; and presence of contraindications to therapy documented. Remarkably, 16.5% of these veterans did not have a testosterone level tested prior to being prescribed testosterone. Among veterans who were prescribed testosterone, 1.4% had a diagnosis of prostate cancer, 7.6% had a diagnosis of obstructive sleep apnea (OSA), and 3.5% had elevated hematocrit at baseline.⁵ These findings raised concerns of whether the diagnosis and etiology of hypogonadism were appropriately established and risks were considered before testosterone treatment was initiated.^5,6

To further understand VA prescribing practices of testosterone therapy, a 2018 VA Office of the Inspector General (OIG) report evaluated the initiation and follow-up of testosterone replacement therapy. The OIG randomly sampled and reviewed 1,091 male patients who filled at least 1 outpatient testosterone prescription from VA in FY 2014 and who did not have a prior testosterone prescription in FY 2013. Patients were followed through September 30, 2015. Within 1 year prior to initiating testosterone, only 1.5% had clinical signs and symptoms of testosterone deficiency documented prior to testosterone testing (76% within 18 months of starting testosterone); only 9.1% of veterans had the recommended measurements of 2 low morning testosterone levels; and only 12% had LH and FSH levels measured. Within 3 to 6 months after starting testosterone therapy, only 24% of veterans were assessed for symptom improvement, and 29% to 33% were evaluated for adverse effects, hematocrit levels and adherence to the therapy. The OIG report concluded that VA HCPs were not adhering to guidelines (referencing the Endocrine Society guidelines) when evaluating and treating veterans with testosterone deficiency.⁷

Considering the OIG recommendations and need to improve current practices among providers, VA Puget Sound Health Care System (VAPSHCS) in Washington established a multidisciplinary workgroup consisting of an endocrinologist, geriatrician, primary care provider (PCP), pharmacists, VA information technology (IT) specialist, and health products support (HPS) clinical team in the spring of 2019 to assess and improve testosterone prescribing practices.

Methods

A testosterone order template was developed, approved by VAPSHCS Pharmacy and Therapeutics Committee, and implemented on July 1, 2019, at VAPSHCS, a 1a medical facility caring for more than 112,000 veterans. Given its potential risks and the propensity for varied prescribing practices, testosterone was designated as a restricted drug requiring a prior authorization drug request (PADR) and required completion of the testosterone order template in the Computerized Patient Record System (CPRS).

Testosterone Order Template

The testosterone order template had 2 components. Completion of the template for new testosterone orders was required to initiate treatment unless the patient had known organic hypogonadism or was a transgender male. The template ensured documentation of defined symptoms and signs of testosterone deficiency; low serum testosterone levels on at least 2 occasions and LH and FSH concentrations; no contraindications to testosterone treatment; discussion of risks and benefits of therapy; and baseline hematocrit (Figure 1). Relevant educational content (eg, risks and benefits of testosterone) was incorporated in the template. The second template was required for the first renewal of testosterone to document adherence to or reason for discontinuation of testosterone; improvement of symptoms and signs; and confirm monitoring hematocrit and testosterone levels during treatment.

Prior to implementation, the PADR template was introduced to HCPs at 2 chief-of-medicine rounds on the diagnosis and evaluation of hypogonadism by a pharmacist and endocrinologist. These educational sessions used case examples and discussions to teach the appropriate use of testosterone therapy in men with hypogonadism. The target audience was PCPs, residents, and other specialists who might prescribe testosterone.

Retrospective Chart Review

To assess the impact of the new testosterone order template on adherence to OIG recommendations, a retrospective chart review was completed comparing the appropriateness of initiating testosterone replacement therapy pretemplate period (July 1 to December 31, 2018) vs posttemplate period (July 1 to December 31, 2019). Inclusion and exclusion criteria were modeled after the 2018 OIG report to allow for comparison with the OIG study population. Eligible veterans in each time period included males who received a new testosterone prescription without having been prescribed testosterone in the previous 12 months. Exclusion criteria included community care network prescriptions (CCNRx); current testosterone prescription from a different VA site; clinic administration of testosterone in the previous 12 months; an organic hypogonadism (ie, Klinefelter syndrome) or gender dysphoria diagnosis; and whether the testosterone prescription was never dispensed (PADR was denied or veteran never had the prescription filled). Veterans who met the inclusion criteria in CPRS were identified by an algorithm developed by the VAPSHCS pharmacoeconomist.

Determining the appropriateness of testosterone prescribing, such as symptoms and laboratory measurements to confirm the diagnosis of hypogonadism, was based on the OIG report and Endocrine Society guidelines. A chart review of the 12 months before testosterone prescribing was completed for each veteran, assessing for documentation of symptoms of testosterone deficiency and laboratory measurements of serum testosterone, LH, and FSH. Also, documentation of a discussion of risks and benefits of testosterone therapy in the 3 months before prescribing was assessed, which matched the timeframe in the VA OIG report.

Interim Analysis

After initial template implementation, the multidisciplinary workgroup reconvened for a preplanned interim analysis in November 2019. The evaluation at this meeting revealed multiple order pathways in CPRS that were not linked to the PADR testosterone order template. Testosterone could be ordered in the generic order dialog, medications by drug class, and medications by alphabet, and endocrinology specialty menus without prompting to complete the testosterone order template or redirection to the restricted drug menu (Figure 2). These alternative testosterone ordering pathways were removed in early December 2019 and additional data collection was conducted for 3 months after discontinuation of alternative order pathways, the posttemplate/no alternative ordering pathways period, from December 7, 2019 to February 29, 2020.

Exclusion of Previous Testosterone Prescriptions Predating Chart Review Period, Subgroup Analysis

In the OIG report and the initial retrospective chart review, only veterans without a testosterone prescription in the previous 12 months were evaluated. To assess whether a previous testosterone prescription influenced completion of the PADR and order template, a further subgroup analysis was conducted that excluded veterans who had a previous testosterone prescription at any time before the chart review periods. Therefore, “new testosterone prescription” refers to a veteran who never had a history of being on testosterone vs “former testosterone prescription,” meaning a patient could have had a previous testosterone prescription > 1 year prior to a new VA testosterone prescription.

Results

One hundred seventy-five veterans with a new testosterone prescription were identified in the pretemplate period; of these 80 (46%) met eligibility criteria; only 20 eligible veterans (25%) had a completed PADR (Figure 3). Ninety-one veterans with a new testosterone prescription were identified in the posttemplate period of which 41 (46%) veterans were eligible; 18 eligible veterans (44%) had a completed PADR, but only 7 (17%) had a completed testosterone order template.

After excluding veterans who had alternative ordering pathways for testosterone, 46 veterans were identified in the posttemplate/no alternative ordering pathways period of which 19 (41%) veterans were eligible. Compared with the posttemplate period, a higher proportion of eligible veterans, 68% (13) had a completed PADR, and 58% (11) had a testosterone order template during the posttemplate/no alternative ordering pathways period.

Discussion

The 2018 OIG report found that VA practitioners demonstrated poor adherence to evidence-based clinical practice guidelines for testosterone treatment in men with hypogonadism. Based on OIG recommendations, we developed a PADR testosterone ordering template to help HCPs improve practice by better adherence to guidelines for the diagnosis and treatment of hypogonadism in veterans. Before implementation of the PADR template, the percentage of veterans at VAPSHCS who had biochemical confirmation of hypogonadism was higher than that in the OIG report. Activation of the PADR testosterone ordering template (with or without removal of options for alternative ordering pathways of testosterone) resulted only in an improvement of laboratory confirmation and evaluation of etiology of hypogonadism. This is when we reasoned that clinicians may have access to prior records and laboratory testing beyond just the past year, and this information may have influenced their use of the PADR template. Subsequently, with exclusion of veterans who were previously prescribed testosterone, implementation of the PADR testosterone order template improved documentation of symptoms of testosterone deficiency, discussion of risks and benefits of testosterone therapy, and biochemical diagnosis and evaluation of hypogonadism relative to the period before implementation.

The lack of effects of implementing the testosterone order template on documentation of symptoms of testosterone deficiency and discussion of risks and benefits of testosterone therapy may be due to local expertise resulting in the relatively high adherence to these guideline recommendations at VAPSHCS before activation of the template vs that in the OIG report. The template improved documentation of the diagnosis and evaluation of hypogonadism for genuinely new testosterone prescriptions in veterans without a history of testosterone prescriptions; while those with a previous prescription had limited improvement. It is possible that in veterans who had testosterone prescribed previously, HCPs may have assumed or had bias that the diagnosis and evaluation of hypogonadism originally made was adequate. This finding underscores the need to develop strategies for reviewing PADR requests where there is historical testosterone use. Perhaps a clinical team member, such as a clinical pharmacist, with the background and training in guidelines for the evaluation of hypogonadism could review PADR requests in veterans with previous testosterone use.

Removal of alternative ordering pathways for testosterone increased the completion rate of PADR requests and the testosterone ordering template, although the latter was not completed in one-third of veterans. Possible reasons for HCPs’ suboptimal completion of the testosterone template despite the PADR initiation include clinicians’ lack of willingness to read the PADR completely and familiarize themselves with the clinical guidelines due to workload demands of PCPs. In addition there maybe pressure from patients to receive testosterone for age-related symptoms due to heavy marketing. In addition, there may have been pharmacists who reviewed the PADR and approved the incomplete testosterone template. At VAPSHCS there were up to 40 pharmacists during different periods reviewing the testosterone PADRs. Likely, not everyone was completely familiar with this implementation process, and a possible future consideration would be further education to staff pharmacists who are verifying these prescriptions. There were several advantages to using this new testosterone order template when HCPs attempted to order a prescription. First, they were prompted to complete the PADR. Subsequently, a pharmacist reviewed the template and approved or rejected the prescription if the template was incomplete. The completed template served as documentation in the electronic health record for the prescribing HCP. The template was constructed to populate the required laboratory tests for ease of use and documentation. In addition, educational information regarding the symptoms and signs of testosterone deficiency, laboratory tests needed to confirm and evaluate hypogonadism, contraindications to testosterone treatment, and risks and benefits of therapy were incorporated into the template to assist HCPs in understanding the requirements for a complete diagnosis and evaluation. Finally, on completion of the template, HCPs were able to order testosterone via link to various testosterone formulations.

Before its implementation, the PADR testosterone order template was introduced to PCPs and internal medicine residents at 2 case-based conferences aimed at the diagnosis and treatment of male hypogonadism. These conferences were well received and helped launch the testosterone PADR template at VAPSHCS. Similar outreach to HCPs who prescribe testosterone is highly recommended in other VA facilities before implementation of the testosterone ordering template. It is possible that more targeted education to other HCPs would have resulted in greater use of the testosterone ordering template and adherence to clinical practice guidelines.

The VAPSHCS multidisciplinary workgroup was essential for the development, implementation, evaluation, and revision of the PADR and testosterone ordering template. The workgroup met routinely to follow up on the ease of installation in CPRS and discuss technical corrections that were needed. This was an essential for quality improvement, as loopholes in CPRS were identified where the HCP could order testosterone without being prompted to use the new PADR testosterone order template (alternative ordering pathways). The workgroup swiftly informed the IT specialist and HPS team to remove alternative ordering pathways of testosterone. Continuous quality improvement evaluations are highly recommended during implementation of the template in other facilities to accommodate specific local modifications that might be needed.

Conclusions

The creation and implementation of a PADR testosterone order template may be a beneficial approach to improve the diagnosis of hypogonadism and facilitate appropriate use of testosterone therapy in veterans in accordance with established clinical practice guidelines, particularly in veterans without any prior testosterone use. Key future strategies to improve testosterone prescribing should focus on identifying clinical team members, such as a local clinical pharmacist, to review and steward PADR requests to ensure that testosterone is indicated, and treatment is appropriately monitored.

Testosterone treatment is clinically indicated when a patient presents with symptoms and signs and biochemical evidence of testosterone deficiency, ie, male hypogonadism. Laboratory confirmation of hypogonadism requires repeatedly low serum testosterone concentrations; between 8 am and 10 am on ≥ 2 separate occasions, and evaluation should include measurement of gonadotropin, follicle-stimulating hormone (FSH), and luteinizing hormone (LH) concentrations. If the diagnosis of hypogonadism is established, it is important to determine whether the etiology is due to a structural or congenital disorder of the hypothalamic-pituitary-testicular (HPT) axis (organic hypogonadism) or a comorbid condition that results in suppressed function of an intact HPT axis and that is potentially reversible or treatable (functional hypogonadism).^1,2 Prior to initiation of treatment, clinicians should discuss potential benefits and risks of testosterone and monitoring during treatment, using a shared decision-making process with the patient.¹

Recent studies have reported an increase in testosterone prescriptions and raised concerns regarding health care provider (HCP) prescribing practices despite current clinical practice guidelines from major societies, such as the Endocrine Society. In the US from 2001 to 2011, testosterone use among men aged ≥ 40 years increased more than 3-fold in all age groups.³ Subsequently in the years from 2013 to 2016, prescription rates declined perhaps due to the cardiovascular and stroke concerns.⁴

In the US Department of Veterans Affairs (VA), new testosterone prescriptions across VA medical centers increased from 20,437 in fiscal year (FY) 2009 to 36,394 in FY 2012. Yet only 3.1% of men who received testosterone therapy had 2 or more low morning total or free testosterone concentrations measured; LH and/or FSH levels assessed; and presence of contraindications to therapy documented. Remarkably, 16.5% of these veterans did not have a testosterone level tested prior to being prescribed testosterone. Among veterans who were prescribed testosterone, 1.4% had a diagnosis of prostate cancer, 7.6% had a diagnosis of obstructive sleep apnea (OSA), and 3.5% had elevated hematocrit at baseline.⁵ These findings raised concerns of whether the diagnosis and etiology of hypogonadism were appropriately established and risks were considered before testosterone treatment was initiated.^5,6

To further understand VA prescribing practices of testosterone therapy, a 2018 VA Office of the Inspector General (OIG) report evaluated the initiation and follow-up of testosterone replacement therapy. The OIG randomly sampled and reviewed 1,091 male patients who filled at least 1 outpatient testosterone prescription from VA in FY 2014 and who did not have a prior testosterone prescription in FY 2013. Patients were followed through September 30, 2015. Within 1 year prior to initiating testosterone, only 1.5% had clinical signs and symptoms of testosterone deficiency documented prior to testosterone testing (76% within 18 months of starting testosterone); only 9.1% of veterans had the recommended measurements of 2 low morning testosterone levels; and only 12% had LH and FSH levels measured. Within 3 to 6 months after starting testosterone therapy, only 24% of veterans were assessed for symptom improvement, and 29% to 33% were evaluated for adverse effects, hematocrit levels and adherence to the therapy. The OIG report concluded that VA HCPs were not adhering to guidelines (referencing the Endocrine Society guidelines) when evaluating and treating veterans with testosterone deficiency.⁷

Considering the OIG recommendations and need to improve current practices among providers, VA Puget Sound Health Care System (VAPSHCS) in Washington established a multidisciplinary workgroup consisting of an endocrinologist, geriatrician, primary care provider (PCP), pharmacists, VA information technology (IT) specialist, and health products support (HPS) clinical team in the spring of 2019 to assess and improve testosterone prescribing practices.

Methods

A testosterone order template was developed, approved by VAPSHCS Pharmacy and Therapeutics Committee, and implemented on July 1, 2019, at VAPSHCS, a 1a medical facility caring for more than 112,000 veterans. Given its potential risks and the propensity for varied prescribing practices, testosterone was designated as a restricted drug requiring a prior authorization drug request (PADR) and required completion of the testosterone order template in the Computerized Patient Record System (CPRS).

Testosterone Order Template

The testosterone order template had 2 components. Completion of the template for new testosterone orders was required to initiate treatment unless the patient had known organic hypogonadism or was a transgender male. The template ensured documentation of defined symptoms and signs of testosterone deficiency; low serum testosterone levels on at least 2 occasions and LH and FSH concentrations; no contraindications to testosterone treatment; discussion of risks and benefits of therapy; and baseline hematocrit (Figure 1). Relevant educational content (eg, risks and benefits of testosterone) was incorporated in the template. The second template was required for the first renewal of testosterone to document adherence to or reason for discontinuation of testosterone; improvement of symptoms and signs; and confirm monitoring hematocrit and testosterone levels during treatment.

Prior to implementation, the PADR template was introduced to HCPs at 2 chief-of-medicine rounds on the diagnosis and evaluation of hypogonadism by a pharmacist and endocrinologist. These educational sessions used case examples and discussions to teach the appropriate use of testosterone therapy in men with hypogonadism. The target audience was PCPs, residents, and other specialists who might prescribe testosterone.

Retrospective Chart Review

To assess the impact of the new testosterone order template on adherence to OIG recommendations, a retrospective chart review was completed comparing the appropriateness of initiating testosterone replacement therapy pretemplate period (July 1 to December 31, 2018) vs posttemplate period (July 1 to December 31, 2019). Inclusion and exclusion criteria were modeled after the 2018 OIG report to allow for comparison with the OIG study population. Eligible veterans in each time period included males who received a new testosterone prescription without having been prescribed testosterone in the previous 12 months. Exclusion criteria included community care network prescriptions (CCNRx); current testosterone prescription from a different VA site; clinic administration of testosterone in the previous 12 months; an organic hypogonadism (ie, Klinefelter syndrome) or gender dysphoria diagnosis; and whether the testosterone prescription was never dispensed (PADR was denied or veteran never had the prescription filled). Veterans who met the inclusion criteria in CPRS were identified by an algorithm developed by the VAPSHCS pharmacoeconomist.

Determining the appropriateness of testosterone prescribing, such as symptoms and laboratory measurements to confirm the diagnosis of hypogonadism, was based on the OIG report and Endocrine Society guidelines. A chart review of the 12 months before testosterone prescribing was completed for each veteran, assessing for documentation of symptoms of testosterone deficiency and laboratory measurements of serum testosterone, LH, and FSH. Also, documentation of a discussion of risks and benefits of testosterone therapy in the 3 months before prescribing was assessed, which matched the timeframe in the VA OIG report.

Interim Analysis

After initial template implementation, the multidisciplinary workgroup reconvened for a preplanned interim analysis in November 2019. The evaluation at this meeting revealed multiple order pathways in CPRS that were not linked to the PADR testosterone order template. Testosterone could be ordered in the generic order dialog, medications by drug class, and medications by alphabet, and endocrinology specialty menus without prompting to complete the testosterone order template or redirection to the restricted drug menu (Figure 2). These alternative testosterone ordering pathways were removed in early December 2019 and additional data collection was conducted for 3 months after discontinuation of alternative order pathways, the posttemplate/no alternative ordering pathways period, from December 7, 2019 to February 29, 2020.

Exclusion of Previous Testosterone Prescriptions Predating Chart Review Period, Subgroup Analysis

In the OIG report and the initial retrospective chart review, only veterans without a testosterone prescription in the previous 12 months were evaluated. To assess whether a previous testosterone prescription influenced completion of the PADR and order template, a further subgroup analysis was conducted that excluded veterans who had a previous testosterone prescription at any time before the chart review periods. Therefore, “new testosterone prescription” refers to a veteran who never had a history of being on testosterone vs “former testosterone prescription,” meaning a patient could have had a previous testosterone prescription > 1 year prior to a new VA testosterone prescription.

Results

One hundred seventy-five veterans with a new testosterone prescription were identified in the pretemplate period; of these 80 (46%) met eligibility criteria; only 20 eligible veterans (25%) had a completed PADR (Figure 3). Ninety-one veterans with a new testosterone prescription were identified in the posttemplate period of which 41 (46%) veterans were eligible; 18 eligible veterans (44%) had a completed PADR, but only 7 (17%) had a completed testosterone order template.

After excluding veterans who had alternative ordering pathways for testosterone, 46 veterans were identified in the posttemplate/no alternative ordering pathways period of which 19 (41%) veterans were eligible. Compared with the posttemplate period, a higher proportion of eligible veterans, 68% (13) had a completed PADR, and 58% (11) had a testosterone order template during the posttemplate/no alternative ordering pathways period.

Discussion

The 2018 OIG report found that VA practitioners demonstrated poor adherence to evidence-based clinical practice guidelines for testosterone treatment in men with hypogonadism. Based on OIG recommendations, we developed a PADR testosterone ordering template to help HCPs improve practice by better adherence to guidelines for the diagnosis and treatment of hypogonadism in veterans. Before implementation of the PADR template, the percentage of veterans at VAPSHCS who had biochemical confirmation of hypogonadism was higher than that in the OIG report. Activation of the PADR testosterone ordering template (with or without removal of options for alternative ordering pathways of testosterone) resulted only in an improvement of laboratory confirmation and evaluation of etiology of hypogonadism. This is when we reasoned that clinicians may have access to prior records and laboratory testing beyond just the past year, and this information may have influenced their use of the PADR template. Subsequently, with exclusion of veterans who were previously prescribed testosterone, implementation of the PADR testosterone order template improved documentation of symptoms of testosterone deficiency, discussion of risks and benefits of testosterone therapy, and biochemical diagnosis and evaluation of hypogonadism relative to the period before implementation.

The lack of effects of implementing the testosterone order template on documentation of symptoms of testosterone deficiency and discussion of risks and benefits of testosterone therapy may be due to local expertise resulting in the relatively high adherence to these guideline recommendations at VAPSHCS before activation of the template vs that in the OIG report. The template improved documentation of the diagnosis and evaluation of hypogonadism for genuinely new testosterone prescriptions in veterans without a history of testosterone prescriptions; while those with a previous prescription had limited improvement. It is possible that in veterans who had testosterone prescribed previously, HCPs may have assumed or had bias that the diagnosis and evaluation of hypogonadism originally made was adequate. This finding underscores the need to develop strategies for reviewing PADR requests where there is historical testosterone use. Perhaps a clinical team member, such as a clinical pharmacist, with the background and training in guidelines for the evaluation of hypogonadism could review PADR requests in veterans with previous testosterone use.

Removal of alternative ordering pathways for testosterone increased the completion rate of PADR requests and the testosterone ordering template, although the latter was not completed in one-third of veterans. Possible reasons for HCPs’ suboptimal completion of the testosterone template despite the PADR initiation include clinicians’ lack of willingness to read the PADR completely and familiarize themselves with the clinical guidelines due to workload demands of PCPs. In addition there maybe pressure from patients to receive testosterone for age-related symptoms due to heavy marketing. In addition, there may have been pharmacists who reviewed the PADR and approved the incomplete testosterone template. At VAPSHCS there were up to 40 pharmacists during different periods reviewing the testosterone PADRs. Likely, not everyone was completely familiar with this implementation process, and a possible future consideration would be further education to staff pharmacists who are verifying these prescriptions. There were several advantages to using this new testosterone order template when HCPs attempted to order a prescription. First, they were prompted to complete the PADR. Subsequently, a pharmacist reviewed the template and approved or rejected the prescription if the template was incomplete. The completed template served as documentation in the electronic health record for the prescribing HCP. The template was constructed to populate the required laboratory tests for ease of use and documentation. In addition, educational information regarding the symptoms and signs of testosterone deficiency, laboratory tests needed to confirm and evaluate hypogonadism, contraindications to testosterone treatment, and risks and benefits of therapy were incorporated into the template to assist HCPs in understanding the requirements for a complete diagnosis and evaluation. Finally, on completion of the template, HCPs were able to order testosterone via link to various testosterone formulations.

Before its implementation, the PADR testosterone order template was introduced to PCPs and internal medicine residents at 2 case-based conferences aimed at the diagnosis and treatment of male hypogonadism. These conferences were well received and helped launch the testosterone PADR template at VAPSHCS. Similar outreach to HCPs who prescribe testosterone is highly recommended in other VA facilities before implementation of the testosterone ordering template. It is possible that more targeted education to other HCPs would have resulted in greater use of the testosterone ordering template and adherence to clinical practice guidelines.

The VAPSHCS multidisciplinary workgroup was essential for the development, implementation, evaluation, and revision of the PADR and testosterone ordering template. The workgroup met routinely to follow up on the ease of installation in CPRS and discuss technical corrections that were needed. This was an essential for quality improvement, as loopholes in CPRS were identified where the HCP could order testosterone without being prompted to use the new PADR testosterone order template (alternative ordering pathways). The workgroup swiftly informed the IT specialist and HPS team to remove alternative ordering pathways of testosterone. Continuous quality improvement evaluations are highly recommended during implementation of the template in other facilities to accommodate specific local modifications that might be needed.

Conclusions

The creation and implementation of a PADR testosterone order template may be a beneficial approach to improve the diagnosis of hypogonadism and facilitate appropriate use of testosterone therapy in veterans in accordance with established clinical practice guidelines, particularly in veterans without any prior testosterone use. Key future strategies to improve testosterone prescribing should focus on identifying clinical team members, such as a local clinical pharmacist, to review and steward PADR requests to ensure that testosterone is indicated, and treatment is appropriately monitored.

Testosterone treatment is clinically indicated when a patient presents with symptoms and signs and biochemical evidence of testosterone deficiency, ie, male hypogonadism. Laboratory confirmation of hypogonadism requires repeatedly low serum testosterone concentrations; between 8 am and 10 am on ≥ 2 separate occasions, and evaluation should include measurement of gonadotropin, follicle-stimulating hormone (FSH), and luteinizing hormone (LH) concentrations. If the diagnosis of hypogonadism is established, it is important to determine whether the etiology is due to a structural or congenital disorder of the hypothalamic-pituitary-testicular (HPT) axis (organic hypogonadism) or a comorbid condition that results in suppressed function of an intact HPT axis and that is potentially reversible or treatable (functional hypogonadism).^1,2 Prior to initiation of treatment, clinicians should discuss potential benefits and risks of testosterone and monitoring during treatment, using a shared decision-making process with the patient.¹

Recent studies have reported an increase in testosterone prescriptions and raised concerns regarding health care provider (HCP) prescribing practices despite current clinical practice guidelines from major societies, such as the Endocrine Society. In the US from 2001 to 2011, testosterone use among men aged ≥ 40 years increased more than 3-fold in all age groups.³ Subsequently in the years from 2013 to 2016, prescription rates declined perhaps due to the cardiovascular and stroke concerns.⁴

In the US Department of Veterans Affairs (VA), new testosterone prescriptions across VA medical centers increased from 20,437 in fiscal year (FY) 2009 to 36,394 in FY 2012. Yet only 3.1% of men who received testosterone therapy had 2 or more low morning total or free testosterone concentrations measured; LH and/or FSH levels assessed; and presence of contraindications to therapy documented. Remarkably, 16.5% of these veterans did not have a testosterone level tested prior to being prescribed testosterone. Among veterans who were prescribed testosterone, 1.4% had a diagnosis of prostate cancer, 7.6% had a diagnosis of obstructive sleep apnea (OSA), and 3.5% had elevated hematocrit at baseline.⁵ These findings raised concerns of whether the diagnosis and etiology of hypogonadism were appropriately established and risks were considered before testosterone treatment was initiated.^5,6

To further understand VA prescribing practices of testosterone therapy, a 2018 VA Office of the Inspector General (OIG) report evaluated the initiation and follow-up of testosterone replacement therapy. The OIG randomly sampled and reviewed 1,091 male patients who filled at least 1 outpatient testosterone prescription from VA in FY 2014 and who did not have a prior testosterone prescription in FY 2013. Patients were followed through September 30, 2015. Within 1 year prior to initiating testosterone, only 1.5% had clinical signs and symptoms of testosterone deficiency documented prior to testosterone testing (76% within 18 months of starting testosterone); only 9.1% of veterans had the recommended measurements of 2 low morning testosterone levels; and only 12% had LH and FSH levels measured. Within 3 to 6 months after starting testosterone therapy, only 24% of veterans were assessed for symptom improvement, and 29% to 33% were evaluated for adverse effects, hematocrit levels and adherence to the therapy. The OIG report concluded that VA HCPs were not adhering to guidelines (referencing the Endocrine Society guidelines) when evaluating and treating veterans with testosterone deficiency.⁷

Considering the OIG recommendations and need to improve current practices among providers, VA Puget Sound Health Care System (VAPSHCS) in Washington established a multidisciplinary workgroup consisting of an endocrinologist, geriatrician, primary care provider (PCP), pharmacists, VA information technology (IT) specialist, and health products support (HPS) clinical team in the spring of 2019 to assess and improve testosterone prescribing practices.

Methods

A testosterone order template was developed, approved by VAPSHCS Pharmacy and Therapeutics Committee, and implemented on July 1, 2019, at VAPSHCS, a 1a medical facility caring for more than 112,000 veterans. Given its potential risks and the propensity for varied prescribing practices, testosterone was designated as a restricted drug requiring a prior authorization drug request (PADR) and required completion of the testosterone order template in the Computerized Patient Record System (CPRS).

Testosterone Order Template

The testosterone order template had 2 components. Completion of the template for new testosterone orders was required to initiate treatment unless the patient had known organic hypogonadism or was a transgender male. The template ensured documentation of defined symptoms and signs of testosterone deficiency; low serum testosterone levels on at least 2 occasions and LH and FSH concentrations; no contraindications to testosterone treatment; discussion of risks and benefits of therapy; and baseline hematocrit (Figure 1). Relevant educational content (eg, risks and benefits of testosterone) was incorporated in the template. The second template was required for the first renewal of testosterone to document adherence to or reason for discontinuation of testosterone; improvement of symptoms and signs; and confirm monitoring hematocrit and testosterone levels during treatment.

Prior to implementation, the PADR template was introduced to HCPs at 2 chief-of-medicine rounds on the diagnosis and evaluation of hypogonadism by a pharmacist and endocrinologist. These educational sessions used case examples and discussions to teach the appropriate use of testosterone therapy in men with hypogonadism. The target audience was PCPs, residents, and other specialists who might prescribe testosterone.

Retrospective Chart Review

To assess the impact of the new testosterone order template on adherence to OIG recommendations, a retrospective chart review was completed comparing the appropriateness of initiating testosterone replacement therapy pretemplate period (July 1 to December 31, 2018) vs posttemplate period (July 1 to December 31, 2019). Inclusion and exclusion criteria were modeled after the 2018 OIG report to allow for comparison with the OIG study population. Eligible veterans in each time period included males who received a new testosterone prescription without having been prescribed testosterone in the previous 12 months. Exclusion criteria included community care network prescriptions (CCNRx); current testosterone prescription from a different VA site; clinic administration of testosterone in the previous 12 months; an organic hypogonadism (ie, Klinefelter syndrome) or gender dysphoria diagnosis; and whether the testosterone prescription was never dispensed (PADR was denied or veteran never had the prescription filled). Veterans who met the inclusion criteria in CPRS were identified by an algorithm developed by the VAPSHCS pharmacoeconomist.

Determining the appropriateness of testosterone prescribing, such as symptoms and laboratory measurements to confirm the diagnosis of hypogonadism, was based on the OIG report and Endocrine Society guidelines. A chart review of the 12 months before testosterone prescribing was completed for each veteran, assessing for documentation of symptoms of testosterone deficiency and laboratory measurements of serum testosterone, LH, and FSH. Also, documentation of a discussion of risks and benefits of testosterone therapy in the 3 months before prescribing was assessed, which matched the timeframe in the VA OIG report.

Interim Analysis

After initial template implementation, the multidisciplinary workgroup reconvened for a preplanned interim analysis in November 2019. The evaluation at this meeting revealed multiple order pathways in CPRS that were not linked to the PADR testosterone order template. Testosterone could be ordered in the generic order dialog, medications by drug class, and medications by alphabet, and endocrinology specialty menus without prompting to complete the testosterone order template or redirection to the restricted drug menu (Figure 2). These alternative testosterone ordering pathways were removed in early December 2019 and additional data collection was conducted for 3 months after discontinuation of alternative order pathways, the posttemplate/no alternative ordering pathways period, from December 7, 2019 to February 29, 2020.

Exclusion of Previous Testosterone Prescriptions Predating Chart Review Period, Subgroup Analysis

In the OIG report and the initial retrospective chart review, only veterans without a testosterone prescription in the previous 12 months were evaluated. To assess whether a previous testosterone prescription influenced completion of the PADR and order template, a further subgroup analysis was conducted that excluded veterans who had a previous testosterone prescription at any time before the chart review periods. Therefore, “new testosterone prescription” refers to a veteran who never had a history of being on testosterone vs “former testosterone prescription,” meaning a patient could have had a previous testosterone prescription > 1 year prior to a new VA testosterone prescription.

Results

One hundred seventy-five veterans with a new testosterone prescription were identified in the pretemplate period; of these 80 (46%) met eligibility criteria; only 20 eligible veterans (25%) had a completed PADR (Figure 3). Ninety-one veterans with a new testosterone prescription were identified in the posttemplate period of which 41 (46%) veterans were eligible; 18 eligible veterans (44%) had a completed PADR, but only 7 (17%) had a completed testosterone order template.

After excluding veterans who had alternative ordering pathways for testosterone, 46 veterans were identified in the posttemplate/no alternative ordering pathways period of which 19 (41%) veterans were eligible. Compared with the posttemplate period, a higher proportion of eligible veterans, 68% (13) had a completed PADR, and 58% (11) had a testosterone order template during the posttemplate/no alternative ordering pathways period.

Discussion

The 2018 OIG report found that VA practitioners demonstrated poor adherence to evidence-based clinical practice guidelines for testosterone treatment in men with hypogonadism. Based on OIG recommendations, we developed a PADR testosterone ordering template to help HCPs improve practice by better adherence to guidelines for the diagnosis and treatment of hypogonadism in veterans. Before implementation of the PADR template, the percentage of veterans at VAPSHCS who had biochemical confirmation of hypogonadism was higher than that in the OIG report. Activation of the PADR testosterone ordering template (with or without removal of options for alternative ordering pathways of testosterone) resulted only in an improvement of laboratory confirmation and evaluation of etiology of hypogonadism. This is when we reasoned that clinicians may have access to prior records and laboratory testing beyond just the past year, and this information may have influenced their use of the PADR template. Subsequently, with exclusion of veterans who were previously prescribed testosterone, implementation of the PADR testosterone order template improved documentation of symptoms of testosterone deficiency, discussion of risks and benefits of testosterone therapy, and biochemical diagnosis and evaluation of hypogonadism relative to the period before implementation.

The lack of effects of implementing the testosterone order template on documentation of symptoms of testosterone deficiency and discussion of risks and benefits of testosterone therapy may be due to local expertise resulting in the relatively high adherence to these guideline recommendations at VAPSHCS before activation of the template vs that in the OIG report. The template improved documentation of the diagnosis and evaluation of hypogonadism for genuinely new testosterone prescriptions in veterans without a history of testosterone prescriptions; while those with a previous prescription had limited improvement. It is possible that in veterans who had testosterone prescribed previously, HCPs may have assumed or had bias that the diagnosis and evaluation of hypogonadism originally made was adequate. This finding underscores the need to develop strategies for reviewing PADR requests where there is historical testosterone use. Perhaps a clinical team member, such as a clinical pharmacist, with the background and training in guidelines for the evaluation of hypogonadism could review PADR requests in veterans with previous testosterone use.

Removal of alternative ordering pathways for testosterone increased the completion rate of PADR requests and the testosterone ordering template, although the latter was not completed in one-third of veterans. Possible reasons for HCPs’ suboptimal completion of the testosterone template despite the PADR initiation include clinicians’ lack of willingness to read the PADR completely and familiarize themselves with the clinical guidelines due to workload demands of PCPs. In addition there maybe pressure from patients to receive testosterone for age-related symptoms due to heavy marketing. In addition, there may have been pharmacists who reviewed the PADR and approved the incomplete testosterone template. At VAPSHCS there were up to 40 pharmacists during different periods reviewing the testosterone PADRs. Likely, not everyone was completely familiar with this implementation process, and a possible future consideration would be further education to staff pharmacists who are verifying these prescriptions. There were several advantages to using this new testosterone order template when HCPs attempted to order a prescription. First, they were prompted to complete the PADR. Subsequently, a pharmacist reviewed the template and approved or rejected the prescription if the template was incomplete. The completed template served as documentation in the electronic health record for the prescribing HCP. The template was constructed to populate the required laboratory tests for ease of use and documentation. In addition, educational information regarding the symptoms and signs of testosterone deficiency, laboratory tests needed to confirm and evaluate hypogonadism, contraindications to testosterone treatment, and risks and benefits of therapy were incorporated into the template to assist HCPs in understanding the requirements for a complete diagnosis and evaluation. Finally, on completion of the template, HCPs were able to order testosterone via link to various testosterone formulations.

Before its implementation, the PADR testosterone order template was introduced to PCPs and internal medicine residents at 2 case-based conferences aimed at the diagnosis and treatment of male hypogonadism. These conferences were well received and helped launch the testosterone PADR template at VAPSHCS. Similar outreach to HCPs who prescribe testosterone is highly recommended in other VA facilities before implementation of the testosterone ordering template. It is possible that more targeted education to other HCPs would have resulted in greater use of the testosterone ordering template and adherence to clinical practice guidelines.

The VAPSHCS multidisciplinary workgroup was essential for the development, implementation, evaluation, and revision of the PADR and testosterone ordering template. The workgroup met routinely to follow up on the ease of installation in CPRS and discuss technical corrections that were needed. This was an essential for quality improvement, as loopholes in CPRS were identified where the HCP could order testosterone without being prompted to use the new PADR testosterone order template (alternative ordering pathways). The workgroup swiftly informed the IT specialist and HPS team to remove alternative ordering pathways of testosterone. Continuous quality improvement evaluations are highly recommended during implementation of the template in other facilities to accommodate specific local modifications that might be needed.

Conclusions

The creation and implementation of a PADR testosterone order template may be a beneficial approach to improve the diagnosis of hypogonadism and facilitate appropriate use of testosterone therapy in veterans in accordance with established clinical practice guidelines, particularly in veterans without any prior testosterone use. Key future strategies to improve testosterone prescribing should focus on identifying clinical team members, such as a local clinical pharmacist, to review and steward PADR requests to ensure that testosterone is indicated, and treatment is appropriately monitored.