Zum Hauptinhalt springen

Analyzing Flow Cytometry or Targeted Gene Expression Data Influences Clinical Discoveries-Profiling Blood Samples of Pancreatic Ductal Adenocarcinoma Patients.

de Koning W ; van Eijck CWF ; et al.
In: Cancers, Jg. 15 (2023-08-31), Heft 17
Online academicJournal

Analyzing Flow Cytometry or Targeted Gene Expression Data Influences Clinical Discoveries—Profiling Blood Samples of Pancreatic Ductal Adenocarcinoma Patients 

Simple Summary: We investigated the immunological changes in the blood of pancreatic ductal adenocarcinoma patients treated with a single cycle of FOLFIRINOX chemotherapy combined with lipegfilgrastim. We compared the use of flow cytometry and targeted gene expression analysis to study these immunological changes in blood samples. Our findings showed that FFX-Lipeg treatment increased the number of neutrophils and monocytes. Interestingly, flow cytometry analysis revealed an increase in B and T cells after treatment, while targeted gene expression analysis indicated a decrease in the expression of B and T cell-specific genes. This suggests that different measurement techniques can influence observed immunological changes. Therefore, the careful selection of an appropriate technique is essential when studying treatment effects in PDAC patients. Introduction: Monitoring the therapeutic response of pancreatic ductal adenocarcinoma (PDAC) patients is crucial to determine treatment strategies. Several studies have examined the effectiveness of FOLFIRINOX as a first-line treatment in patients with locally advanced pancreatic cancer, but little attention has been paid to the immunologic alterations in peripheral blood caused by this chemotherapy regimen. Furthermore, the influence of the measurement type (e.g., flow cytometry and targeted gene expression) on the clinical discoveries is unknown. Therefore, we aimed to scrutinize the influence of using flow cytometry or targeted immune gene expression to study the immunological changes in blood samples of PDAC patients who were treated with a single-cycle FOLFIRINOX combined with lipegfilgrastim (FFX-Lipeg). Material and Methods: Whole-blood samples from 44 PDAC patients were collected at two time points: before the first FOLFIRINOX cycle and 14 days after the first cycle. EDTA blood tubes were used for multiplex flow cytometry analyses to quantify 18 immune cell populations and for complete blood count tests as the standard clinical routine. The flow cytometry data were analyzed with FlowJo software. In addition, Tempus blood tubes were used to isolate RNA and measure 1230 immune-related genes using NanoString Technology®. Data quality control, normalization, and analysis were performed using nSolver™ software and the Advanced Analysis module. Results: FFX-Lipeg treatment increased the number of neutrophils and monocytes, as shown by flow cytometry and complete blood count in concordance with elevated gene expression measured via targeted gene expression profiling analysis. Interestingly, flow cytometry analysis showed an increase in the number of B and T cells after treatment, while targeted gene expression analysis showed a decrease in B and T cell-specific gene expression. Conclusions: Targeted gene expression complements flow cytometry analysis to provide a comprehensive understanding of the effects of FFX-Lipeg. Flow cytometry and targeted gene expression showed increases in neutrophils and monocytes after FFX-Lipeg. The number of lymphocytes is increased after treatment; nevertheless, their cell-specific gene expression levels are downregulated. This highlights that different techniques influence clinical discoveries. Therefore, it is important to carefully select the measurement technique used to study the effect of a treatment.

Keywords: pancreatic ductal adenocarcinoma (PDAC); FOLFIRINOX; flow cytometry; targeted gene expression; peripheral immune cell profile

1. Introduction

Pancreatic ductal adenocarcinoma (PDAC) is a malignancy that develops from the epithelial cells that line pancreatic ducts and is one of the most lethal cancer types [[1]]. The complex tumor (immune) microenvironment, the environment that surrounds the tumor cells, is composed of many cell types and the extracellular matrix. It includes immune cells, blood vessels, cancer-associated fibroblasts, and other cells that constantly interact with and influence each other. The combination of gemcitabine with nab-paclitaxel or a combination or the combined chemotherapeutic regimen of 5-fluorouracil, folinic acid, irinotecan, and oxaliplatin (FOLFIRINOX) is considered the first-line treatment option for locally advanced and metastatic PDAC [[2]]. For (borderline) resectable PDAC patients with a good performance status, FOLFIRINOX is the preferred adjuvant treatment and several randomized control clinical trials are currently investigating its applicability in the neoadjuvant setting [[3]]. However, FOLFIRINOX is often associated with toxicity, particularly neutropenia [[3], [5], [7]]. To prevent FOLFIRINOX-induced neutropenia, many clinicians consider the prophylactic administration of a granulocyte colony-stimulating factor (G-CSF), such as lipegfilgrastim, as standard therapy [[9], [11]].

FOLFIRINOX has been shown to alter the intra-tumoral immune cell profile of PDAC patients. Increased effector T cells and reduced suppressor cells were reported in the pancreatic tumor after neoadjuvant FOLFIRINOX treatment [[12]]. Furthermore, FOLFIRINOX enhanced tumor antigen presentation, potentially synthesizing the pancreatic tumor for treatment with immune checkpoint inhibitors [[13]]. Nevertheless, the effect of FOLFIRINOX-lipegfilgrastim (FFX-Lipeg) on a patient's peripheral immune profile remains unclear. More knowledge on the immunological changes caused by FOLFIRINOX could pave the way to improved immunotherapeutic approaches and is therefore of clinical interest.

Flow cytometry is a technique that is widely employed for evaluating the immune cell composition of peripheral blood. It utilizes laser-based technology to detect and analyze the chemical and physical properties of cells or particles present in fluid samples [[15]]. By leveraging flow cytometry, researchers can accurately quantify different immune cell populations within peripheral blood. This technique offers the advantage of providing a more comprehensive and detailed analysis at the single-cell level. Subpopulations can be distinguished although common protein markers are present, and cells can be assigned to subpopulations based on negative protein markers. However, flow cytometry does not allow for the robust quantification of subpopulations based on intracellular characteristics [[16]]. Furthermore, flow cytometry requires viable cells, which necessitates costly and time-consuming processing as well as storage procedures. For longitudinal sample collection, cryopreservation is often employed, but it has been observed to affect the expression of crucial markers for immune subsets [[17], [19]].

RNA-based transcriptome analysis is an emerging technique that enables the study of diverse cellular processes, including immune responses and the identification of various cell types within the peripheral blood [[20]]. Targeted gene expression profiling provides a more comprehensive immune-related dataset compared to flow cytometry. The composition of the immune cell subpopulations with RNA-based transcriptome analysis is inferred from the generated bulk gene expression dataset and can be defined based on intracellular characteristics [[21]]. Furthermore, gene expression analysis is possible even when far fewer viable cells are available, as it only requires 25–100 ng of total RNA.

Recently, we identified the FOLFIRINOX delta Gene Expression Profiling (FFX-ΔGEP) score, which predicts the lack of a FOLFIRINOX response in PDAC patients after only one cycle of FFX-Lipeg treatment [[23]]. In this study, we aimed to scrutinize the influence of using flow cytometry or targeted immune gene expression to study the immunological changes in blood samples of PDAC patients who were treated with a single cycle of FFX-Lipeg.

2. Material and Methods

2.1. Patient Cohort and Blood Collection

The 44 PDAC patients included in this study were hospitalized at the Erasmus University Medical Centre Rotterdam between February 2018 and October 2020. Fourteen of these patients had (borderline) resectable PDAC and participated in the PREOPANC-2 randomized clinical trial (Dutch trial register NL7094). Thirty patients participated in the iKnowIT prospective cohort study (Dutch trial register NL7522), of which 19 had locally advanced and 11 had metastasized PDAC. Exclusion criteria were <18 years of age, previous treatment with FOLFIRINOX, or co-treatment with another chemotherapeutic. The medical ethics committee of the Erasmus University Medical Centre Rotterdam approved both studies (MEC-2018-087 and MEC-2018-004), and patient samples were only used when written informed consent was provided. After the histological confirmation of the primary tumor or metastases, patients underwent treatment with FOLFIRINOX chemotherapy. Moreover, all patients received prophylactic treatment with the long-acting G-CSF lipegfilgrastim (Lonquex®; Teva Pharmaceuticals, Petach Tikva, Israel), administered 24 h after each cycle. This approach aimed to mitigate FOLFIRINOX-induced neutropenia and its associated complications [[9], [24]]. Two types of whole-blood samples (2 EDTA and 1 Tempus) were collected from the 44 PDAC patients at two time points: at the baseline (on the same day, but before the first cycle) and 14 days after the first cycle, but before the second FOLFIRINOX cycle (Figure 1).

2.2. Flow Cytometry and Complete Blood Count

EDTA tubes were utilized to collect whole-blood samples for conducting flow cytometry and complete blood count (CBC) analyses. As part of the standard clinical routine, CBC tests were performed to evaluate lymphocyte, neutrophil, and thrombocyte counts. The whole-blood samples were subjected to multiplex flow cytometry to quantify 18 immune cell populations, following a previously established protocol [[25]]. Briefly, distinct immune cell subsets were individually identified and gated on a scatter plot based on CD45+ staining versus side scatter. Subsequently, specific markers further defined eosinophils (CD15+ CD16−), mature neutrophils (CD15high CD16high), immature neutrophils (CD15+ CD16+), classical monocytes (CD14+ CD16−), intermediate monocytes (CD14+ CD16+), non-classical monocytes (CD14− CD16+), dendritic cells (CD14− CD16− CD11c+), myeloid-derived suppressor cells (CD14+ CD16− CD11b+ HLA-DRlow), B cells (CD3− CD19+), natural killer cells (CD3− CD56+ CD16+/−), T cells (CD3+), γδ T cells (CD3+ TCRγδ+), CD4+ T cells (CD3+ TCRγδ− CD4+), and CD8+ T cells (CD3+ TCRγδ− CD8+). Absolute cell counts were determined using Flow-Count Fluorospheres (Beckman Coulter, Brea, CA, USA). FlowJo software (version 10.7, Tree Star, San Carlos, CA, USA) was used for data analysis.

2.3. Targeted Immune Gene Expression Profiling

The whole-blood samples intended for targeted gene expression analysis were collected in Tempus tubes (Applied Biosystems, Foster City, CA, USA) and subsequently stored at −80 °C. Tempus tubes are designed to contain an RNA-stabilizing reagent, which effectively preserves RNA quality, enabling the measurement of gene expression profiles without the need to isolate peripheral blood mononuclear cells [[27]]. To extract total RNA from the blood in Tempus tubes, a Tempus Spin RNA Isolation Kit from Thermo Fisher Scientific (Waltham, MA, USA) was employed, following the manufacturer's instructions. Subsequently, RNA quality was assessed using an Agilent 2100 BioAnalyzer (Santa Clara, CA, USA). Samples with RNA concentrations below 35 mg/mL were excluded from further analysis. Corrected RNA concentrations were calculated based on the percentage of fragments within the 300–4000 nucleotide range to account for RNA degradation. An nCounter® PanCancer Immune Profiling (IP) Panel and nCounter® Myeloid Innate Immunity (MII) Panel, each consisting of 730 genes and 40 housekeeping genes, were used for NanoString targeted gene expression analysis of the 88 whole-blood samples. The IP panel targeted different immune-related pathways as well as immune and adaptive immune cell-related genes. The MII panel targeted genes involved in the innate immune response of myeloid-derived cells. For each sample, a total of 200 ng RNA, in a maximum volume of 7 μL, was subjected to hybridization with the two panels for a duration of 17 h at 65 °C, following the protocol provided by the manufacturer (NanoString Technologies Inc., Seattle, WA, USA). Subsequently, the nCounter® FLEX platform was utilized to wash away the unbound probes and to count the genes by scanning 490 fields of view (FOV). Data quality control, normalization, and analysis were performed using nSolver™ software (version 4.0) and the Advanced Analysis module (version 2.0) of NanoString Technology Inc. [[28]]. Raw gene counts were normalized based on the most stable 19 housekeeping genes identified by the geNorm algorithm [[29]]. Subsequently, scaling was performed based on the 265 overlapping genes between the two panels, and all data were log2 transformed. Genes were included in the further analysis if their expression levels exceeded the limit of detection, which was calculated as the average count of the negative controls plus two standard deviations, in more than 50% of the gene expression profiles (4.35 log2). To identify differentially expressed genes (DEGs), simplified negative binomial models, a mixture of negative binomial models, or log-linear models were utilized, depending on the convergence of each gene. DEGs were defined as genes with a p-value < 0.05 after correction for multiple testing using the Benjamin–Hochberg (BH) method. To characterize the abundance of immune cell abundance, candidate cell-specific gene markers were identified as described previously [[22]]. The selection of marker genes was carried out by calculating pairwise similarity scores among the 61 detected candidate marker genes that exceeded the limit of detection. For each immune cell type, at least two unique marker genes with a pairwise similarity score above 0.6 were required. The abundance score of the immune cell types was calculated via the average marker expression. Pathway scores were extracted from the advanced analysis of nSolver software. Pathway enrichment analyses were performed with the differentially expressed genes (|Log2 fold change| > 0.5, P.BH < 0.05) using Metascape [[30]] and ClueGo [[31]].

2.4. Statistical Analysis

Statistical testing and data visualization were performed with R statistical software (v.4.1.2) [[32]]. We used paired two-sided Student t-tests as a parametric test. We used the R packages ggplot2 [[33]] and EnhancedVolcano [[34]] for data visualization. Heatmaps were generated using the Log2-normalized count data of significantly differentially expressed genes (|Log2 fold change| > 0.5, P.BH < 0.05). Genes that were determined to be outliers using Tukey's rule were removed [[35]]. The heatmap was visualized using the web-based tool Morpheus by the Broad Institute (RRID: SCR_017386).

3. Results

3.1. Patients' Characteristics

A total of 44 patients who received one FFX-Lipeg cycle were included. Three whole-blood samples (two EDTA, one Tempus) were collected at the baseline (on the same day before the first cycle) and 14 days after the first cycle but before the second cycle. The mean overall survival (95% CI) was 9 (11–14) months, calculated as the months between the first FFX-Lipeg cycle and the date of death. All clinicopathological characteristics are summarized in Supplementary Table S1.

3.2. FFX-Lipeg Therapy Results in Enhanced Frequencies of Granulocytes and Monocytes in the B...

Flow cytometry analyses showed that one cycle of FFX-Lipeg significantly increased 17 out of 18 immune cell types. The most pronounced increase was observed in the number of granulocytes and monocytes (Figure 2). The only cell type that was not significantly altered was the CD16+ NK cells (Supplementary Figure S1). Furthermore, the changes relative to the total leukocytes have been calculated (Supplementary Figure S2). The CBC measurements showed a significant increase in lymphocytes and neutrophils but a significant decrease in thrombocytes after treatment (Supplementary Figure S3).

The RNA samples for targeted immune expression profiling were of a minimum concentration of 35 mg/mL, meeting the requirement for targeted gene expression analysis. As a result, all of the samples included in the study exceeded the specified inclusion threshold. Targeted immune expression profiling showed that the total infiltration of CD45+ cells significantly increased after FFX-Lipeg treatment. The definition of infiltrated immune cells was based on 41 genes that showed a pairwise similarity higher than 0.6 and defined thirteen different immune cell types (Supplementary Table S2). The peripheral abundance of neutrophils and monocytes significantly increased after treatment. In contrast to the flow cytometry measurements, the peripheral abundance of T cells and B cells significantly decreased after treatment (Figure 3). The abundance of plasma B cells and mast cells was not significantly altered after treatment (Supplementary Figure S4). Furthermore, the changes relative to the total leukocytes have been calculated (Supplementary Figure S5).

3.3. FFX-Lipeg Results in an Increased Number of Lymphocytes, Yet Pathways Associated with Ly...

Flow cytometry results showed that T, B, and NK cells, as well as their subtypes, were increased after FFX-Lipeg treatment. On the contrary, pathway analysis using nSolver software revealed decreased scores of natural killer, B cell, and T cell functions (Supplementary Table S3). On the other hand, data from both flow cytometry and targeted gene expression revealed an increase in the myeloid compartment after FFX-Lipeg therapy. In concordance with this, pathway analysis resulted in an increased score of the differentiation and maintenance of myeloid cells after FFX-Lipeg treatment (Figure 4).

Metascape enrichment analysis using the 39 downregulated (P.BH ≤ 0.05 and log2 fold of change ≤ −0.5) genes showed that the FFX-Lipeg treatment negatively affected the MHC class II antigen presentation (Supplementary Figure S6A). The 170 upregulated (P.BH ≤ 0.05 and log2 fold of change ≥ 0.5) genes showed an enriched neutrophil degranulation, IRAK4 deficiency (TLR5), leukotriene metabolic pathway, IL-4 signaling pathway, and activation of matrix metalloproteinases (Supplementary Figure S6B). ClueGo functional analysis using the 39 downregulated (P.BH ≤ 0.05 and log2 fold of change ≤ −0.5) showed a negative regulation of T cell-mediated immunity and an innate immune response (Supplementary Figure S7A). On the contrary, myeloid and neutrophil cell-related functions were stimulated, and genes related to lymphocyte proliferation were enriched in the 170 upregulated (P.BH ≤ 0.05 and log2 fold of change ≥ 0.5) genes (Supplementary Figure S7B).

In order to scrutinize the differences in the results between flow cytometry and gene expression, we performed a correlation analysis of proteins targeted by flow cytometry with their corresponding marker genes in the targeted immune gene expression profile for the two time points separately. Lymphocyte subtypes showed a higher correlation before FFX-Lipeg treatment in comparison to the correlation after treatment (Supplementary Figure S8).

3.4. FFX-Lipeg Induces a Distinct Gene Expression Profile in the Peripheral Blood

A single FFX-Lipeg cycle induced profound genetic alterations in (Figure 5A). Among the 870 genes that surpassed the detection limit, 209 genes exhibited differential expression (|Log2 fold change| > 0.5, P.BH < 0.05). Specifically, following FFX-Lipeg treatment, 170 genes were found to be upregulated and 39 genes were downregulated (Figure 5B).

The most upregulated differentially expressed genes include matrix metalloproteinase-8 (MMP8, P.BH = 3.38 × 10−20, FOC = 4.99), lactotransferrin (LTF, P.BH = 1.09 × 10−18, FOC = 3.97) and carcinoembryonic antigen-related cell adhesion molecule 8 (CEACAM8, P.BH = 1.58 × 10−19, FOC = 3.16), which are mainly expressed by neutrophils. MMP8 plays a role in the degradation of the extracellular matrix by cleaving various substrates, including collagens and cytokines [[36], [38]]. LTF is an iron-binding protein elevated specifically in polymorphonuclear neutrophils [[39]]. CEACAM8, also referred to as CD66b, is a surface glycoprotein that participates in heterophilic cell adhesion within activated neutrophils, along with other carcinoembryonic antigen-related cell adhesion molecules such as CEACAM6 [[40]]. Furthermore, integrin subunit beta 4 (ITGB4, P.BH = 8.05 × 10−20, FOC = 3.29) and lipocalin 2 (LCN2, P.BH = 3.12 × 10−18, FOC = 3.35) were also found to be upregulated. ITGB4 promotes cell migration and invasion in pancreatic cancer; however, its exact role in these processes remains unclear [[41]]. The iron-trafficking protein LCN2 plays a role in various biological processes, including apoptosis, innate immunity, and renal development [[42]].

On the other hand, (cytotoxic) T cell- and natural killer cell-specific genes, RUNX family transcription factor 3 (RUNX3, P.BH = 1.37 × 10−12, FOC = −0.549), granzyme B (GZMB, P.BH = 2.43 × 10−11, FOC = −0.527), and killer cell lectin like receptor D1 (KLRD1, P.BH = 1.96 × 10−11, FOC = −0.525) were downregulated consistently in all samples after treatment. Furthermore, HLA class genes, like major histocompatibility complex, class II, DP beta 1 (HLA-DPB1, P.BH = 1.30 × 10−11, FOC = −0.704), and major histocompatibility complex, class II, DR beta 3 (HLA-DRB3, P.BH = 1.96 × 10−11, FOC = −0.704) were also downregulated.

4. Discussion

In this study, we used paired blood samples of 44 FFX-Lipeg-treated PDAC patients to scrutinize the influence of using flow cytometry or targeted immune gene expression to study immunological changes. Flow cytometry and targeted gene expression profiling revealed a similar effect caused by a single cycle of FFX-Lipeg regarding granulocytes and monocytes; however, the measurement technique affects the observed changes regarding lymphocytes.

FFX-Lipeg treatment increased the total number of leukocytes, as shown by flow cytometry in concordance with elevated gene expression measured via targeted gene expression. As parts of these leukocytes, the number of neutrophils and monocytes as well as their cell-specific gene expression are increased; this is also shown through CBC. Contrarily, previously reported results showed a reduction in granulocytes and monocytes due to FOLFIRINOX treatment [[12]]. Nevertheless, studies on the effect of modified FFX-Lipeg show an increase in granulocytes, caused by lipegfilgrastim. The addition of lipegfilgrastim has been shown to decrease the incidence of neutropenic events and prolong the progression-free survival of patients [[43]].

Interestingly, flow cytometry analysis showed an increase in the number of B and T cells after treatment, while targeted gene expression analysis showed a decrease in B and T cell-specific gene expression. Both granulocytes and monocytes are potent suppressors of T cell functions and inhibit antitumor immune responses [[45]]. This could explain that even though the number of lymphocytes showed an increase after treatment in the flow cytometry data and complete blood count measurements, there is a decrease in cell-specific gene expression based on the gene expression analysis.

It is essential to highlight that the predominant share of leukocytes comprises granulocytes, a phenomenon amplified through Lipeg treatment. Consequently, adjusting cell prevalence through total leukocyte count could obscure the impact on other cell subsets. This could elucidate the apparent proportional reduction in monocytes and lymphocytes. This discrepancy contradicts the targeted gene expression outcomes relating to monocytes in comparison to the entirety of CD45. The correlation analysis highlights that the effect of FFX-Lipeg therapy influences the number of cells differently than cell-specific gene expression. This could indicate that, regardless of the number of lymphocytes, the function of those immune cells cannot be fulfilled. The pathway analyses further highlighted this downregulation of the functions of the lymphocytes. Based on the gene expression analysis, it seems that lymphocytes have a lower expression of functional genes after FFX-Lipeg treatment.

In this study, we measured 1230 immune-related genes via targeted gene expression profile and 18 immune cell types via flow cytometry. The added value of targeted gene expression analysis is shown by the discovery that a single FFX-Lipeg cycle changed the expression of 209 immune-related genes significantly and caused a distinct genetic profile between the samples before and after treatment. Targeted gene expression profiles that specifically measure part of the immune-related genes enabled us to identify an FFX-ΔGEP score to predict the lack of a treatment response after a single FFX-Lipeg cycle, as has been described previously [[23]]. As far as we know, measuring with flow cytometry did not lead to a similar discovery.

Besides a biological explanation, several technical factors might influence the discrepancy between the two measurement techniques. The higher detection of lymphocytes measured via flow cytometry could be due to non-specific bindings of lower-quality antibodies, whereas the lower detection of immune cell-specific gene expression could be caused by the amount of RNA present in the samples, as well as mRNA stability. Furthermore, the comparison was performed on heterogenous samples and different types of blood samples (EDTA/Tempus).

5. Conclusions

Flow cytometry could be used for the precise quantification of immune cell populations, whereas gene expression analysis gave a broader understanding of the immune expression activity of those cells. This highlights that measuring the number of cells in the blood does not reflect the immune functionality of these cells. To study the effects of treatment, different techniques must be used to obtain a more complete overview. This study revealed that measurement techniques influence clinical discoveries.

Figures

Graph: Figure 1 Schematic overview of the sample collection and measurements. The cycles of FOLFIRINOX chemotherapy (black), lipegfilgrastim injections (orange), and the blood draw time points (red). The blood is collected in EDTA and Tempus tubes. After the blood draw, the flow cytometry and complete blood count procedures are performed on the EDTA tubes. The Tempus tubes are used for gene expression profiling.

Graph: Figure 2 The effect of one cycle of FFX-Lipeg on the immune cells measured via flow cytometry. (A) The number of granulocytes (pink) including the subtypes that were significantly increased after treatment (blue) compared with before treatment (yellow). (B) The number of monocytes (green) including the subtypes that were significantly increased after treatment. (C) The number of lymphocytes (light blue) including the subtypes that were significantly increased after treatment. * p ≤ 0.05, ** p ≤ 0.01, *** p ≤ 0.001, **** p ≤ 0.0001.

Graph: Figure 3 The effect of one FFX-Lipeg cycle on the immune cells measured by targeted gene expression. (A) The total immune cell (dark blue) abundance was significantly increased after treatment (blue) compared with before treatment (yellow). (B) The abundance of granulocytes' (pink) subtype neutrophils was significantly increased after treatment. (C) The abundance of monocytes (green) including the subtypes was significantly increased after treatment. (D) The abundance of lymphocytes (light blue) including the subtypes was significantly decreased after treatment. ** p ≤ 0.01, **** p ≤ 0.0001.

Graph: Figure 4 Differential expression of predefined pathway genes after one cycle of FFX-Lipeg. A significant upregulation of leukocyte functions and the differentiation as well as maintenance of myeloid cells was measured. On the contrary, natural killer, B cell, and T cell functions were significantly downregulated. **** p ≤ 0.0001.

Graph: Figure 5 The effect of one FFX-Lipeg cycle on the gene expression profile. (A) The clustering of the genes showed an almost distinct genetic profile after one cycle. (B) A volcano plot highlighting the genes that were significantly altered (243 genes upregulated and 213 genes downregulated) after one cycle.

Author Contributions

W.d.K.: literature search, figures, study design, data analysis, data interpretation, and writing. C.W.F.v.E.: data collection and writing. F.v.d.S. and G.J.S.: blood sample handling. A.A.M.O. and R.D.: flow cytometry supervision. C.H.J.v.E.: study design and writing. D.A.M.M.: study design, targeted gene expression supervision, data analysis, data interpretation, and writing. All authors contributed to the editing of the final report. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

The medical ethics committee of the Erasmus University Medical Centre Rotterdam approved the PREOPANC-2 randomized clinical trial (Dutch trial register NL7094, MEC-2018-004, 19 June 2018) and the iKnowIT prospective cohort study (Dutch trial register NL7522, MEC-2018-087, 14 February 2019). We only used patient samples when written informed consent was provided.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The NanoString data presented in the study are deposited in the Gene Expression Omnibus (GEO) repository, accession number GSE241957.

Conflicts of Interest

The authors declare no conflict of interest.

Acknowledgments

The authors would like to give special thanks to all of the students involved in the blood collection and to Disha Vadgama as well as Jasper Dumas for their help in processing the blood samples.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/cancers15174349/s1, Figure S1: The effect of one cycle FFX-Lipeg on the immune cells measured by flow cytometry. Figure S2: The effect of one cycle FFX-Lipeg on the immune cells measured by flow cytometry relative to the total number of leukocytes. Figure S3: The effect of one cycle FFX-Lipeg on the immune cells measured by complete blood count. Figure S4: The effect of one cycle FFX-Lipeg on the immune cells measured by targeted gene expression. Figure S5: The effect of one cycle FFX-Lipeg on the immune cells measured by targeted gene expression relative to the total CD45 expression. Figure S6: Metascape enrichment analysis of the 39 downregulated and 115 upregulated genes after one FFX-Lipeg cycle. Figure S7: ClueGo functional analysis of the 39 downregulated and 115 upregulated genes after one FFX-Lipeg cycle. Figure S8: Correlation analysis between the proteins targeted by flow cytometry with their corresponding marker genes in the targeted immune-gene expression profiling of the lymphocyte subtypes. Table S1: Clinicopathological characteristics of patients included in the study. Table S2: The targeted gene expression definition of infiltrated immune cells. Table S3: The nSolver pathway definitions.

Footnotes 1 Disclaimer/Publisher's Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. References Siegel R.L., Miller K.D., Fuchs H.E., Jemal A. Cancer Statistics, 2022. CA Cancer J. Clin. 2022; 72: 7-33. 10.3322/caac.21708 2 van der Sijde F., van Dam J.L., Groot Koerkamp B., Haberkorn B.C.M., Homs M.Y.V., Mathijssen D., Besselink M.G., Wilmink J.W., van Eijck C.H.J. Treatment Response and Conditional Survival in Advanced Pancreatic Cancer Patients Treated with FOLFIRINOX: A Multicenter Cohort Study. J. Oncol. 2022; 2022: 8549487. 10.1155/2022/8549487 3 Conroy T., Hammel P., Hebbar M., ben Abdelghani M., Wei A.C., Raoul J.-L., Choné L., Francois E., Artru P., Biagi J.J. FOLFIRINOX or Gemcitabine as Adjuvant Therapy for Pancreatic Cancer. N. Engl. J. Med. 2018; 379: 2395-2406. 10.1056/NEJMoa1809775 4 Thibodeau S., Voutsadakis I.A. FOLFIRINOX Chemotherapy in Metastatic Pancreatic Cancer: A Systematic Review and Meta-Analysis of Retrospective and Phase II Studies. J. Clin. Med. 2018; 77. 10.3390/jcm7010007 5 Suker M., Beumer B.R., Sadot E., Marthey L., Faris J.E., Mellon E.A., El-Rayes B.F., Wang-Gillam A., Lacy J., Hosein P.J. FOLFIRINOX for Locally Advanced Pancreatic Cancer: A Systematic Review and Patient-Level Meta-Analysis. Lancet Oncol. 2016; 17: 801-810. 10.1016/S1470-2045(16)00172-8 6 Chun J.W., Woo S.M., Lee S.H., Choi J.H., Park N., Kim J.S., Cho I.R., Paik W.H., Lee W.J., Ryu J.K. A Real-World Analysis of Nanoliposomal-Irinotecan with 5-Fluorouracil and Folinic Acid as Third- or Later-Line Therapy in Patients with Metastatic Pancreatic Adenocarcinoma. Ther. Adv. Med. Oncol. 2022; 14: 175883592211195. 10.1177/17588359221119539 7 Irisawa A., Takeno M., Watanabe K., Takahashi H., Mitsunaga S., Ikeda M. Incidence of and Risk Factors for Severe Neutropenia during Treatment with the Modified FOLFIRINOX Therapy in Patients with Advanced Pancreatic Cancer. Sci. Rep. 2022; 12: 15574. 10.1038/s41598-022-18669-9 8 Conroy T., Desseigne F., Ychou M., Bouché O., Guimbaud R., Bécouarn Y., Adenis A., Raoul J.-L., Gourgou-Bourgade S., de la Fouchardière C. FOLFIRINOX versus Gemcitabine for Metastatic Pancreatic Cancer. N. Engl. J. Med. 2011; 364: 1817-1825. 10.1056/NEJMoa1011923 9 Timmer-Bonte J.N.H., Ouwerkerk J., Faber L.M., Kerkhofs L.G.M., Laterveer L., ten Oever D., van Rees B.P., van der Linden P.W. Lipegfilgrastim for Prophylaxis of Chemotherapy-Induced Neutropenia in Dutch Patients. Neth J. Med. 2020; 78: 270-276 Terazawa T., Goto M., Miyamoto T., Asaishi K., Shimamoto F., Kuwakado S., Nishitani H., Kii T., Higuchi K. Efficacy of Prophylactic G-CSF in Patients Receiving FOLFIRINOX: A Preliminary Retrospective Study. Intern Med. 2015; 54: 2969-2973. 10.2169/internalmedicine.54.5325 Steger G., Pichler P., Airoldi M., Mazza P., Fontaine C., Timmer Bonte J., Walewski J.A., Katolicka J., Mikulova M., Gasparic M. Use of Lipegfilgrastim for the Prophylaxis of Chemotherapy-Induced Neutropenia: Pan-European Non-Interventional Study. Ann. Oncol. 2018; 29: viii607-viii608. 10.1093/annonc/mdy300.014 Peng H., James C.A., Cullinan D.R., Hogg G.D., Mudd J.L., Zuo C., Takchi R., Caldwell K.E., Liu J., DeNardo D.G. Neoadjuvant FOLFIRINOX Therapy Is Associated with Increased Effector T Cells and Reduced Suppressor Cells in Patients with Pancreatic Cancer. Clin. Cancer Res. 2021; 27: 6761-6771. 10.1158/1078-0432.CCR-21-0998. 34593529 Zhou C., Chen G., Huang Y., Zhou J., Lin L.Z., Feng J., Wang Z., Shu Y., Shi J., Hu Y. Camrelizumab plus Carboplatin and Pemetrexed versus Chemotherapy Alone in Chemotherapy-Naive Patients with Advanced Non-Squamous Non-Small-Cell Lung Cancer (CameL): A Randomised, Open-Label, Multicentre, Phase 3 Trial. Lancet Respir. Med. 2021; 9: 305-314. 10.1016/S2213-2600(20)30365-9. 33347829 Principe D.R., Narbutis M., Kumar S., Park A., Viswakarma N., Dorman M.J., Kamath S.D., Grippo P.J., Fishel M.L., Hwang R.F. Long-Term Gemcitabine Treatment Reshapes the Pancreatic Tumor Microenvironment and Sensitizes Murine Carcinoma to Combination Immunotherapy. Cancer Res. 2020; 80: 3101-3115. 10.1158/0008-5472.CAN-19-2959 Maecker H.T., McCoy J.P., Nussenblatt R. Standardizing Immunophenotyping for the Human Immunology Project. Nat. Rev. Immunol. 2012; 12: 191-200. 10.1038/nri3158 McKinnon K.M. Flow Cytometry: An Overview. Curr. Protoc. Immunol. 2018; 120: 5.1.1-5.1.11. 10.1002/cpim.40 Costantini A., Mancini S., Giuliodoro S., Butini L., Regnery C.M., Silvestri G., Montroni M. Effects of Cryopreservation on Lymphocyte Immunophenotype and Function. J. Immunol. Methods. 2003; 278: 145-155. 10.1016/S0022-1759(03)00202-3 Campbell D.E., Tustin N.B., Riedel E., Tustin R., Taylor J., Murray J., Douglas S.D. Cryopreservation Decreases Receptor PD-1 and Ligand PD-L1 Coinhibitory Expression on Peripheral Blood Mononuclear Cell-Derived T Cells and Monocytes. Clin. Vaccine Immunol. 2009; 16: 1648-1653. 10.1128/CVI.00259-09 Weinberg A., Song L.Y., Wilkening C., Sevin A., Blais B., Louzao R., Stein D., Defechereux P., Durand D., Riedel E. Optimization and Limitations of Use of Cryopreserved Peripheral Blood Mononuclear Cells for Functional and Phenotypic T-Cell Characterization. Clin. Vaccine Immunol. 2009; 16: 1176-1186. 10.1128/CVI.00342-08 Bagaev A., Kotlov N., Nomie K., Svekolkin V., Gafurov A., Isaeva O., Osokin N., Kozlov I., Frenkel F., Gancharova O. Conserved Pan-Cancer Microenvironment Subtypes Predict Response to Immunotherapy. Cancer Cell. 2021; 39: 845-865.e7. 10.1016/j.ccell.2021.04.014 Danaher P., Warren S., Dennis L., D'Amico L., White A., Disis M.L., Geller M.A., Odunsi K., Beechem J., Fling S.P. Gene Expression Markers of Tumor Infiltrating Leukocytes. J. Immunother. Cancer. 2017; 5: 18. 10.1186/s40425-017-0215-8. 28239471 de Koning W., Latifi D., Li Y., van Eijck C.H.J., Stubbs A.P., Mustafa D.A.M. Identification, Validation, and Utilization of Immune Cells in Pancreatic Ductal Adenocarcinoma Based on Marker Genes. Front. Immunol. 2021; 12: 1449. 10.3389/fimmu.2021.649061 van Eijck C.W.F., de Koning W., van der Sijde F., Moskie M., Groot Koerkamp B., Homs M.Y.V., van der Burg S.H., van Eijck C.H.J., Mustafa D.A.M. A Multigene Circulating Biomarker to Predict the Lack of FOLFIRINOX Response after a Single Cycle in Patients with Pancreatic Ductal Adenocarcinoma. Eur. J. Cancer. 2023; 181: 119-134. 10.1016/j.ejca.2022.12.024. 36652890 Lyman G.H., Yau L., Nakov R., Krendyukov A. Overall Survival and Risk of Second Malignancies with Cancer Chemotherapy and G-CSF Support. Ann. Oncol. 2018; 29: 1903-1910. 10.1093/annonc/mdy311. 30099478 Kunert A., Basak E.A., Hurkmans D.P., Balcioglu H.E., Klaver Y., van Brakel M., Oostvogels A.A.M., Lamers C.H.J., Bins S., Koolen S.L.W. CD45RA+CCR7− CD8 T Cells Lacking Co-Stimulatory Receptors Demonstrate Enhanced Frequency in Peripheral Blood of NSCLC Patients Responding to Nivolumab. J. Immunother. Cancer. 2019; 7: 149. 10.1186/s40425-019-0608-y Rijnders M., Robbrecht D.G.J., Oostvogels A.A.M., van Brakel M., Boormans J.L., Aarts M.J.B., Balcioglu H.E., Hamberg P., Voortman J., Westgeest H.M. A Blood-Based Immune Marker for Resistance to Pembrolizumab in Patients with Metastatic Urothelial Cancer. Cancer Immunol. Immunother. 2022; 72: 759-767. 10.1007/s00262-022-03250-0 van der Sijde F., Li Y., Schraauwen R., de Koning W., van Eijck C.H.J., Mustafa D.A.M. RNA from Stabilized Whole Blood Enables More Comprehensive Immune Gene Expression Profiling Compared to RNA from Peripheral Blood Mononuclear Cells. PLoS ONE. 2020; 15e0235413. 10.1371/journal.pone.0235413 Geiss G.K., Bumgarner R.E., Birditt B., Dahl T., Dowidar N., Dunaway D.L., Fell H.P., Ferree S., George R.D., Grogan T. Direct Multiplexed Measurement of Gene Expression with Color-Coded Probe Pairs. Nat. Biotechnol. 2008; 26: 317-325. 10.1038/nbt1385 Vandesompele J., de Preter K., Pattyn F., Poppe B., van Roy N., de Paepe A., Speleman F. Accurate Normalization of Real-Time Quantitative RT-PCR Data by Geometric Averaging of Multiple Internal Control Genes. Genome Biol. 2002; 3: research0034.1. 10.1186/gb-2002-3-7-research0034 Zhou Y., Zhou B., Pache L., Chang M., Khodabakhshi A.H., Tanaseichuk O., Benner C., Chanda S.K. Metascape Provides a Biologist-Oriented Resource for the Analysis of Systems-Level Datasets. Nat. Commun. 2019; 10: 1523. 10.1038/s41467-019-09234-6. 30944313 Bindea G., Mlecnik B., Hackl H., Charoentong P., Tosolini M., Kirilovsky A., Fridman W.H., Pagès F., Trajanoski Z., Galon J. ClueGO: A Cytoscape Plug-in to Decipher Functionally Grouped Gene Ontology and Pathway Annotation Networks. Bioinformatics. 2009; 25: 1091. 10.1093/bioinformatics/btp101. 19237447 R Core Team. R: A Language and Environment for Statistical Computing; R Core Team: Vienna, Austria. 2022 Wickham H. Ggplot2: Elegant Graphics for Data Analysis; Springer: New York, NY, USA. 2016. 978-3-319-24277-4 Blighe K., Rana S., Lewis M. EnhancedVolcano: Publication-Ready Volcano Plots with Enhanced Colouring and Labeling. 2021Available online: https://bioconductor.org/packages/devel/bioc/vignettes/EnhancedVolcano/inst/doc/EnhancedVolcano.html(accessed on 27 June 2023) Tukey J.W. Exploratory Data Analysis. Addison-Wesley, Reading, MA. J. Biopharm. Stat. 1977; 1: 133-138 Sirniö P., Tuomisto A., Tervahartiala T., Sorsa T., Klintrup K., Karhu T., Herzig K.-H., Mäkelä J., Karttunen T.J., Salo T. High-Serum MMP-8 Levels Are Associated with Decreased Survival and Systemic Inflammation in Colorectal Cancer. Br. J. Cancer. 2018; 119: 213-219. 10.1038/s41416-018-0136-4 Kruzel M.L., Zimecki M., Actor J.K. Lactoferrin in a Context of Inflammation-Induced Pathology. Front. Immunol. 2017; 8: 1438. 10.3389/fimmu.2017.01438 Ribon M., Mussard J., Semerano L., Singer B.B., Decker P. Extracellular Chromatin Triggers Release of Soluble CEACAM8 Upon Activation of Neutrophils. Front. Immunol. 2019; 10: 1346. 10.3389/fimmu.2019.01346. 31258530 Zhao X., Ting S.-M., Sun G., Roy-O'Reilly M., Mobley A.S., Bautista Garrido J., Zheng X., Obertas L., Jung J.E., Kruzel M. Beneficial Role of Neutrophils Through Function of Lactoferrin After Intracerebral Hemorrhage. Stroke. 2018; 49: 1241-1247. 10.1161/STROKEAHA.117.020544 Yamanaka T., Kuroki M., Kinugasa T., Matsuo Y., Matsuoka Y. Preparation and Characterization of Two Human Carcinoembryonic Antigen Family Proteins of Neutrophils, CD66b and c, in Silkworm Larvae. Protein Expr. Purif. 1996; 7: 438-446. 10.1006/prep.1996.0065 Meng X., Liu P., Wu Y., Liu X., Huang Y., Yu B., Han J., Jin H., Tan X. Integrin Beta 4 (ITGB4) and Its Tyrosine-1510 Phosphorylation Promote Pancreatic Tumorigenesis and Regulate the MEK1-ERK1/2 Signaling Pathway. Bosn. J. Basic Med. Sci. 2019; 20: 106. 10.17305/bjbms.2019.4255 Yang J., Goetz D., Li J.-Y., Wang W., Mori K., Setlik D., Du T., Erdjument-Bromage H., Tempst P., Strong R. An Iron Delivery Pathway Mediated by a Lipocalin. Mol. Cell. 2002; 10: 1045-1056. 10.1016/S1097-2765(02)00710-4 Yamao K., Takenaka M., Yoshikawa T., Ishikawa R., Okamoto A., Yamazaki T., Nakai A., Omoto S., Kamata K., Minaga K. Clinical Safety and Efficacy of Secondary Prophylactic Pegylated G-CSF in Advanced Pancreatic Cancer Patients Treated with MFOLFIRINOX: A Single-Center Retrospective Study. Intern. Med. 2019; 58: 1993. 10.2169/internalmedicine.2234-18 Carvalho de Brito A.B., Riechelmann R.P., Fonseca de Jesus V.H. Impact of Granulocyte Colony-Stimulating Factor (G-CSF) on the Outcomes of Patients with Metastatic Pancreatic Adenocarcinoma (MPA) During First-Line Treatment with FOLFIRINOX: A Single-Center Retrospective Analysis. Cancer Control. 2023; 30: 10732748221149543. 10.1177/10732748221149543 Bronte V., Brandau S., Chen S.H., Colombo M.P., Frey A.B., Greten T.F., Mandruzzato S., Murray P.J., Ochoa A., Ostrand-Rosenberg S. Recommendations for Myeloid-Derived Suppressor Cell Nomenclature and Characterization Standards. Nat. Commun. 2016; 7: 12150. 10.1038/ncomms12150 Nywening T.M., Wang-Gillam A., Sanford D.E., Belt B.A., Panni R.Z., Cusworth B.M., Toriola A.T., Nieman R.K., Worley L.A., Yano M. Targeting Tumour-Associated Macrophages with CCR2 Inhibition in Combination with FOLFIRINOX in Patients with Borderline Resectable and Locally Advanced Pancreatic Cancer: A Single-Centre, Open-Label, Dose-Finding, Non-Randomised, Phase 1b Trial. Lancet Oncol. 2016; 17: 651-662. 10.1016/S1470-2045(16)00078-4

By Willem de Koning; Casper W. F. van Eijck; Fleur van der Sijde; Gaby J. Strijk; Astrid A. M. Oostvogels; Reno Debets; Casper H. J. van Eijck and Dana A. M. Mustafa

Reported by Author; Author; Author; Author; Author; Author; Author; Author

Titel:
Analyzing Flow Cytometry or Targeted Gene Expression Data Influences Clinical Discoveries-Profiling Blood Samples of Pancreatic Ductal Adenocarcinoma Patients.
Autor/in / Beteiligte Person: de Koning W ; van Eijck CWF ; van der Sijde F ; Strijk, GJ ; Oostvogels, AAM ; Debets, R ; van Eijck CHJ ; Mustafa, DAM
Link:
Zeitschrift: Cancers, Jg. 15 (2023-08-31), Heft 17
Veröffentlichung: Basel, Switzerland : MDPI, 2023
Medientyp: academicJournal
ISSN: 2072-6694 (print)
DOI: 10.3390/cancers15174349
Sonstiges:
  • Nachgewiesen in: MEDLINE
  • Sprachen: English
  • Publication Type: Journal Article
  • Language: English
  • [Cancers (Basel)] 2023 Aug 31; Vol. 15 (17). <i>Date of Electronic Publication: </i>2023 Aug 31.
  • References: Cancer Cell. 2021 Jun 14;39(6):845-865.e7. (PMID: 34019806) ; Ann Oncol. 2018 Sep 1;29(9):1903-1910. (PMID: 30099478) ; Br J Cancer. 2018 Jul;119(2):213-219. (PMID: 29808017) ; Nat Rev Immunol. 2012 Feb 17;12(3):191-200. (PMID: 22343568) ; Nat Commun. 2016 Jul 06;7:12150. (PMID: 27381735) ; Front Immunol. 2021 Apr 27;12:649061. (PMID: 33986743) ; Neth J Med. 2020 Sep;78(5):270-276. (PMID: 33093252) ; Sci Rep. 2022 Sep 16;12(1):15574. (PMID: 36114233) ; Eur J Cancer. 2023 Mar;181:119-134. (PMID: 36652890) ; Cancer Control. 2023 Jan-Dec;30:10732748221149543. (PMID: 36592369) ; Clin Vaccine Immunol. 2009 Aug;16(8):1176-86. (PMID: 19515870) ; Genome Biol. 2002 Jun 18;3(7):RESEARCH0034. (PMID: 12184808) ; J Oncol. 2022 Jul 7;2022:8549487. (PMID: 35847365) ; Front Immunol. 2017 Nov 06;8:1438. (PMID: 29163511) ; Bioinformatics. 2009 Apr 15;25(8):1091-3. (PMID: 19237447) ; Lancet Oncol. 2016 May;17(5):651-62. (PMID: 27055731) ; J Clin Med. 2018 Jan 04;7(1):. (PMID: 29300345) ; Protein Expr Purif. 1996 Jun;7(4):438-46. (PMID: 8776764) ; CA Cancer J Clin. 2022 Jan;72(1):7-33. (PMID: 35020204) ; J Immunother Cancer. 2017 Feb 21;5:18. (PMID: 28239471) ; N Engl J Med. 2011 May 12;364(19):1817-25. (PMID: 21561347) ; Ther Adv Med Oncol. 2022 Aug 29;14:17588359221119539. (PMID: 36062047) ; Lancet Respir Med. 2021 Mar;9(3):305-314. (PMID: 33347829) ; J Immunother Cancer. 2019 Jun 8;7(1):149. (PMID: 31176366) ; Curr Protoc Immunol. 2018 Feb 21;120:5.1.1-5.1.11. (PMID: 29512141) ; Stroke. 2018 May;49(5):1241-1247. (PMID: 29636422) ; Bosn J Basic Med Sci. 2020 Feb 05;20(1):106-116. (PMID: 31242404) ; Clin Cancer Res. 2021 Dec 15;27(24):6761-6771. (PMID: 34593529) ; Cancer Res. 2020 Aug 1;80(15):3101-3115. (PMID: 32238357) ; Intern Med. 2019 Jul 15;58(14):1993-2002. (PMID: 30996164) ; Cancer Immunol Immunother. 2023 Mar;72(3):759-767. (PMID: 35976415) ; J Immunol Methods. 2003 Jul;278(1-2):145-55. (PMID: 12957403) ; Front Immunol. 2019 Jun 14;10:1346. (PMID: 31258530) ; Nat Biotechnol. 2008 Mar;26(3):317-25. (PMID: 18278033) ; Lancet Oncol. 2016 Jun;17(6):801-810. (PMID: 27160474) ; Mol Cell. 2002 Nov;10(5):1045-56. (PMID: 12453413) ; Intern Med. 2015;54(23):2969-73. (PMID: 26631878) ; PLoS One. 2020 Jun 26;15(6):e0235413. (PMID: 32589655) ; Clin Vaccine Immunol. 2009 Nov;16(11):1648-53. (PMID: 19726615) ; N Engl J Med. 2018 Dec 20;379(25):2395-2406. (PMID: 30575490) ; Nat Commun. 2019 Apr 3;10(1):1523. (PMID: 30944313)
  • Contributed Indexing: Keywords: FOLFIRINOX; flow cytometry; pancreatic ductal adenocarcinoma (PDAC); peripheral immune cell profile; targeted gene expression
  • Entry Date(s): Date Created: 20230909 Latest Revision: 20230911
  • Update Code: 20240513
  • PubMed Central ID: PMC10486875

Klicken Sie ein Format an und speichern Sie dann die Daten oder geben Sie eine Empfänger-Adresse ein und lassen Sie sich per Email zusenden.

oder
oder

Wählen Sie das für Sie passende Zitationsformat und kopieren Sie es dann in die Zwischenablage, lassen es sich per Mail zusenden oder speichern es als PDF-Datei.

oder
oder

Bitte prüfen Sie, ob die Zitation formal korrekt ist, bevor Sie sie in einer Arbeit verwenden. Benutzen Sie gegebenenfalls den "Exportieren"-Dialog, wenn Sie ein Literaturverwaltungsprogramm verwenden und die Zitat-Angaben selbst formatieren wollen.

xs 0 - 576
sm 576 - 768
md 768 - 992
lg 992 - 1200
xl 1200 - 1366
xxl 1366 -