|
|
||||||||
From the Nuffield Laboratory of Ophthalmology, University of Oxford, Oxford, United Kingdom.
| Abstract |
|---|
|
|
|---|
METHODS. Ischemia was delivered to the rabbit retina by raising the IOP. After 3 days, a flash electroretinogram (ERG) was recorded, and the retina processed for the localization of certain antigens. In the rat, N-methyl-D-aspartate (NMDA) was injected intravitreally, and 8 days later, the retinas were analyzed for the localization of Thy-1 or the relative amounts of mRNAs for antigens located to ganglion cells or photoreceptors. Rats and rabbits received topical flunarizine or vehicle before and after ischemia or NMDA. IOP was measured in rabbits after a single topical application of 2% flunarizine. Studies were conducted on isolated rat retinas, cortical cultures, and brain synaptosomes to compare the effectiveness of flunarizine with nifedipine and betaxolol at reducing the influx of calcium or sodium.
RESULTS. Changes in rabbit retinal choline acetyltransferase and parvalbumin immunoreactivities and the b-wave of the ERG caused by ischemia-reperfusion were blunted by topical treatment with flunarizine. Similarly, NMDA induced reductions in Thy-1 immunoreactivity and mRNA for rat ganglion cell antigens (Thy-1 and neurofilament light form) were counteracted by topical application of flunarizine. Topical application of 2% flunarizine significantly lowered the IOP in rabbits over a period of 5 hours. Flunarizine was more effective than betaxolol and much stronger than nifedipine at attenuating veratridine-induced influx of sodium into synaptosomes. Nifedipine, flunarizine, and betaxolol all reduced the NMDA-induced influx of calcium into the isolated retina or cortical neurons, but betaxolol was the least effective.
CONCLUSIONS. Topically applied flunarizine reduces IOP and attenuates injury to the whole of the retina, including the ganglion cells. The neuroprotective action of flunarizine is to reduce the influx of calcium and sodium into stressed neurons. The potent effect of flunarizine on sodium influx would be particularly protective to axons.
| Introduction |
|---|
|
|
|---|
A common feature of both ischemia to the retina and mechanical damage to the optic nerve in animals is an excessive release of the excitatory neurotransmitter glutamate.5 6 Glutamate and glutamate receptor agonists are toxic to retinal ganglion cells, both in culture7 and when injected intravitreally.8 Ganglion cells are thought to be particularly sensitive to glutamate toxicity because of the presence of N-methyl-D-aspartate (NMDA) receptors on these cells.9 In support of this assertion, NMDA receptor antagonists protect ganglion cells from ischemic and excitotoxic insults8 10 and from optic nerve crush.11 12 A role for glutamate receptor-mediated excitotoxicity in the pathogenesis of both true and experimental glaucoma is supported by the findings that the glutamate levels in the vitreous humor of patients with glaucoma and animals are significantly elevated in comparison with those in control subjects.13 Activation of voltage-dependent sodium and calcium channels (Na+ and Ca2+ channels) are key steps in the release of glutamate and the cascade of detrimental events that occur in ischemia. As a consequence, it is of no surprise to find that substances that diminish the influx of Ca2+ and/or Na+ have been shown to protect neurons in the central nervous system (CNS) from the detrimental effects of ischemia-excitotoxicity.14 15
Interest in the potential neuroprotective action of calcium channel antagonists in retinal ischemia-excitotoxicity models has stemmed from the knowledge that a number of these drugs can lower IOP and improve retinal blood flow. For example, the L-type antagonists verapamil, nifedipine, and diltiazem, applied topically, all reduce IOP in rabbits16 and primates.17 Topical verapamil has also been shown to lower IOP18 and improve microcirculation in the optic nerve head19 in humans. Results to date with calcium channel blockers used in retinal models of ischemia-excitotoxicity are positive. Researchers have reported favorable effects of nifedipine,20 lomerizine,21 nimodipine, and levemopamil.22 23
The ability of Na+ channel antagonists to protect retinal neurons from insults in vivo has thus far been largely ignored. This is surprising, because substances that reduce Na+ influx have been shown to be particularly effective neuroprotectants against ischemia-induced damage to CNS white matter, rather than gray matter.24 Pertinent to the retina, anoxic injury to the isolated rat optic nerve can be ameliorated by exposure to the potent Na+ channel blocker tetrodotoxin.25 Because the initial insult to ganglion cells in diseases such as glaucoma appears to occur at the level of their axons (white matter), it can be argued that an effective neuroprotectant for this disease may ideally have sodium as well as calcium channel-blocking characteristics. Certain ligands display both calcium and sodium channel-blocking activities,26 and the rationale for the current research is to provide detailed information on the potential effectiveness of one such drug, flunarizine, in paradigms of ischemia-excitotoxicity.
The diphenylalkylamine flunarizine is classified as a type IV voltage-dependent calcium channel antagonist and a vasodilator. It is regarded as a wide-spectrum Ca2+ channel antagonist, but nevertheless displays relative selectivity for the L- and T-type channels. Recent work has shown that topical application of flunarizine reduces IOP in primates17 and improves blood flow to the optic nerve head in patients with low-tension glaucoma.27 Flunarizine also exhibits considerable affinity for Na+ channels,28 although whether this property contributes to its effects remains unknown. Flunarizine has been found to attenuate the effect of ischemia to the brain29 30 31 32 and also protects neurons from death after axotomy-nerve crush.33 34 35 In rats, flunarizine reduces ischemicexcitotoxic damage to the retina,21 36 blunts the effects of argon laserinduced retinal injury,37 lessens light-induced retinal degeneration,38 and enhances ganglion cell survival after axotomy.39 In all prior studies, flunarizine was not applied topically, and rabbits were not the experimental animal. The primary purpose of this work was to provide further support for the idea that topically applied flunarizine is neuroprotective for the ganglion cells of the retina in paradigms of ischemia-excitotoxicity. Initially, we examined whether repeated topical administration of flunarizine reduces retinal cell death after ischemia-reperfusion and NMDA injection. We then investigated whether topical application of flunarizine lowers IOP in rabbits. Experiments were also conducted to compare the effectiveness of flunarizine with that of betaxolol in reducing Ca2+ influx (in retinal and cortical neurons) and Na+ influx (in brain synaptosomes), so as to obtain a possible measure of their neuroprotective potencies.
| Materials and Methods |
|---|
|
|
|---|
Ischemia-Reperfusion
Five litters of rabbits, two comprising six animals and three comprising four animals, were used in the present study. Each litter was divided into two groups, one group received 20 µL 2% flunarizine in 50% polyethylene glycol topically (both eyes) and the other the drug vehicle (both eyes) 1 hour before and 1 hour after ischemia and twice daily during reperfusion. Ischemia was given for 60 minutes to the left eye of each animal from the two groups. This was performed by use of an ophthalmodynamometric cup and raising the IOP to 125 mm Hg to affect the retinal blood flow. Because the degree of blockage of retinal blood flow is dependent on the size of the eye, 7-week-old rabbits were used. After 3 days of reperfusion, a flash electroretinogram was recorded and the amplitude of the b-wave analyzed.40
The animals were then killed and the retinas dissected and processed for immunohistochemistry.
NMDA Injection
Two groups of 14 rats (200250 g) received either 5-µL doses of topical flunarizine (2% in 50% polyethylene glycol) or 5-µL doses of vehicle bilaterally, twice daily for 2 days. On the third day, 5 µL NMDA in sterile water was injected intravitreally into a single eye of each animal (the calculated concentration in the vitreous humor was 200 µM). The other eye was injected with 5 µL sterile water. The rats were further treated topically with flunarizine or vehicle twice daily for 7 days. The rats were then killed and the retinas removed for mRNA analysis (eight rats in each group) or for immunohistochemistry (six rats in each group).
Reverse TranscriptionPolymerase Chain Reaction
The levels of Thy-1, rhodopsin, and neurofilament light (NF-L; molecular mass 7080 kDa) from mRNAs present in the retinas were determined with a semiquantitative reverse transcriptionpolymerase chain reaction (RT-PCR) technique, as described previously.41
Briefly, total RNA was isolated, and first-strand cDNA synthesis performed on 2 µg DNase-treated RNA. The individual cDNA species were amplified in a reaction containing a cDNA aliquot, PCR buffer, MgCl2 (4 mM for rhodopsin and Thy-1 primers and 5 mM for NF-L). Reactions were initiated by incubating at 94°C for 10 minutes and PCR (94°C, 15 seconds; 52°C, 30 seconds; 72°C, 30 seconds) performed for a suitable number of cycles to ensure that amplification had not occurred (rhodopsin, 23; Thy-1 and NF-L, 29), followed by a final extension at 72°C for 3 minutes. Interexperimental variations were avoided by performing all amplifications in a single run. Oligonucleotides primers used were 5'-CGCTTTATCAAGGTCCTTACTC-3' and 5'-GCGTTTTGAGATATTTGAAGGT-3' (sense and antisense for Thy-1), 5'-CAGTGTTCATGTGGGATTGACT-3' and 5'-ATGATTGGGTTGTAGATGGAGG-3' (sense and antisense for rhodopsin), and 5'-ATGCTCAGATCTCCGTGGAGATG-3' and 5'-GCTTCGCACTCATTCTCCAGTT-3' (sense and antisense for NF-L). PCR reaction products were separated on 1.5% agarose gels using ethidium bromide for visualization. The relative abundance of each PCR product was determined by quantitative analysis of digital photographs of gels on computer (Labworks; UVP Products, Upland, CA).
Calcium Influx into Cortical Neurons
Cortical neurons were prepared from 16- to 18-day fetal rats, exactly as described previously.42
Isolated neurons were plated in 12-well multiwell plates at approximately 1 to 2 x 106 cells per well. Cultures were left to grow for 7 days in an atmosphere of 5% CO2-95% air at 35.5°C in saturating humidity. Calcium influx studies were performed as outlined previously.42
Effect of Flunarizine on Calcium Influx into Isolated Rat Retinas
Freshly dissected retinas were preincubated in magnesium-free Krebs-Ringer bicarbonate buffer (138 mM NaCl, 1 mM CaCl2, 5.6 mM KCl, 1 mM NaH2PO4-Na2HPO4, 11 mM NaHCO3, 10 mM glucose, and 20 mM HEPES [pH 7.4] and continuously perfused with 95% O2-5% CO2) for 25 minutes at 37°C. Test substances were added and, after 10 minutes, calcium influx initiated by the addition of 1 µCi 45CaCl2 and 100 µM NMDA in a final volume of 2 mL. After a 15-minute incubation, the reaction was terminated by the addition of 2 mL ice-cold 10 mM EGTA-0.9% NaCl. Retinas were washed twice in 1 mM EGTA-0.9% NaCl and sonicated in 1 mL distilled water. Radioactivity was determined by liquid scintillation spectrometry using 5 mL liquid scintillation cocktail (Insta-gel Plus; Packard BioScience, Groningen, The Netherlands), and protein concentration was determined with a bicinchoninic protein assay kit (Sigma), with bovine serum albumin as the standard.
Sodium Influx into Rat Cortical Synaptosomes
Sodium influx experiments were conducted as previously described.43
In brief, aliquots of freshly prepared rat cortical synaptosomes containing approximately 350 to 450 µg protein were preincubated at 37°C for 10 minutes, with or without test agents. After preincubation, 0.5 µCi 22Na+ was added, and the samples were incubated for 10 minutes at 37°C. Uptake was initiated by the addition of 100 µM veratridine and terminated after 30 seconds by washing. Samples were rapidly vacuum filtered and washed and trapped radioactivity measured by liquid scintillation spectrometry. Nonspecific uptake of Na+ was determined in the presence of 1 µM tetrodotoxin.
Intraocular Pressure
An applanation pneumatometer (Ocular Blood Flow Tonograph; OBF Laboratories, Malmesbury, UK), calibrated for use in rabbits,44
was used to determine the IOP after topical instillation of 1 drop of 0.4% benoxinate hydrochloride. All experiments were conducted in a masked manner, and measurements were taken 60 minutes before and at the onset of topical application of 30 µL 2% flunarizine (in 50% polyethylene glycol) or drug vehicle. After a single application at the midpoint of the light period (t = 0) the IOP was measured at 60-minute intervals for a period of 5 hours and then at two 3-hour intervals during the dark phase.
Immunohistochemistry
Similar regions from retinas were excised and fixed in 2% paraformaldehyde and cryopreserved and frozen 10-µm-thick sections produced. Retinal sections were incubated overnight at 4°C with rabbit anti-parvalbumin (1:200; Sigma), rabbit anti-choline acetyltransferase (ChAT; 1:200; Sigma) or mouse anti-Thy-1 monoclonal antibody (clone OX-7, 1:10) and developed with appropriate secondary antibodies conjugated with fluorescein.
Statistical Analysis
All results are expressed as mean ± SEM. Comparisons were made using Students paired or unpaired t-tests where appropriate. P < 0.05 was considered significant.
| Results |
|---|
|
|
|---|
|
|
|
|
|
|
|
|
|
| Discussion |
|---|
|
|
|---|
In previous studies, the Ca2+ channel blockers nifedipine20 and levemopamil23 have been shown to attenuate the ERG b-wave amplitude loss after an ischemialike insult to the retina. The present results are therefore consistent with these observations, although how they exert their effects remains uncertain. One obvious possibility is that neurons in the outer retina are adversely affected by ischemia and that Ca2+ channel blockers simply act to prevent Ca2+ overload. Another possibility is that the cation channel-blocking activity of these substances helps to maintain the normal physiology of the Müller cells.
It is generally accepted that raised IOP is more detrimental to the inner than the outer retina. This is reflected by changes in a number of antigens associated with inner retinal neurons, including Thy-1 (ganglion cells), NF-L (ganglion cell axons), ChAT (small subset of amacrine cells), and parvalbumin (many amacrine cells).47
48
It has been shown in the current study that amacrine cells are affected in the rabbit retina by ischemia-reperfusion and that flunarizine partially blunts these effects. It is also known that ischemia-reperfusion or intraocular injections of NMDA cause destruction to rat retinal ganglion cells by similar, but not necessarily identical, mechanisms. Substances that protect against NMDA toxicity to ganglion cells include NMDA antagonists,49
calcium channel blockers,21
22
betaxolol,50
and
2-adrenoceptor agonists.51
The finding that flunarizine also does so, not only confirms the usefulness of calcium channel blockers as neuroprotectants, but also shows that they can be effective when topically applied, at least in the case of flunarizine. Such data support the idea that when topically applied to the human eye, flunarizine may promote survival of some retinal ganglion cellsfor example, in glaucoma. Of course, it should be stated that in both glaucoma and ischemia, it is glutamate rather than NMDA that causes damage to ganglion cells. However, because most investigators are in agreement that the predominant form of glutamate excitotoxicity of retinal ganglion cells is mediated by overstimulation of the NMDA receptor type,2
8
results obtained using NMDA are a useful way of mimicking the effect of glutamate. In the normal eye, the retina has efficient mechanisms for uptake of glutamate, which means that very high levels would have to be injected to produce deleterious effects on ganglion cells.
In our investigation, 10 µM flunarizine (an L- and T-type channel blocker) was slightly less effective than the same concentration of nifedipine (an L-type channel blocker) at reducing the NMDA-induced influx of Ca2+ in the rat retina. This suggests that the NMDA-induced influx of Ca2+ involves a significant contribution from L-type but not T-type Ca2+ channels, a conclusion drawn previously.52 Thus, if the neuroprotective effect of these compounds is dependent solely on their ability to attenuate Ca2+ influx, it can be predicted that nifedipine would be the more effective of the two. Because there is a general consensus that intracellular levels of both Ca2+ and Na+ increase when a neuron is induced to die by ischemia, it would be anticipated that compounds that block the entry of both cations would be more efficacious neuroprotectants. This would be expected to be the case with flunarizine, which was much more effective than nifedipine at blunting Na+ influx (Fig. 7) . To be certain of the neuroprotective capabilities of these compounds, a direct comparison would have to be undertaken; however, perhaps in a tissue culture system in which possible confounding factors such as effects of ocular blood flow and/or pharmacokinetic differences could be eliminated. Nevertheless, that voltage-dependent Ca2+ channel blockers do not completely inhibit the NMDA-induced Ca2+ influx in vitro helps to explain why flunarizine only partially prevented the loss of Thy-1 mRNA caused by NMDA in vivo.
It appears that the mechanism by which flunarizine acts as a neuroprotectant is very similar to that of the ß-adrenoceptor antagonist betaxolol (i.e., reducing Na+ and Ca2+ influx).43 53 The Na+ channel-blocking activity of these compounds is much more effective than that of nifedipine; this is particularly important in the context of their neuroprotective actions in white matter (ganglion cell axon), as opposed to gray matter (ganglion cell body and dendrites). Anoxic injury to the rat optic nerve can be ameliorated by exposure to Na+ channel blockers25 and local substances that prevent the reversal of the sodium-calcium exchanger54 Ca2+ channel blockers being essentially ineffective.55 Because it is generally believed that in glaucoma the initial insult to the ganglion cell is to the axon in the optic nerve head,56 it follows that an effective neuroprotectant has to be particularly directed to preserving the ganglion cell axon. It is therefore suggested that such calcium channel blockers as flunarizine, rather than nifedipine, could be more appropriate candidates for use in glaucoma. Moreover, because flunarizine is more effective at reducing the influx of Ca2+ and Na+ than betaxolol, it follows that theoretically it should be a more potent neuroprotectant.
Future studies on retinal cell cultures will examine this idea in detail in conditions that should make it possible to make a direct comparison of the potencies of the two compounds. As a final point, it should be recognized that the neuroprotective action of flunarizine may occur partly because of increased blood flow to the affected tissues. Flunarizine is known to have vasodilatory properties and to improve blood flow to the optic nerve head in patients with low-tension glaucoma.27
The observation that topically applied flunarizine attenuates NMDA- and ischemia-induced injuries to the retina raises two questions: How does flunarizine get to the retina, and does the concentration required to be effective relate to the findings observed in the in vitro studies? We suggest that topically applied flunarizine reaches the retina through a combination of systemic and local routes. The reasoning behind this suggestion is that experiments with other topical drugs that are neuroprotective to ganglion cells have shown this to be the case. With regard to the second question, it is likely that the amount of flunarizine required for effective neuroprotection is not necessarily related to the concentration of substance needed to blunt the effect of NMDA in the in vitro studies (Figs. 5 6) . In the in vitro experiments, 100 µM NMDA was necessary to clearly stimulate calcium influx and at least 10 µM flunarizine to attenuate this effect. With more sensitive procedures, less NMDA is likely to be required to obtain a measurable influx of calcium and, as a consequence, less flunarizine to blunt the effect. In addition, in the in vitro studies, NMDA caused a measurable increase in calcium influx within 30 minutes. In contrast, even when NMDA is injected into the vitreous humor so that the concentration is approximately 100 µM, ganglion cell death can be clearly measured only after 7 days (Osborne NN, unpublished data, 1998), suggesting that the amount of NMDA actually reaching the ganglion cells is appreciably less than the 100 µM in the vitreous humor. In cell culture experiments, it is known that 100 µM NMDA causes cell death within 2 days, supporting this notion.57 It is therefore postulated that the actual amount of flunarizine that has to reach the retina to attenuate NMDA- or ischemia-induced injuries to the retina is considerably less than that predicted from the in vitro studies. This is partly because the insult to the retina in vivo is likely to be milder (and therefore a measurable effect requires a number of days) than occurs in in vitro studies in which the experiments are completed in a short period (30 minutes).
Various studies have shown that topically applied calcium channel blockers can reduce IOP.16 17 Indeed, flunarizine itself has recently been demonstrated to lower IOP in the monkey eye when applied topically.17 The results of this study support these findings: A single topical application of 2% flunarizine to the rabbit eye caused a significant reduction in IOP that was sustained for 5 hours. The magnitude of the response and the relatively long duration of action are similar to the effects of certain Ca2+ channel blockers in the rabbit and monkey,17 58 implying that the mechanism of action probably involves blockade of Ca2+ channels. However, it should be noted that flunarizine is also an effective antagonist at Na+ channels, and Na+ channels are known to be expressed by the ciliary epithelium.59 As a result, a reduction in Na+ influx may contribute to the decrease of IOP induced by flunarizine, although Na+ channel-blocking drugs have not, to date, been tested on aqueous dynamics. In addition, flunarizine has effects on the dopaminergic60 and serotonergic61 systems, and each of these neurotransmitters can modulate IOP. To complicate matters further, different Ca2+ channels are associated with different structures in the anterior uvea, and probably the types vary across species. Detailed information regarding the density and types of Ca2+ channels associated with the various structures in the anterior uvea is not available, but it is known that L- and T-type Ca2+ channels are associated with the ciliary processes62 63 and L-type channels alone with the trabecular meshwork.64 Different Ca2+ channel antagonists have differential ion channel selectivities; therefore, flunarizine may not lower IOP by exactly the same mechanism as other Ca2+ channel antagonists, such as verapamil and nifedipine. In support of the argument that Ca2+ channels vary across species are the data obtained using verapamil: Erickson et al.65 reported that flunarizine increased outflow facility in perfused human eyes, whereas Melena et al.66 showed that it decreases the same parameter in rabbits. More comprehensive research is needed to elucidate exactly how Ca2+ channel blockers lower IOP.
In conclusion, we propose that further study is warranted in primates and humans into the potential usefulness of flunarizine in the amelioration of retinal injuries caused by ischemic, hypoxic, or excitotoxic episodes. This is based on studies in rats and rabbits, in which it was shown that when topically applied, this drug reduced IOP and attenuated injury to ganglion cells. Moreover, it protected against general injuries to the retina caused by ischemia-reperfusion. The neuroprotective action of flunarizine does not appear to be weak and is directed to preserving the ganglion cell, including the axon. Such data, together with the findings that flunarizine reduces IOP in monkeys,17 can be safely administered to humans, and even improves blood flow to the optic nerve head in low-tension glaucoma,27 provide impressive support for the idea that flunarizine may be beneficial in pathologic conditions in which the functioning of ganglion cells is known to be compromised. As a note of caution, however, a wide variety of classes of drug acting through a diverse array of distinct but often complementary mechanisms have been found to offer some degree of neuroprotection to retinal neurons in in vitro and in vivo experimental paradigms (for review see Ritch67 ).There is still much to be learned about how ganglion cells die in glaucoma3 and other diseases before we can be confident of selecting the most suitable neuroprotectant for clinical use.
| Footnotes |
|---|
Submitted for publication July 31, 2001; revised January 22, 2002; accepted January 24, 2002.
Commercial relationships policy: N.
The publication costs of this article were defrayed in part by page charge payment. This article must therefore be marked "advertisement" in accordance with 18 U.S.C.
1734 solely to indicate this fact.
Corresponding author: Neville N. Osborne, Nuffield Laboratory of Ophthalmology, University of Oxford, Walton Street, Oxford GB-OX2 6AW, UK; neville.osborne{at}eye.ox.ac.uk.
| References |
|---|
|
|
|---|
1-adrenoceptor antagonist, has an affinity for L-type Ca2+ channels Eur J Pharmacol 378,317-322[Medline][Order article via Infotrieve]
This article has been cited by other articles:
![]() |
O. Uckermann, S. Uhlmann, T. Pannicke, M. Francke, R. Gamsalijew, F. Makarov, E. Ulbricht, P. Wiedemann, A. Reichenbach, N. N. Osborne, et al. Ischemia-Reperfusion Causes Exudative Detachment of the Rabbit Retina Invest. Ophthalmol. Vis. Sci., July 1, 2005; 46(7): 2592 - 2600. [Abstract] [Full Text] [PDF] |
||||
![]() |
F. Dijk, E. Kraal-Muller, and W. Kamphuis Ischemia-Induced Changes of AMPA-Type Glutamate Receptor Subunit Expression Pattern in the Rat Retina: A Real-Time Quantitative PCR Study Invest. Ophthalmol. Vis. Sci., January 1, 2004; 45(1): 330 - 341. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. B. El-Remessy, I. E. Khalil, S. Matragoon, G. Abou-Mohamed, N.-J. Tsai, P. Roon, R. B. Caldwell, R. W. Caldwell, K. Green, and G. I. Liou Neuroprotective Effect of(-){Delta}9-Tetrahydrocannabinol and Cannabidiol in N-Methyl-D-Aspartate-Induced Retinal Neurotoxicity: Involvement of Peroxynitrite Am. J. Pathol., November 1, 2003; 163(5): 1997 - 2008. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. Campana, C. Bucolo, G. Murari, and S. Spampinato Ocular Hypotensive Action of Topical Flunarizine in the Rabbit: Role of sigma 1 Recognition Sites J. Pharmacol. Exp. Ther., December 1, 2002; 303(3): 1086 - 1094. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||