Computed tomography imaging spectrometer
The computed tomography imaging spectrometer (CTIS) is a snapshot imaging spectrometer which can produce in fine the three-dimensional (i.e. spatial and spectral) hyperspectral datacube of a scene.
History
[edit]The CTIS was conceived separately by Takayuki Okamoto and Ichirou Yamaguchi at Riken (Japan), and by F. Bulygin and G. Vishnakov in Moscow (Russia).[1][2][3] The concept was subsequently further developed by Michael Descour, at the time a PhD student at the University of Arizona, under the direction of Prof. Eustace Dereniak.[4]
The first research experiments based on CTIS imaging were conducted in the fields of molecular biology.[5] Several improvements of the technology have been proposed since then, in particular regarding the hardware: dispersive elements providing more information on the datacube,[6] enhanced calibration of the system.[7] The enhancement of the CTIS was also fueled by the general development of bigger image sensors.[8] For academic purposes, although not as widely used as other spectrometers, CTIS has been employed in applications ranging from the military[9] to ophthalmology[10] and astronomy.[11]
Image formation
[edit]
Optical layout
[edit]The optical layout of a CTIS instrument is shown on the left part of the top image. A field stop is placed at the image plane of an objective lens, after which a lens collimates the light before it passes through a disperser (such as a grating or a prism). Finally, a re-imaging lens maps the dispersed image of the field stop onto a large-format detector array.
Resulting image
[edit]The information that the CTIS acquires can be seen as the three-dimensional datacube of the scene. Of course, this cube does not exist in physical space as mechanical objects do, but this representation helps to gain intuition on what the image is capturing: As seen in the figure on the right, the shapes on the image can be considered as projections (in a mechanical sense) of the datacube.
The central projection, called the 0th order of diffraction, is the sum of the datacube following the spectral axis (hence, this projection acts as a panchromatic camera). In the image of the "5" on the right, one can clearly read the number in the central projection, but with no information regarding the spectre of the light.
All the other projections result from "looking" at the cube obliquely and hence contain a mixture of spatial and spectral information. From a discrete point of view where the datacube is considered as a set of spectral slices (as in the figure above, where two such slices are represented in purple and red), one can understand these projections as a partial spread of the stack of slices, similarly to a magician spreading his cards in order for an audience member to pick one of them. It is important to note that for typical spectral dispersions and the typical size of a sensor, the spectral information of a given slice is heavily overlapping with the one from other neighboring slices. In the "5" image, one can see in the side projections that the number is not clearly readable (loss of spatial information), but that some spectral information is available (i.e. some wavelengths appear brighter than others). Hence, the image contains multiplexed information regarding the datacube.
The number and layout of the projections depend on the type of diffracting element employed. In particular, more than one order of diffraction can be captured.[6]
Datacube reconstruction
[edit]The resulting image contains all of the information of the datacube. It is necessary to carry out a reconstruction algorithm to convert this image back in the 3D spatio-spectral space. Hence, the CTIS is a computational imaging system.
Link to X-ray computed tomography
[edit]Conceptually, one can consider each of the projections of the datacube in a manner analogous to the X-ray projections measured by medical X-ray computed tomography instruments used to estimate the volume distribution within a patient's body.
| X-ray CT | CTIS | |
|---|---|---|
| Object to acquire | Slice of a patient's body (2D) | Spatio-spectral datacube (3D) |
| Penetrating wave | X-ray | Light from the scene |
| Projection generator | Transmitters rotating around an axis | Dispersive element |
| Image acquired | Sinogram | CTIS multiplexed image |
Hence, the most widely-used algorithms for CTIS reconstruction are the same as the one used in the X-ray CT field of study. In particular, the algorithm used by Descour[12] is directly taken from a seminal work in X-ray CT reconstruction.[13] Since then, slightly more elaborate techniques have been employed,[8] in the same way (but not to the same extent) X-ray CT reconstruction has improved since the 80s.
Difficulties
[edit]Compared to the X-ray CT field, CTIS reconstruction is notoriously more difficult. In particular, the number of projections resulting from a CTIS acquisition is typically far less than in X-ray CT. This results in a blurrier reconstruction, following the projection-slice theorem. Moreover, unlike X-ray CT where projections are acquired around the patient, the CTIS, as all imaging systems, only acquires the scene from a single point of view, and hence many projection angles are unobtainable.
References
[edit]- ^ Takayuki Okamoto and Ichirou Yamaguchi, "Simultaneous acquisition of spectral image information", Optics Letters 16: 1277-1279 (1991).
- ^ Takayuki Okamoto, Akinori Takahashi, and Ichirou Yamaguchi, "Simultaneous acquisition of spectral and spatial intensity distribution", Applied Spectroscopy 47: 1198-1202 (1993)
- ^ F. V. Bulygin and G. N. Vishnyakov, "Spectrotomography -- a new method of obtaining spectrograms of two-dimensional objects", in Analytical Methods for Optical Tomography, Proc. SPIE 1843: 315-322 (1992).
- ^ Michael Robert Descour, "Non-scanning imaging spectrometry", PhD Thesis, University of Arizona (1994)
- ^ Ford, Bridget K.; Volin, Curtis E.; Murphy, Sean M.; Lynch, Ronald M.; Descour, Michael R. (February 2001). "Computed Tomography-Based Spectral Imaging For Fluorescence Microscopy". Biophysical Journal. 80 (2): 986–993. Bibcode:2001BpJ....80..986F. doi:10.1016/s0006-3495(01)76077-8. ISSN 0006-3495. PMC 1301296. PMID 11159465.
- ^ a b Hagen, Nathan; Dereniak, Eustace L.; Sass, David T. (2006-08-31). "Maximizing the resolution of a CTIS instrument". In Shen, Sylvia S; Lewis, Paul E (eds.). Imaging Spectrometry XI. Vol. 6302. SPIE. pp. 63020L. Bibcode:2006SPIE.6302E..0LH. doi:10.1117/12.680750. S2CID 120974275.
{{cite book}}:|journal=ignored (help) - ^ Wilson, Daniel W.; Maker, Paul D.; Muller, Richard E. (1997-10-31). "Reconstructions of computed-tomography imaging spectrometer image cubes using calculated system matrices". In Descour, Michael R; Shen, Sylvia S (eds.). Imaging Spectrometry III. Vol. 3118. SPIE. pp. 184–193. Bibcode:1997SPIE.3118..184W. doi:10.1117/12.283827. S2CID 136914912.
{{cite book}}:|journal=ignored (help) - ^ a b Ford, Bridget K.; Descour, Michael R.; Lynch, Ronald M. (2001-10-22). "Large-image-format computed tomography imaging spectrometer for fluorescence microscopy". Optics Express. 9 (9): 444–453. Bibcode:2001OExpr...9..444F. doi:10.1364/oe.9.000444. ISSN 1094-4087. PMID 19424362.
- ^ Descour, Michael R.; Dereniak, Eustace L.; Dubey, Abinash C. (1995-06-20). "Mine detection using instantaneous spectral imaging". In Dubey, Abinash C; Cindrich, Ivan; Ralston, James M; Rigano, Kelly A (eds.). Detection Technologies for Mines and Minelike Targets. Vol. 2496. SPIE. pp. 286–304. Bibcode:1995SPIE.2496..286D. doi:10.1117/12.211325. S2CID 62771528.
{{cite book}}:|journal=ignored (help) - ^ Johnson, William R.; Wilson, Daniel W.; Fink, Wolfgang; M.d, Mark S. Humayun; Bearman, Gregory H. (January 2007). "Snapshot hyperspectral imaging in ophthalmology". Journal of Biomedical Optics. 12 (1): 014036. Bibcode:2007JBO....12a4036J. doi:10.1117/1.2434950. ISSN 1083-3668. PMID 17343511.
- ^ Hege, E. Keith; O'Connell, Dan; Johnson, William; Basty, Shridhar; Dereniak, Eustace L. (2004-01-07). Shen, Sylvia S; Lewis, Paul E (eds.). "Hyperspectral imaging for astronomy and space surveillance". Imaging Spectrometry IX. 5159. SPIE: 380–391. doi:10.1117/12.506426. S2CID 121946613.
- ^ a b Descour, Michael; Dereniak, Eustace (1995-08-01). "Computed-tomography imaging spectrometer: experimental calibration and reconstruction results". Applied Optics. 34 (22): 4817–4826. Bibcode:1995ApOpt..34.4817D. doi:10.1364/ao.34.004817. ISSN 0003-6935. PMID 21052321.
- ^ Shepp, L. A.; Vardi, Y. (October 1982). "Maximum Likelihood Reconstruction for Emission Tomography". IEEE Transactions on Medical Imaging. 1 (2): 113–122. doi:10.1109/TMI.1982.4307558. ISSN 0278-0062. PMID 18238264.
External links
[edit]- A fast reconstruction algorithm for computed tomography imaging spectrometer (CTIS) is documented in the paper: Larz White, W. Bryan Bell, Ryan Haygood, "Accelerating computed tomographic imaging spectrometer reconstruction using a parallel algorithm exploiting spatial shift-invariance", Opt. Eng. 59(5), 055110 (2020).[1]