-
Reviewing FID and SID Metrics on Generative Adversarial Networks
Authors:
Ricardo de Deijn,
Aishwarya Batra,
Brandon Koch,
Naseef Mansoor,
Hema Makkena
Abstract:
The growth of generative adversarial network (GAN) models has increased the ability of image processing and provides numerous industries with the technology to produce realistic image transformations. However, with the field being recently established there are new evaluation metrics that can further this research. Previous research has shown the Fréchet Inception Distance (FID) to be an effective…
▽ More
The growth of generative adversarial network (GAN) models has increased the ability of image processing and provides numerous industries with the technology to produce realistic image transformations. However, with the field being recently established there are new evaluation metrics that can further this research. Previous research has shown the Fréchet Inception Distance (FID) to be an effective metric when testing these image-to-image GANs in real-world applications. Signed Inception Distance (SID), a founded metric in 2023, expands on FID by allowing unsigned distances. This paper uses public datasets that consist of façades, cityscapes, and maps within Pix2Pix and CycleGAN models. After training these models are evaluated on both inception distance metrics which measure the generating performance of the trained models. Our findings indicate that usage of the metric SID incorporates an efficient and effective metric to complement, or even exceed the ability shown using the FID for the image-to-image GANs
△ Less
Submitted 5 February, 2024;
originally announced February 2024.
-
DMLR: Data-centric Machine Learning Research -- Past, Present and Future
Authors:
Luis Oala,
Manil Maskey,
Lilith Bat-Leah,
Alicia Parrish,
Nezihe Merve Gürel,
Tzu-Sheng Kuo,
Yang Liu,
Rotem Dror,
Danilo Brajovic,
Xiaozhe Yao,
Max Bartolo,
William A Gaviria Rojas,
Ryan Hileman,
Rainier Aliment,
Michael W. Mahoney,
Meg Risdal,
Matthew Lease,
Wojciech Samek,
Debojyoti Dutta,
Curtis G Northcutt,
Cody Coleman,
Braden Hancock,
Bernard Koch,
Girmaw Abebe Tadesse,
Bojan Karlaš
, et al. (13 additional authors not shown)
Abstract:
Drawing from discussions at the inaugural DMLR workshop at ICML 2023 and meetings prior, in this report we outline the relevance of community engagement and infrastructure development for the creation of next-generation public datasets that will advance machine learning science. We chart a path forward as a collective effort to sustain the creation and maintenance of these datasets and methods tow…
▽ More
Drawing from discussions at the inaugural DMLR workshop at ICML 2023 and meetings prior, in this report we outline the relevance of community engagement and infrastructure development for the creation of next-generation public datasets that will advance machine learning science. We chart a path forward as a collective effort to sustain the creation and maintenance of these datasets and methods towards positive scientific, societal and business impact.
△ Less
Submitted 1 June, 2024; v1 submitted 21 November, 2023;
originally announced November 2023.
-
Polarization-Dependent Loss of Optical Connectors Measured with High Accuracy (<0.004 dB) after Cancelation of Polarimetric Errors
Authors:
Reinhold Noe,
Benjamin Koch
Abstract:
State-of-the-art polarimeter calibration is reviewed. Producing many quasi-random polarization states and moving/bending a fiber without changing power allows finding a polarimeter calibration where the degree-of-polarization reaches unity and parasitic polarization-dependent loss is small. Using a polarization scrambler/transformer and a polarimeter a device-under-test can be characterized. Its M…
▽ More
State-of-the-art polarimeter calibration is reviewed. Producing many quasi-random polarization states and moving/bending a fiber without changing power allows finding a polarimeter calibration where the degree-of-polarization reaches unity and parasitic polarization-dependent loss is small. Using a polarization scrambler/transformer and a polarimeter a device-under-test can be characterized. Its Mueller matrix can be decomposed into a product of a nondepolarizing Mueller-Jones matrix times a purely depolarizing Mueller matrix. Test polarizations may drift over time. With help of an optical switch the reference device can be measured against an internal reference path. Later, with possibly different test polarizations, the actual device-under-test is measured against the internal reference. Polarization drift and need for repeated reference device measurement are thus overcome. When a patchcord is inserted, connector PDL can be measured, provided that errors are calibrated away, again by fiber moving/bending. Experimentally we have measured PDL with errors <0.004 dB. This easily suffices to measure connector PDL, which is demonstrated. PDL >60 dB was measured when the device under test was a good polarizer. A 20 Mrad/s polarization scrambler with LiNbO3 device generates the test polarizations. The polarimeter can sample at 100 MHz and can store 64M Stokes vectors. During laser frequency scans Mueller matrices can be measured in time intervals as short as 5 us.
△ Less
Submitted 28 June, 2022;
originally announced July 2022.
-
PMD-Tolerant 20 krad/s Endless Polarization and Phase Control for BB84-Based QKD with TDM Pilot Signals
Authors:
Benjamin Koch,
Reinhold Noe
Abstract:
TDM-based polarization and differential phase control with 35ps PMD tolerance and 20krad/s tracking speed is demonstrated. 600ns intervals are reserved for QKD and for 0°- and 45°-polarized pilot signals. ECLs are modulated directly, with high extinction. Power budget is 17dB, fiber length is 63km.
TDM-based polarization and differential phase control with 35ps PMD tolerance and 20krad/s tracking speed is demonstrated. 600ns intervals are reserved for QKD and for 0°- and 45°-polarized pilot signals. ECLs are modulated directly, with high extinction. Power budget is 17dB, fiber length is 63km.
△ Less
Submitted 20 May, 2020;
originally announced June 2020.
-
Structure and Needed Properties of Reasonable Polarization Mode Dispersion Emulators for Coherent Optical Fiber Transmission
Authors:
Reinhold Noe,
Benjamin Koch
Abstract:
This paper proposes a scientifically reasonable polarization mode dispersion (PMD) emulator (PMDE) for coherent optical fiber transmission. Guidelines are physically correct modeling of the polarization-dispersive fiber, the time-variable polarization transformations occurring in there, including emulation of polarization events caused by lightning strikes, the adoption of acceptable compromise to…
▽ More
This paper proposes a scientifically reasonable polarization mode dispersion (PMD) emulator (PMDE) for coherent optical fiber transmission. Guidelines are physically correct modeling of the polarization-dispersive fiber, the time-variable polarization transformations occurring in there, including emulation of polarization events caused by lightning strikes, the adoption of acceptable compromise to keep implementation cost low enough and competitive industrial basis for production of such PMDE. We propse a PMDE consisting of N differential group delay (DGD) sections placed between N+1 time-variable general retarders or polarization scramblers. These should be general elliptical retarders, capable of changing polarization with rates up to 20 Mrad/s on the Poincaré sphere. That should include bursts of polarization rotations forth and back at up to 20 Mrad/s. The DGD sections can be fixed or variable and should be able to constitute a total PMD of alternatively, say, 20 ps, 50 ps, 100 ps, 200 ps, or another set of various discrete values. We propose even N and equal individual DGDs, which allows the total PMDE to assume a neutral state without any PMD of whatever order. Number N may be chosen relatively small; N = 2 seems acceptable. A variety of component and subsystem suppliers is available, and the proposed PMDE is available on the market.
△ Less
Submitted 12 March, 2019;
originally announced March 2019.
-
Accuracy Limits of Polarization-Independent Optical Depolarizers Based on Rotating Waveplates
Authors:
Reinhold Noe,
Benjamin Koch
Abstract:
Optical depolarizers for monochromatic waves which work independent of input polarization can be built from cascaded electrooptic rotating waveplates. If the waveplate retardations deviate from their desired values then the worst-case residual degree-of-polarization DOPmax is larger than its desired value 0. In a depolarizer consisting of one rotating halfwave and one rotating quarterwave plate, D…
▽ More
Optical depolarizers for monochromatic waves which work independent of input polarization can be built from cascaded electrooptic rotating waveplates. If the waveplate retardations deviate from their desired values then the worst-case residual degree-of-polarization DOPmax is larger than its desired value 0. In a depolarizer consisting of one rotating halfwave and one rotating quarterwave plate, DOPmax roughly equals the retardation error, which is <<1. However, with just one rotating quarterwave plate more, DOPmax roughly equals the square of the retardation error which is a much smaller value. Thereby depolarizer accuracy is substantially improved. Waveplate sequence and rotation frequency combinations suitable for fast depolarization are discussed.
△ Less
Submitted 25 January, 2019;
originally announced January 2019.
