-
FlowMo: Variance-Based Flow Guidance for Coherent Motion in Video Generation
Authors:
Ariel Shaulov,
Itay Hazan,
Lior Wolf,
Hila Chefer
Abstract:
Text-to-video diffusion models are notoriously limited in their ability to model temporal aspects such as motion, physics, and dynamic interactions. Existing approaches address this limitation by retraining the model or introducing external conditioning signals to enforce temporal consistency. In this work, we explore whether a meaningful temporal representation can be extracted directly from the…
▽ More
Text-to-video diffusion models are notoriously limited in their ability to model temporal aspects such as motion, physics, and dynamic interactions. Existing approaches address this limitation by retraining the model or introducing external conditioning signals to enforce temporal consistency. In this work, we explore whether a meaningful temporal representation can be extracted directly from the predictions of a pre-trained model without any additional training or auxiliary inputs. We introduce FlowMo, a novel training-free guidance method that enhances motion coherence using only the model's own predictions in each diffusion step. FlowMo first derives an appearance-debiased temporal representation by measuring the distance between latents corresponding to consecutive frames. This highlights the implicit temporal structure predicted by the model. It then estimates motion coherence by measuring the patch-wise variance across the temporal dimension and guides the model to reduce this variance dynamically during sampling. Extensive experiments across multiple text-to-video models demonstrate that FlowMo significantly improves motion coherence without sacrificing visual quality or prompt alignment, offering an effective plug-and-play solution for enhancing the temporal fidelity of pre-trained video diffusion models.
△ Less
Submitted 4 June, 2025; v1 submitted 1 June, 2025;
originally announced June 2025.
-
Adapting to the Unknown: Training-Free Audio-Visual Event Perception with Dynamic Thresholds
Authors:
Eitan Shaar,
Ariel Shaulov,
Gal Chechik,
Lior Wolf
Abstract:
In the domain of audio-visual event perception, which focuses on the temporal localization and classification of events across distinct modalities (audio and visual), existing approaches are constrained by the vocabulary available in their training data. This limitation significantly impedes their capacity to generalize to novel, unseen event categories. Furthermore, the annotation process for thi…
▽ More
In the domain of audio-visual event perception, which focuses on the temporal localization and classification of events across distinct modalities (audio and visual), existing approaches are constrained by the vocabulary available in their training data. This limitation significantly impedes their capacity to generalize to novel, unseen event categories. Furthermore, the annotation process for this task is labor-intensive, requiring extensive manual labeling across modalities and temporal segments, limiting the scalability of current methods. Current state-of-the-art models ignore the shifts in event distributions over time, reducing their ability to adjust to changing video dynamics. Additionally, previous methods rely on late fusion to combine audio and visual information. While straightforward, this approach results in a significant loss of multimodal interactions. To address these challenges, we propose Audio-Visual Adaptive Video Analysis ($\text{AV}^2\text{A}$), a model-agnostic approach that requires no further training and integrates a score-level fusion technique to retain richer multimodal interactions. $\text{AV}^2\text{A}$ also includes a within-video label shift algorithm, leveraging input video data and predictions from prior frames to dynamically adjust event distributions for subsequent frames. Moreover, we present the first training-free, open-vocabulary baseline for audio-visual event perception, demonstrating that $\text{AV}^2\text{A}$ achieves substantial improvements over naive training-free baselines. We demonstrate the effectiveness of $\text{AV}^2\text{A}$ on both zero-shot and weakly-supervised state-of-the-art methods, achieving notable improvements in performance metrics over existing approaches.
△ Less
Submitted 21 March, 2025; v1 submitted 17 March, 2025;
originally announced March 2025.
-
Classifier-Guided Captioning Across Modalities
Authors:
Ariel Shaulov,
Tal Shaharabany,
Eitan Shaar,
Gal Chechik,
Lior Wolf
Abstract:
Most current captioning systems use language models trained on data from specific settings, such as image-based captioning via Amazon Mechanical Turk, limiting their ability to generalize to other modality distributions and contexts. This limitation hinders performance in tasks like audio or video captioning, where different semantic cues are needed. Addressing this challenge is crucial for creati…
▽ More
Most current captioning systems use language models trained on data from specific settings, such as image-based captioning via Amazon Mechanical Turk, limiting their ability to generalize to other modality distributions and contexts. This limitation hinders performance in tasks like audio or video captioning, where different semantic cues are needed. Addressing this challenge is crucial for creating more adaptable and versatile captioning frameworks applicable across diverse real-world contexts. In this work, we introduce a method to adapt captioning networks to the semantics of alternative settings, such as capturing audibility in audio captioning, where it is crucial to describe sounds and their sources. Our framework consists of two main components: (i) a frozen captioning system incorporating a language model (LM), and (ii) a text classifier that guides the captioning system. The classifier is trained on a dataset automatically generated by GPT-4, using tailored prompts specifically designed to enhance key aspects of the generated captions. Importantly, the framework operates solely during inference, eliminating the need for further training of the underlying captioning model. We evaluate the framework on various models and modalities, with a focus on audio captioning, and report promising results. Notably, when combined with an existing zero-shot audio captioning system, our framework improves its quality and sets state-of-the-art performance in zero-shot audio captioning.
△ Less
Submitted 3 January, 2025;
originally announced January 2025.
-
Zero-Shot Audio Captioning via Audibility Guidance
Authors:
Tal Shaharabany,
Ariel Shaulov,
Lior Wolf
Abstract:
The task of audio captioning is similar in essence to tasks such as image and video captioning. However, it has received much less attention. We propose three desiderata for captioning audio -- (i) fluency of the generated text, (ii) faithfulness of the generated text to the input audio, and the somewhat related (iii) audibility, which is the quality of being able to be perceived based only on aud…
▽ More
The task of audio captioning is similar in essence to tasks such as image and video captioning. However, it has received much less attention. We propose three desiderata for captioning audio -- (i) fluency of the generated text, (ii) faithfulness of the generated text to the input audio, and the somewhat related (iii) audibility, which is the quality of being able to be perceived based only on audio. Our method is a zero-shot method, i.e., we do not learn to perform captioning. Instead, captioning occurs as an inference process that involves three networks that correspond to the three desired qualities: (i) A Large Language Model, in our case, for reasons of convenience, GPT-2, (ii) A model that provides a matching score between an audio file and a text, for which we use a multimodal matching network called ImageBind, and (iii) A text classifier, trained using a dataset we collected automatically by instructing GPT-4 with prompts designed to direct the generation of both audible and inaudible sentences. We present our results on the AudioCap dataset, demonstrating that audibility guidance significantly enhances performance compared to the baseline, which lacks this objective.
△ Less
Submitted 7 September, 2023;
originally announced September 2023.
-
Flux-flow resistivity anisotropy in the instability regime in the a-b plane of epitaxial YBCO thin films
Authors:
B. Kalisky,
P. Aronov,
G. Koren,
A. Shaulov,
Y. Yeshurun,
R. P. Huebener
Abstract:
Measurements of the nonlinear flux-flow resistivity $ρ$ and the critical vortex velocity $\rm v^*_φ$ at high voltage bias close to the instability regime predicted by Larkin and Ovchinnikov \cite{LO} are reported along the node and antinode directions of the d-wave order parameter in the \textit{a-b} plane of epitaxial $YBa_2Cu_3O_{7-δ}$ films. In this pinning-free regime, $ρ$ and $\rm v^*_φ$ ar…
▽ More
Measurements of the nonlinear flux-flow resistivity $ρ$ and the critical vortex velocity $\rm v^*_φ$ at high voltage bias close to the instability regime predicted by Larkin and Ovchinnikov \cite{LO} are reported along the node and antinode directions of the d-wave order parameter in the \textit{a-b} plane of epitaxial $YBa_2Cu_3O_{7-δ}$ films. In this pinning-free regime, $ρ$ and $\rm v^*_φ$ are found to be anisotropic with values in the node direction larger on average by 10% than in the antinode direction. The anisotropy of $ρ$ is almost independent of temperature and field. We attribute the observed results to the anisotropic quasiparticle distribution on the Fermi surface of $YBa_2Cu_3O_{7-δ}$.
△ Less
Submitted 26 June, 2006;
originally announced June 2006.
-
Dynamics of transient disordered vortex states in BSCCO
Authors:
B. Kalisky,
Y. Bruckental,
A. Shaulov,
Y. Yeshurun
Abstract:
The dynamics of transient disordered vortex states in BSCCO was magneto-optically traced in three experiments: (i) during continuous injection of transient vortex states while ramping up the external magnetic field, (ii) during annealing of injected transient states while keeping the external field constant, and (iii) during annealing of transient 'supercooled' disordered states while ramping do…
▽ More
The dynamics of transient disordered vortex states in BSCCO was magneto-optically traced in three experiments: (i) during continuous injection of transient vortex states while ramping up the external magnetic field, (ii) during annealing of injected transient states while keeping the external field constant, and (iii) during annealing of transient 'supercooled' disordered states while ramping down the external field. The results reveal front-like propagation (experiment i) or retreat (experiments ii and iii) of the transient vortex states, at a rate governed by the rate of change of the external field, the annealing time tau of the transient states and the creep rate. The experimental results are theoretically analyzed in terms of competition between generation and annealing of transient disordered vortex states. Extraction of the annealing time tau from the above three experiments, yields the same results for tau as a function of the induction, B, and temperature T. Knowledge of tau(B,T) allows for correct determination of the thermodynamic order-disorder vortex phase transition line.
△ Less
Submitted 3 November, 2003;
originally announced November 2003.
-
Unified order-disorder vortex phase transition in high-Tc superconductors
Authors:
Y. Radzyner,
A. Shaulov,
Y. Yeshurun
Abstract:
The diversity of vortex melting and solid-solid transition lines measured in different high-T$_{c}$ superconductors is explained, postulating a unified order-disorder phase transition driven by both thermally- and disorder-induced fluctuations. The temperature dependence of the transition line and the nature of the disordered phase (solid, liquid, or pinned liquid) are determined by the relative…
▽ More
The diversity of vortex melting and solid-solid transition lines measured in different high-T$_{c}$ superconductors is explained, postulating a unified order-disorder phase transition driven by both thermally- and disorder-induced fluctuations. The temperature dependence of the transition line and the nature of the disordered phase (solid, liquid, or pinned liquid) are determined by the relative contributions of these fluctuations and by the pinning mechanism. By varying the pinning mechanism and the pinning strength one obtains a spectrum of monotonic and non-monotonic transition lines similar to those measured in Bi$_{2}$Sr$_{2}$CaCu$_{2}$O$%_{8}$, YBa$_{2}$Cu$_{3}$O$_{7-δ}$, Nd$_{1.85}$Ce$_{0.15}$CuO$%_{4-δ}$, Bi$_{1.6}$Pb$_{0.4}$Sr$_{2}$CaCu$_{2}$O$_{8+δ}$ and (La$% _{0.937}$Sr$_{0.063}$)$_{2}$CuO$_{4}$
△ Less
Submitted 3 January, 2002;
originally announced January 2002.
-
Disorder and thermally driven vortex-lattice melting in La{2-x}Sr{x}CuO{4} crystals
Authors:
Y. Radzyner,
A. Shaulov,
Y. Yeshurun,
I. Felner,
K. Kishio,
J. Shimoyama
Abstract:
Magnetization measurements in La{2-x}Sr{x}CuO{4} crystals indicate vortex order-disorder transition manifested by a sharp kink in the second magnetization peak. The transition field exhibits unique temperature dependence, namely a strong decrease with temperature in the entire measured range. This behavior rules out the conventional interpretation of a disorder-driven transition into an entangle…
▽ More
Magnetization measurements in La{2-x}Sr{x}CuO{4} crystals indicate vortex order-disorder transition manifested by a sharp kink in the second magnetization peak. The transition field exhibits unique temperature dependence, namely a strong decrease with temperature in the entire measured range. This behavior rules out the conventional interpretation of a disorder-driven transition into an entangled vortex solid phase. It is shown that the transition in La{2-x}Sr{x}CuO{4} is driven by both thermally- and disorder-induced fluctuations, resulting in a pinned liquid state. We conclude that vortex solid-liquid, solid-solid and solid to pinned-liquid transitions are different manifestations of the same thermodynamic order-disorder transition, distinguished by the relative contributions of thermal and disorder-induced fluctuations.
△ Less
Submitted 23 December, 2001;
originally announced December 2001.
-
Possibility of Kauzmann points in the vortex matter phase diagram of single crystal YBa$_2$Cu$_3$O$_{7-δ}$
Authors:
S. B. Roy,
Y. Radzyner,
D. Giller,
Y. Wolfus,
A. Shaulov,
P. Chaddah,
Y. Yeshurun
Abstract:
We highlight interesting thermomagnetic history effects across the transition line between the (quasi) ordered and disordered vortex states in single crystal YBa$_2$Cu$_3$O$_{7-δ}$, and argue that these features are indicative of the first order nature of the transition line. We suggest that the destruction of the ordered vortex state in YBa$_2$Cu$_3$O$_{7-δ}$ leading to vortex liquid (at high t…
▽ More
We highlight interesting thermomagnetic history effects across the transition line between the (quasi) ordered and disordered vortex states in single crystal YBa$_2$Cu$_3$O$_{7-δ}$, and argue that these features are indicative of the first order nature of the transition line. We suggest that the destruction of the ordered vortex state in YBa$_2$Cu$_3$O$_{7-δ}$ leading to vortex liquid (at high temperatures and low fields) and amorphous vortex solid (at low temperatures and high fields), takes place along a unified first-order transition line. The nonmonotonic behavior of this first order transition line gives rise to the possibility of more than one Kauzmann point where the entropies of the ordered and disordered vortex states are equal. In the high temperature region, one may order the vortex lattice by warming it, giving rise to an inverse melting effect.
△ Less
Submitted 5 July, 2001;
originally announced July 2001.
-
Crystallization of the ordered vortex phase in high temperature superconductors
Authors:
D. Giller,
B. Ya. Shapiro,
I. Shapiro,
A. Shaulov,
Y. Yeshurun
Abstract:
The Landau-Khalatnikov time-dependent equation is applied to describe the crystallization process of the ordered vortex lattice in high temperature superconductors after a sudden application of a magnetic field. Dynamic coexistence of a stable ordered phase and an unstable disordered phase, with a sharp interface between them, is demonstrated. The transformation to the equilibrium ordered state…
▽ More
The Landau-Khalatnikov time-dependent equation is applied to describe the crystallization process of the ordered vortex lattice in high temperature superconductors after a sudden application of a magnetic field. Dynamic coexistence of a stable ordered phase and an unstable disordered phase, with a sharp interface between them, is demonstrated. The transformation to the equilibrium ordered state proceeds by movement of this interface from the sample center toward its edge. The theoretical analysis dictates specific conditions for the creation of a propagating interface, and provides the time scale for this process.
△ Less
Submitted 19 April, 2001;
originally announced April 2001.
-
Fluctuations in $YBa_{2}Cu_{3}O_{6.5}$ single crystal: an evidence for 2D->3D crossover
Authors:
B. Rosenstein,
B. Ya. Shapiro,
R. Prozorov,
A. Shaulov,
Y. Yeshurun
Abstract:
Magnetization measurements as a function of temperature are reported for $YBa_{2}Cu_{3}O_{6.5}$ crystal (T_{c}=45.2 K) for fields between 0.2 to $3.5\ Tesla$. All isochamps for H>1 Tesla intersect at $T_{2D}^{\star}\simeq 42.8\ K$, implying fluctuations contribution to the magnetization. These curves collapse into a single curve when magnetization and temperature are scaled according to the pred…
▽ More
Magnetization measurements as a function of temperature are reported for $YBa_{2}Cu_{3}O_{6.5}$ crystal (T_{c}=45.2 K) for fields between 0.2 to $3.5\ Tesla$. All isochamps for H>1 Tesla intersect at $T_{2D}^{\star}\simeq 42.8\ K$, implying fluctuations contribution to the magnetization. These curves collapse into a single curve when magnetization and temperature are scaled according to the predicted ''2D scaling'' in the fluctuation regime. Surprisingly, the low field curves also intersect, at $T_{3D}^{\star}\simeq 43.4 K$, and they obey a 3D scaling. We provide a theoretical picture of the magnetization in the fluctuation regime based on the Lawrence-Doniach model. Within this model we calculate the field and temperature dependence of the magnetization. The two intersection points and the $2D\to 3D$ crossover are consistent with the experimental observation.
△ Less
Submitted 8 December, 2000;
originally announced December 2000.
-
Current density inhomogeneity throughout the thickness of superconducting films and its effect on their irreversible magnetic properties
Authors:
R. Prozorov,
E. B. Sonin,
E. Sheriff,
A. Shaulov,
Y. Yeshurun
Abstract:
We calculate the distribution of the current density $j$ in superconducting films along the direction of an external field applied perpendicular to the film plane. Our analysis reveals that in the presence of bulk pinning $j$ is inhomogeneous on a length scale of order the inter vortex distance. This inhomogeneity is significantly enhanced in the presence of surface pinning. We introduce new cri…
▽ More
We calculate the distribution of the current density $j$ in superconducting films along the direction of an external field applied perpendicular to the film plane. Our analysis reveals that in the presence of bulk pinning $j$ is inhomogeneous on a length scale of order the inter vortex distance. This inhomogeneity is significantly enhanced in the presence of surface pinning. We introduce new critical state model, which takes into account the current density variations throughout the film thickness, and show how these variations give rise to the experimentally observed thickness dependence of $% j$ and magnetic relaxation rate.
△ Less
Submitted 25 February, 1998;
originally announced February 1998.
-
On the origin of the irreversibility line in thin YBaCuO7 films with and without columnar defects
Authors:
R. Prozorov,
M. Konczykowski,
B. Schmidt,
Y. Yeshurun,
A. Shaulov,
C. Villard,
G. Koren
Abstract:
We report on measurements of the angular dependence of the irreversibility temperature $T_{irr}(θ) $ in $YBa_2Cu_3O_{7-δ}$ thin films, defined by the onset of a third harmonic signal and measured by a miniature Hall probe. From the functional form of $T_{irr}(θ)$ we conclude that the origin of the irreversibility line in unirradiated films is a dynamic crossover from an unpinned to a pinned vort…
▽ More
We report on measurements of the angular dependence of the irreversibility temperature $T_{irr}(θ) $ in $YBa_2Cu_3O_{7-δ}$ thin films, defined by the onset of a third harmonic signal and measured by a miniature Hall probe. From the functional form of $T_{irr}(θ)$ we conclude that the origin of the irreversibility line in unirradiated films is a dynamic crossover from an unpinned to a pinned vortex liquid. In irradiated films the irreversibility temperature is determined by the trapping angle.
△ Less
Submitted 26 August, 1996;
originally announced August 1996.
-
Plastic vortex-creep in YBa$_2$Cu$_3$O$_{7-x}$ crystals
Authors:
Y. Abulafia,
A. Shaulov,
Y. Wolfus,
R. Prozorov,
L. Burlachkov,
Y. Yeshurun,
D. Majer E. Zeldov,
H. Wühl,
V. B. Geshkenbein,
V. M. Vinokur
Abstract:
Local magnetic relaxation measurements in YBa$_2$Cu$_3$O$_{7-x}$ crystals show evidence for plastic vortex-creep associated with the motion of dislocations in the vortex lattice. This creep mechanism governs the vortex dynamics in a wide range of temperatures and fields below the melting line and above the field corresponding to the peak in the ''fishtail'' magnetization. In this range the activ…
▽ More
Local magnetic relaxation measurements in YBa$_2$Cu$_3$O$_{7-x}$ crystals show evidence for plastic vortex-creep associated with the motion of dislocations in the vortex lattice. This creep mechanism governs the vortex dynamics in a wide range of temperatures and fields below the melting line and above the field corresponding to the peak in the ''fishtail'' magnetization. In this range the activation energy $U_{pl}$, which decreases with field, drops below the elastic (collective) creep activation energy, $U_{el}$, which increases with field. A crossover in flux dynamics from elastic to plastic creep is shown to be the origin of the fishtail in YBa$_2$Cu$_3$O$_{7-x}$.
△ Less
Submitted 22 June, 1996;
originally announced June 1996.
-
Irreversible magnetization in thin YBCO films rotated in external magnetic field
Authors:
R. Prozorov,
A. Poddar,
E. Sheriff,
A. Shaulov,
Y. Yeshurun
Abstract:
The magnetization M of a thin YBaCuO film is measured as a function of the angle $θ$ between the applied field H and the c-axis. For fields above the first critical field, but below the Bean's field for first penetration H*, M is symmetric with respect to $θ=π$ and the magnetization curves for forward and backward rotation coincide. For H>H* the curves are asymmetric and they do not coincide. Th…
▽ More
The magnetization M of a thin YBaCuO film is measured as a function of the angle $θ$ between the applied field H and the c-axis. For fields above the first critical field, but below the Bean's field for first penetration H*, M is symmetric with respect to $θ=π$ and the magnetization curves for forward and backward rotation coincide. For H>H* the curves are asymmetric and they do not coincide. These phenomena have a simple explanation in the framework of the Bean critical state model.
△ Less
Submitted 2 May, 1996;
originally announced May 1996.