Skip to main content

Showing 1–30 of 30 results for author: Na, C

.
  1. arXiv:2504.17674  [pdf, other

    cs.CL cs.LG

    Energy Considerations of Large Language Model Inference and Efficiency Optimizations

    Authors: Jared Fernandez, Clara Na, Vashisth Tiwari, Yonatan Bisk, Sasha Luccioni, Emma Strubell

    Abstract: As large language models (LLMs) scale in size and adoption, their computational and environmental costs continue to rise. Prior benchmarking efforts have primarily focused on latency reduction in idealized settings, often overlooking the diverse real-world inference workloads that shape energy use. In this work, we systematically analyze the energy implications of common inference efficiency optim… ▽ More

    Submitted 24 April, 2025; originally announced April 2025.

    Comments: 16 pages

  2. arXiv:2504.13551  [pdf, other

    cs.CR cs.AI cs.CL

    Q-FAKER: Query-free Hard Black-box Attack via Controlled Generation

    Authors: CheolWon Na, YunSeok Choi, Jee-Hyong Lee

    Abstract: Many adversarial attack approaches are proposed to verify the vulnerability of language models. However, they require numerous queries and the information on the target model. Even black-box attack methods also require the target model's output information. They are not applicable in real-world scenarios, as in hard black-box settings where the target model is closed and inaccessible. Even the rec… ▽ More

    Submitted 18 April, 2025; originally announced April 2025.

    Comments: NAACL 2025 Findings

  3. arXiv:2503.05804  [pdf, other

    cs.CY cs.AI cs.LG

    Holistically Evaluating the Environmental Impact of Creating Language Models

    Authors: Jacob Morrison, Clara Na, Jared Fernandez, Tim Dettmers, Emma Strubell, Jesse Dodge

    Abstract: As the performance of artificial intelligence systems has dramatically increased, so too has the environmental impact of creating these systems. While many model developers release estimates of the power consumption and carbon emissions from the final training runs for their latest models, there is comparatively little transparency into the impact of model development, hardware manufacturing, and… ▽ More

    Submitted 3 March, 2025; originally announced March 2025.

    Comments: ICLR 2025 (spotlight)

  4. Scalable Data Ablation Approximations for Language Models through Modular Training and Merging

    Authors: Clara Na, Ian Magnusson, Ananya Harsh Jha, Tom Sherborne, Emma Strubell, Jesse Dodge, Pradeep Dasigi

    Abstract: Training data compositions for Large Language Models (LLMs) can significantly affect their downstream performance. However, a thorough data ablation study exploring large sets of candidate data mixtures is typically prohibitively expensive since the full effect is seen only after training the models; this can lead practitioners to settle for sub-optimal data mixtures. We propose an efficient metho… ▽ More

    Submitted 21 October, 2024; originally announced October 2024.

    Comments: EMNLP 2024. 17 pages

  5. Energy and Carbon Considerations of Fine-Tuning BERT

    Authors: Xiaorong Wang, Clara Na, Emma Strubell, Sorelle Friedler, Sasha Luccioni

    Abstract: Despite the popularity of the `pre-train then fine-tune' paradigm in the NLP community, existing work quantifying energy costs and associated carbon emissions has largely focused on language model pre-training. Although a single pre-training run draws substantially more energy than fine-tuning, fine-tuning is performed more frequently by many more individual actors, and thus must be accounted for… ▽ More

    Submitted 16 October, 2024; v1 submitted 16 November, 2023; originally announced November 2023.

    Comments: EMNLP 2023 Findings; First two authors contributed equally; 12 pages

  6. To Build Our Future, We Must Know Our Past: Contextualizing Paradigm Shifts in Natural Language Processing

    Authors: Sireesh Gururaja, Amanda Bertsch, Clara Na, David Gray Widder, Emma Strubell

    Abstract: NLP is in a period of disruptive change that is impacting our methodologies, funding sources, and public perception. In this work, we seek to understand how to shape our future by better understanding our past. We study factors that shape NLP as a field, including culture, incentives, and infrastructure by conducting long-form interviews with 26 NLP researchers of varying seniority, research area,… ▽ More

    Submitted 11 October, 2023; originally announced October 2023.

    Comments: Accepted to EMNLP 2023

  7. arXiv:2305.11474  [pdf, other

    cs.CV cs.AI

    Reciprocal Attention Mixing Transformer for Lightweight Image Restoration

    Authors: Haram Choi, Cheolwoong Na, Jihyeon Oh, Seungjae Lee, Jinseop Kim, Subeen Choe, Jeongmin Lee, Taehoon Kim, Jihoon Yang

    Abstract: Although many recent works have made advancements in the image restoration (IR) field, they often suffer from an excessive number of parameters. Another issue is that most Transformer-based IR methods focus only on either local or global features, leading to limited receptive fields or deficient parameter issues. To address these problems, we propose a lightweight IR network, Reciprocal Attention… ▽ More

    Submitted 18 April, 2024; v1 submitted 19 May, 2023; originally announced May 2023.

    Comments: CVPR 2024 Workshop - NTIRE. Codes are available at https://github.com/rami0205/RAMiT

  8. arXiv:2304.01805  [pdf, other

    cs.CV cs.AI

    Exploration of Lightweight Single Image Denoising with Transformers and Truly Fair Training

    Authors: Haram Choi, Cheolwoong Na, Jinseop Kim, Jihoon Yang

    Abstract: As multimedia content often contains noise from intrinsic defects of digital devices, image denoising is an important step for high-level vision recognition tasks. Although several studies have developed the denoising field employing advanced Transformers, these networks are too momory-intensive for real-world applications. Additionally, there is a lack of research on lightweight denosing (LWDN) w… ▽ More

    Submitted 4 April, 2023; originally announced April 2023.

    Comments: Technical report. Will be further revised. Codes are available at https://github.com/rami0205/LWDN

  9. arXiv:2302.06117  [pdf, other

    cs.LG

    The Framework Tax: Disparities Between Inference Efficiency in NLP Research and Deployment

    Authors: Jared Fernandez, Jacob Kahn, Clara Na, Yonatan Bisk, Emma Strubell

    Abstract: Increased focus on the computational efficiency of NLP systems has motivated the design of efficient model architectures and improvements to underlying hardware accelerators. However, the resulting increases in computational throughput and reductions in floating point operations have not directly translated to improvements in wall-clock inference latency. We demonstrate that these discrepancies ca… ▽ More

    Submitted 22 December, 2023; v1 submitted 13 February, 2023; originally announced February 2023.

    Comments: EMNLP 2023

  10. arXiv:2211.06315  [pdf, other

    cs.SI cs.AI

    Fraudulent User Detection Via Behavior Information Aggregation Network (BIAN) On Large-Scale Financial Social Network

    Authors: Hanyi Hu, Long Zhang, Shuan Li, Zhi Liu, Yao Yang, Chongning Na

    Abstract: Financial frauds cause billions of losses annually and yet it lacks efficient approaches in detecting frauds considering user profile and their behaviors simultaneously in social network . A social network forms a graph structure whilst Graph neural networks (GNN), a promising research domain in Deep Learning, can seamlessly process non-Euclidean graph data . In financial fraud detection, the modu… ▽ More

    Submitted 26 March, 2023; v1 submitted 4 November, 2022; originally announced November 2022.

    Comments: 6 pages, 1 figure

  11. Train Flat, Then Compress: Sharpness-Aware Minimization Learns More Compressible Models

    Authors: Clara Na, Sanket Vaibhav Mehta, Emma Strubell

    Abstract: Model compression by way of parameter pruning, quantization, or distillation has recently gained popularity as an approach for reducing the computational requirements of modern deep neural network models for NLP. Inspired by prior works suggesting a connection between simpler, more generalizable models and those that lie within wider loss basins, we hypothesize that optimizing for flat minima shou… ▽ More

    Submitted 24 October, 2022; v1 submitted 25 May, 2022; originally announced May 2022.

    Comments: EMNLP 2022 Findings, 28 pages

  12. Revisiting the role of heterophily in graph representation learning: An edge classification perspective

    Authors: Jincheng Huang, Ping Li, Rui Huang, Chen Na, Acong Zhang

    Abstract: Graph representation learning aim at integrating node contents with graph structure to learn nodes/graph representations. Nevertheless, it is found that many existing graph learning methods do not work well on data with high heterophily level that accounts for a large proportion of edges between different class labels. Recent efforts to this problem focus on improving the message passing mechanism… ▽ More

    Submitted 5 August, 2022; v1 submitted 23 May, 2022; originally announced May 2022.

  13. arXiv:2010.09648  [pdf

    cs.MA cs.CV eess.IV physics.soc-ph

    Agent-based Simulation Model and Deep Learning Techniques to Evaluate and Predict Transportation Trends around COVID-19

    Authors: Ding Wang, Fan Zuo, Jingqin Gao, Yueshuai He, Zilin Bian, Suzana Duran Bernardes, Chaekuk Na, Jingxing Wang, John Petinos, Kaan Ozbay, Joseph Y. J. Chow, Shri Iyer, Hani Nassif, Xuegang Jeff Ban

    Abstract: The COVID-19 pandemic has affected travel behaviors and transportation system operations, and cities are grappling with what policies can be effective for a phased reopening shaped by social distancing. This edition of the white paper updates travel trends and highlights an agent-based simulation model's results to predict the impact of proposed phased reopening strategies. It also introduces a re… ▽ More

    Submitted 23 September, 2020; originally announced October 2020.

  14. arXiv:2009.14019  [pdf

    physics.soc-ph

    NYC Recovery at a Glance: The Rise of Buses and Micromobility

    Authors: Suzana Duran Bernardes, Zilin Bian, Siva Sooryaa Muruga Thambiran, Jingqin Gao, Chaekuk Na, Fan Zuo, Nick Hudanich, Abhinav Bhattacharyya, Kaan Ozbay, Shri Iyer, Joseph Y. J. Chow, Hani Nassif

    Abstract: New York City (NYC) is entering Phase 4 of the state's reopening plan, starting July 20, 2020. This white paper updates travel trends observed during the first three reopening phases and highlights the spatial distributions in terms of bus speeds and Citi Bike trips, and further investigates the role of micro-mobility in the pandemic response.

    Submitted 23 September, 2020; originally announced September 2020.

  15. arXiv:2009.14018  [pdf

    physics.soc-ph cs.SI

    Toward the "New Normal": A Surge in Speeding, New Volume Patterns, and Recent Trends in Taxis/For-Hire Vehicles

    Authors: Jingqin Gao, Abhinav Bhattacharyya, Ding Wang, Nick Hudanich, Siva Sooryaa, Muruga Thambiran, Suzana Duran Bernardes, Chaekuk Na, Fan Zuo, Zilin Bian, Kaan Ozbay, Shri Iyer, Hani Nassif, Joseph Y. J. Chow

    Abstract: Six months into the pandemic and one month after the phase four reopening in New York City (NYC), restrictions are lifting, businesses and schools are reopening, but global infections are still rising. This white paper updates travel trends observed in the aftermath of the COVID-19 outbreak in NYC and highlight some findings toward the "new normal."

    Submitted 23 September, 2020; originally announced September 2020.

  16. The effects of individual metal contents on isochrones for C, N, O, Na, Mg, Al, Si, and Fe

    Authors: Minje Beom, Chongsam Na, Jason W. Ferguson, Y. -C. Kim

    Abstract: The individual characteristics of C, N, O, Na, Mg, Al, Si, and Fe on isochrones have been investigated in this study. Stellar models have been constructed for various mixtures in which the content of each element is changed up to the extreme value reported in recent studies, and the changes in isochrone shape have been analyzed for the various mixtures. To express the abundance variation of differ… ▽ More

    Submitted 17 August, 2016; originally announced August 2016.

    Comments: published in ApJ (Aug 1. 2016) / accepted for publication in ApJ (May 25. 2016) / 11 pages, 9 figures, 5 tables / ads address: http://adsabs.harvard.edu/abs/2016ApJ...826..155B

    Journal ref: 2016ApJ...826..155B

  17. arXiv:1606.03897  [pdf, ps, other

    cs.DS

    FM-index of Alignment with Gaps

    Authors: Joong Chae Na, Hyunjoon Kim, Seunghwan Min, Heejin Park, Thierry Lecroq, Martine Leonard, Laurent Mouchardd, Kunsoo Park

    Abstract: Recently, a compressed index for similar strings, called the FM-index of alignment (FMA), has been proposed with the functionalities of pattern search and random access. The FMA is quite efficient in space requirement and pattern search time, but it is applicable only for an alignment of similar strings without gaps. In this paper we propose the FM-index of alignment with gaps, a realistic index f… ▽ More

    Submitted 13 June, 2016; originally announced June 2016.

    Comments: 15pages

  18. Multiple Populations in Globular Clusters and the Origin of the Oosterhoff Period Groups

    Authors: Sohee Jang, Young-Wook Lee, Seok-Joo Joo, Chongsam Na

    Abstract: The presence of multiple populations is now well-established in most globular clusters in the Milky Way. In light of this progress, here we suggest a new model explaining the origin of the Sandage period-shift and the difference in mean period of type ab RR Lyrae variables between the two Oosterhoff groups. In our models, the instability strip in the metal-poor group II clusters, such as M15, is p… ▽ More

    Submitted 29 April, 2014; originally announced April 2014.

    Comments: 5 pages, 4 figures, accepted for publication in MNRAS Letters

  19. Two distinct red giant branch populations in the globular cluster NGC 2419 as tracers of a merger event in the Milky Way

    Authors: Young-Wook Lee, Sang-Il Han, Seok-Joo Joo, Sohee Jang, Chongsam Na, Sakurako Okamoto, Nobuo Arimoto, Dongwook Lim, Hak-Sub Kim, Suk-Jin Yoon

    Abstract: Recent spectroscopic observations of the outer halo globular cluster (GC) NGC 2419 show that it is unique among GCs, in terms of chemical abundance patterns, and some suggest that it was originated in the nucleus of a dwarf galaxy. Here we show, from the Subaru narrow-band photometry employing a calcium filter, that the red giant-branch (RGB) of this GC is split into two distinct subpopulations. C… ▽ More

    Submitted 16 October, 2013; originally announced October 2013.

    Comments: 4 pages, 4 figures, 1 table, accepted for the publication in ApJL

  20. arXiv:1309.4290  [pdf, other

    physics.flu-dyn physics.comp-ph

    Simple free-surface detection in two and three-dimensional SPH solver

    Authors: Agra Barecasco, Hanifa Terissa, Christian Fredy Naa

    Abstract: A simple free-surface particle detection method for two and three-dimensional SPH simulation has been implemented. The method uses sphere representation for the SPH particle. The fluid domain is covered by overlapping spheres. A sphere whose surface is not fully covered considered as boundary. To test particle boundary status, we used a sum of normalized relative position vectors from neighbouring… ▽ More

    Submitted 17 September, 2013; originally announced September 2013.

    Comments: 10 pages, 11 figures, Selected Paper from the International Symposium on Computational Science 2013

  21. arXiv:1309.4234  [pdf, other

    physics.flu-dyn

    Three-Dimensional Smoothed Particle Hydrodynamics Simulation for Liquid Metal Solidification Process

    Authors: Raden Ahnaf Faqih S, Christian Fredy Naa

    Abstract: The solidification behavior of liquid metal in a container under rapid cooling process is one of the major concerns to be analyzed. In order to analyze its fundamental behavior, a three- dimensional (3D) fluid dynamics simulation was developed using a particle-based method, known as the smoothed particle hydrodynamics (SPH) method. Governing equations that determine the fluid motion and heat trans… ▽ More

    Submitted 17 September, 2013; originally announced September 2013.

    Comments: 10 pages, 7 figures, Selected Paper from the International Symposium on Computational Science 2013

  22. arXiv:1309.4074  [pdf, other

    physics.flu-dyn

    Three-Dimensional Smoothed Particle Hydrodynamics Method for Simulating Free Surface Flows

    Authors: Rizal Dwi Prayogo, Christian Fredy Naa

    Abstract: In this paper, we applied an improved Smoothing Particle Hydrodynamics (SPH) method by using gradient kernel renormalization in three-dimensional cases. The purpose of gradient kernel renormalization is to improve the accuracy of numerical simulation by improving gradient kernel approximation. This method is implemented for simulating free surface flows, in particular dam break case with rigid bal… ▽ More

    Submitted 16 September, 2013; originally announced September 2013.

    Comments: 9 pages, 5 figures, Selected Paper from the International Symposium on Computational Science 2013

  23. arXiv:1309.3868  [pdf

    physics.flu-dyn

    Three-Dimensional Smoothed Particle Hydrodynamics Simulation for Liquid Droplet with Surface Tension

    Authors: Hanifa Terissa, Agra Barecasco, Christian Fredy Naa

    Abstract: We provide a basic method of Smoothed Particle Hydrodynamics (SPH) to simulate liquid droplet with surface tension in three dimensions. Liquid droplet is a simple case for surface tension modeling. Surface tension works only on fluid surface. In SPH method, we simply apply the surface tension on the boundary particles of liquid. The particle on the 3D boundary was detected dynamically using Free-S… ▽ More

    Submitted 16 September, 2013; originally announced September 2013.

    Comments: 9 pages, 4 figure, Selected Paper from the International Symposium on Computational Science 2013

  24. arXiv:1309.3632  [pdf, other

    physics.flu-dyn

    3D Simulation of Dam-break effect on a Solid Wall using Smoothed Particle Hydrodynamics

    Authors: Suprijadi, Ferry Faizal, Christian Naa, Anggy Trisnawan Putra

    Abstract: Dam is built for water supply, water flow or flooding control and electricity energy storage, but in other hand, dam is one of the most dangerous natural disaster in many countries including in Indonesia. The impact of dam break in neighbour area and is huge and many flooding in remote area, as happen in Dam Situ Gintung in Tangerang (close to Jakarta) in 2009. Smoothed Particle Hydrodynamics (SPH… ▽ More

    Submitted 14 September, 2013; originally announced September 2013.

    Comments: 7 pages, 7 figures, Selected Paper from the International Symposium on Computational Science 2013

  25. arXiv:1309.3524  [pdf, ps, other

    physics.flu-dyn

    Stochastic moving particle semi-implicit for inviscid fluid wave simulation

    Authors: Christian Fredy Naa, Seiro Omata, Masaki Kazama

    Abstract: The present paper introduces stochastic velocity as improvement for moving particle semi-implicit (MPS) method. This improvement is to overcome energy loss caused by numerical dissipation in the basic MPS that brings about rapid decay of waves. Stochastic velocity is added in the explicit step of the basic MPS method. MPS with stochastic improvement is compared with the basic method in the case of… ▽ More

    Submitted 13 September, 2013; originally announced September 2013.

    Comments: 19 pages, 11 figures, International Symposium on Computational Science 2011

    Journal ref: Selected Paper for Gakuto International Series Mathematical Science and Application Volume 34, 2011

  26. arXiv:1309.3504  [pdf

    physics.flu-dyn

    Simulation of Temperature Distribution In a Rectangular Cavity using Finite Element Method

    Authors: Christian Naa, Suprijadi

    Abstract: This paper presents the study and implementation of finite element method to find the temperature distribution in a rectangular cavity which contains a fluid substance. The fluid motion is driven by a sudden temperature difference applied to two opposite side walls of the cavity. The remaining walls were considered adiabatic. Fluid properties were assumed incompressible. The problem has been appro… ▽ More

    Submitted 13 September, 2013; originally announced September 2013.

    Comments: 7 pages, 9 figures, Proceedings of the 3rd Asian Physics Symposium, July 22-23, 2009, Bandung, Indonesia

  27. arXiv:1309.1006  [pdf

    cond-mat.mtrl-sci cond-mat.mes-hall

    Novel Giant Magnetoresistance Model using Multiple Barrier Potential

    Authors: Christian Naa, Suprijadi, Sparisoma Viridi, Mitra Djamal

    Abstract: This paper proposes a new model for Giant Magnetoresistance (GMR) and calculates its typical graph qualitatively. The model foundation is the microscopic mechanism in GMR, where the GMR effect can be explained by intrinsic and extrinsic potential. The potentials are spin-dependent. The potentials determine the transmission probability then it will give conductance value. Here, the multiple barrier… ▽ More

    Submitted 6 September, 2013; v1 submitted 4 September, 2013; originally announced September 2013.

    Comments: 4 pages, 9 figures, Submitted to ARPN Journal of Engineering and Applied Sciences 2013

  28. arXiv:1305.1744  [pdf, ps, other

    cs.DS

    Suffix Tree of Alignment: An Efficient Index for Similar Data

    Authors: Joong Chae Na, Heejin Park, Maxime Crochemore, Jan Holub, Costas S. Iliopoulos, Laurent Mouchard, Kunsoo Park

    Abstract: We consider an index data structure for similar strings. The generalized suffix tree can be a solution for this. The generalized suffix tree of two strings $A$ and $B$ is a compacted trie representing all suffixes in $A$ and $B$. It has $|A|+|B|$ leaves and can be constructed in $O(|A|+|B|)$ time. However, if the two strings are similar, the generalized suffix tree is not efficient because it does… ▽ More

    Submitted 8 May, 2013; originally announced May 2013.

    Comments: 12 pages

  29. arXiv:quant-ph/0703219  [pdf

    quant-ph cond-mat.other

    Strongly Correlated Polaritons in a Two-Dimensional Array of Photonic Crystal Microcavities

    Authors: Y. C. Neil Na, Shoko Utsunomiya, Lin Tian, Yoshihisa Yamamoto

    Abstract: We propose a practical scheme to observe the polaritonic quantum phase transition (QPT) from the superfluid (SF) to Bose-glass (BG) to Mott-insulator (MI) states. The system consists of a two-dimensional array of photonic crystal microcavities doped with substitutional donor/acceptor impurities. Using realistic parameters, we show that such strongly correlated polaritonic systems can be construc… ▽ More

    Submitted 12 October, 2007; v1 submitted 23 March, 2007; originally announced March 2007.

    Comments: 14 pages, 5 figures

    Journal ref: Phys. Rev. A 77, 031803(R) (2008)

  30. arXiv:physics/0702216   

    physics.optics

    Strongly Correlated Photons in a Photonic Crystal

    Authors: Y. C. Neil Na, Shoko Utsunomiya, Yoshihisa Yamamoto

    Abstract: This paper is withdrawn.

    Submitted 4 April, 2007; v1 submitted 24 February, 2007; originally announced February 2007.

    Comments: This paper is withdrawn. Please see quant-ph/0703219 for the revision