-
Codetations: Intelligent, Persistent Notes and UIs for Programs and Other Documents
Authors:
Edward Misback,
Erik Vank,
Zachary Tatlock,
Steven Tanimoto
Abstract:
Software developers maintain extensive mental models of code they produce and its context, often relying on memory to retrieve or reconstruct design decisions, edge cases, and debugging experiences. These missing links and data obstruct both developers and, more recently, large language models (LLMs) working with unfamiliar code. We present Codetations, a system that helps developers contextualize…
▽ More
Software developers maintain extensive mental models of code they produce and its context, often relying on memory to retrieve or reconstruct design decisions, edge cases, and debugging experiences. These missing links and data obstruct both developers and, more recently, large language models (LLMs) working with unfamiliar code. We present Codetations, a system that helps developers contextualize documents with rich notes and tools. Unlike previous approaches, notes in Codetations stay outside the document to prevent code clutter, attaching to spans in the document using a hybrid edit-tracking/LLM-based method. Their content is dynamic, interactive, and synchronized with code changes. A worked example shows that relevant notes with interactively-collected data improve LLM performance during code repair. In our user evaluation, developers praised these properties and saw significant potential in annotation types that we generated with an LLM in just a few minutes.
△ Less
Submitted 25 April, 2025;
originally announced April 2025.
-
Magic Markup: Maintaining Document-External Markup with an LLM
Authors:
Edward Misback,
Zachary Tatlock,
Steven L. Tanimoto
Abstract:
Text documents, including programs, typically have human-readable semantic structure. Historically, programmatic access to these semantics has required explicit in-document tagging. Especially in systems where the text has an execution semantics, this means it is an opt-in feature that is hard to support properly. Today, language models offer a new method: metadata can be bound to entities in chan…
▽ More
Text documents, including programs, typically have human-readable semantic structure. Historically, programmatic access to these semantics has required explicit in-document tagging. Especially in systems where the text has an execution semantics, this means it is an opt-in feature that is hard to support properly. Today, language models offer a new method: metadata can be bound to entities in changing text using a model's human-like understanding of semantics, with no requirements on the document structure. This method expands the applications of document annotation, a fundamental operation in program writing, debugging, maintenance, and presentation. We contribute a system that employs an intelligent agent to re-tag modified programs, enabling rich annotations to automatically follow code as it evolves. We also contribute a formal problem definition, an empirical synthetic benchmark suite, and our benchmark generator. Our system achieves an accuracy of 90% on our benchmarks and can replace a document's tags in parallel at a rate of 5 seconds per tag. While there remains significant room for improvement, we find performance reliable enough to justify further exploration of applications.
△ Less
Submitted 6 March, 2024;
originally announced March 2024.
-
Designing Participatory AI: Creative Professionals' Worries and Expectations about Generative AI
Authors:
Nanna Inie,
Jeanette Falk,
Steven Tanimoto
Abstract:
Generative AI, i.e., the group of technologies that automatically generate visual or written content based on text prompts, has undergone a leap in complexity and become widely available within just a few years. Such technologies potentially introduce a massive disruption to creative fields. This paper presents the results of a qualitative survey ($N$ = 23) investigating how creative professionals…
▽ More
Generative AI, i.e., the group of technologies that automatically generate visual or written content based on text prompts, has undergone a leap in complexity and become widely available within just a few years. Such technologies potentially introduce a massive disruption to creative fields. This paper presents the results of a qualitative survey ($N$ = 23) investigating how creative professionals think about generative AI. The results show that the advancement of these AI models prompts important reflections on what defines creativity and how creatives imagine using AI to support their workflows. Based on these reflections, we discuss how we might design \textit{participatory AI} in the domain of creative expertise with the goal of empowering creative professionals in their present and future coexistence with AI.
△ Less
Submitted 15 March, 2023;
originally announced March 2023.
-
Natural growth model of weighted complex networks
Authors:
Shinji Tanimoto
Abstract:
We propose a natural model of evolving weighted networks in which new links are not necessarily connected to new nodes. The model allows a newly added link to connect directly two nodes already present in the network. This is plausible in modeling many real-world networks. Such a link is called an inner link, while a link connected to a new node is called an outer link. In view of interrelations b…
▽ More
We propose a natural model of evolving weighted networks in which new links are not necessarily connected to new nodes. The model allows a newly added link to connect directly two nodes already present in the network. This is plausible in modeling many real-world networks. Such a link is called an inner link, while a link connected to a new node is called an outer link. In view of interrelations between inner and outer links, we investigate power-laws for the strength, degree and weight distributions of weighted complex networks. This model enables us to predict some features of weighted networks such as the worldwide airport network and the scientific collaboration network.
△ Less
Submitted 16 August, 2011;
originally announced August 2011.
-
Epidemic spreading with immunization rate on complex networks
Authors:
Shinji Tanimoto
Abstract:
We investigate the spread of diseases, computer viruses or information on complex networks and also immunization strategies to prevent or control the spread. When an entire population cannot be immunized and the effect of immunization is not perfect, we need the targeted immunization with immunization rate. Under such a circumstance we calculate epidemic thresholds for the SIR and SIS epidemic mod…
▽ More
We investigate the spread of diseases, computer viruses or information on complex networks and also immunization strategies to prevent or control the spread. When an entire population cannot be immunized and the effect of immunization is not perfect, we need the targeted immunization with immunization rate. Under such a circumstance we calculate epidemic thresholds for the SIR and SIS epidemic models. It is shown that, in scale-free networks, the targeted immunization is effective only if the immunization rate is equal to one. We analyze here epidemic spreading on directed complex networks, but similar results are also valid for undirected ones.
△ Less
Submitted 12 April, 2011;
originally announced April 2011.
-
Epidemic thresholds in directed complex networks
Authors:
Shinji Tanimoto
Abstract:
The spread of a disease, a computer virus or information is discussed in a directed complex network. We are concerned with a steady state of the spread for the SIR and SIS dynamic models. In a scale-free directed network it is shown that the threshold of its outbreak in both models approaches zero under a high correlation between nodal indegrees and outdegrees.
The spread of a disease, a computer virus or information is discussed in a directed complex network. We are concerned with a steady state of the spread for the SIR and SIS dynamic models. In a scale-free directed network it is shown that the threshold of its outbreak in both models approaches zero under a high correlation between nodal indegrees and outdegrees.
△ Less
Submitted 8 March, 2011;
originally announced March 2011.
