-
EgoCHARM: Resource-Efficient Hierarchical Activity Recognition using an Egocentric IMU Sensor
Authors:
Akhil Padmanabha,
Saravanan Govindarajan,
Hwanmun Kim,
Sergio Ortiz,
Rahul Rajan,
Doruk Senkal,
Sneha Kadetotad
Abstract:
Human activity recognition (HAR) on smartglasses has various use cases, including health/fitness tracking and input for context-aware AI assistants. However, current approaches for egocentric activity recognition suffer from low performance or are resource-intensive. In this work, we introduce a resource (memory, compute, power, sample) efficient machine learning algorithm, EgoCHARM, for recognizi…
▽ More
Human activity recognition (HAR) on smartglasses has various use cases, including health/fitness tracking and input for context-aware AI assistants. However, current approaches for egocentric activity recognition suffer from low performance or are resource-intensive. In this work, we introduce a resource (memory, compute, power, sample) efficient machine learning algorithm, EgoCHARM, for recognizing both high level and low level activities using a single egocentric (head-mounted) Inertial Measurement Unit (IMU). Our hierarchical algorithm employs a semi-supervised learning strategy, requiring primarily high level activity labels for training, to learn generalizable low level motion embeddings that can be effectively utilized for low level activity recognition. We evaluate our method on 9 high level and 3 low level activities achieving 0.826 and 0.855 F1 scores on high level and low level activity recognition respectively, with just 63k high level and 22k low level model parameters, allowing the low level encoder to be deployed directly on current IMU chips with compute. Lastly, we present results and insights from a sensitivity analysis and highlight the opportunities and limitations of activity recognition using egocentric IMUs.
△ Less
Submitted 24 April, 2025;
originally announced April 2025.
-
CoVE: Towards Confidential Computing on RISC-V Platforms
Authors:
Ravi Sahita,
Atish Patra,
Vedvyas Shanbhogue,
Samuel Ortiz,
Andrew Bresticker,
Dylan Reid,
Atul Khare,
Rajnesh Kanwal
Abstract:
Multi-tenant computing platforms are typically comprised of several software and hardware components including platform firmware, host operating system kernel, virtualization monitor, and the actual tenant payloads that run on them (typically in a virtual machine, container, or application). This model is well established in large scale commercial deployment, but the downside is that all platform…
▽ More
Multi-tenant computing platforms are typically comprised of several software and hardware components including platform firmware, host operating system kernel, virtualization monitor, and the actual tenant payloads that run on them (typically in a virtual machine, container, or application). This model is well established in large scale commercial deployment, but the downside is that all platform components and operators are in the Trusted Computing Base (TCB) of the tenant. This aspect is ill-suited for privacy-oriented workloads that aim to minimize the TCB footprint. Confidential computing presents a good stepping-stone towards providing a quantifiable TCB for computing. Confidential computing [1] requires the use of a HW-attested Trusted Execution Environments for data-in-use protection. The RISC-V architecture presents a strong foundation for meeting the requirements for Confidential Computing and other security paradigms in a clean slate manner. This paper describes a reference architecture and discusses ISA, non-ISA and system-on-chip (SoC) requirements for confidential computing on RISC-V Platforms. It discusses proposed ISA and non-ISA Extension for Confidential Virtual Machine for RISC-V platforms, referred to as CoVE.
△ Less
Submitted 12 April, 2023;
originally announced April 2023.
-
Considerations for Eye Tracking Experiments in Information Retrieval
Authors:
Michael Segundo Ortiz
Abstract:
In this survey I discuss ophthalmic neurophysiology and the experimental considerations that must be made to reduce possible noise in an eye-tracking data stream. I also review the history, experiments, technological benefits and limitations of eye-tracking within the information retrieval field. The concepts of aware and adaptive user interfaces are also explored that humbly make an attempt to sy…
▽ More
In this survey I discuss ophthalmic neurophysiology and the experimental considerations that must be made to reduce possible noise in an eye-tracking data stream. I also review the history, experiments, technological benefits and limitations of eye-tracking within the information retrieval field. The concepts of aware and adaptive user interfaces are also explored that humbly make an attempt to synthesize work from the fields of industrial engineering and psychophysiology with information retrieval.
△ Less
Submitted 24 July, 2020;
originally announced July 2020.
-
Toward Exploratory Search in Biomedicine: Evaluating Document Clusters by MeSH as a Semantic Anchor
Authors:
Michael Segundo Ortiz,
Kazuhiro Seki,
Javed Mostafa
Abstract:
The current mode of biomedical literature search is severely limited in effectively finding information relevant to specialists. A potential approach to solving this problem is exploratory search, which allows users to interactively navigate through a vast document collection. As the first step toward exploratory search for specialists in biomedicine, this paper develops a methodology to evaluate…
▽ More
The current mode of biomedical literature search is severely limited in effectively finding information relevant to specialists. A potential approach to solving this problem is exploratory search, which allows users to interactively navigate through a vast document collection. As the first step toward exploratory search for specialists in biomedicine, this paper develops a methodology to evaluate quality of document clusters. For this purpose, we incorporate human expertise into data set creation and evaluation framework by leveraging MeSH terms as semantic anchors. In addition, we investigate the benefit of full-text data for improving cluster quality.
△ Less
Submitted 5 December, 2018;
originally announced December 2018.
-
Measures of Cluster Informativeness for Medical Evidence Aggregation and Dissemination
Authors:
Michael Segundo Ortiz,
Sam Bubnovich,
Mengqian Wang,
Kazuhiro Seki Ph. D.,
Javed Mostafa Ph. D
Abstract:
The largest collection of medical evidence in the world is PubMed. However, the significant barrier in accessing and extracting information is information organization. A factor that contributes towards this barrier is managing medical controlled vocabularies that allow us to systematically and consistently organize, index, and search biomedical literature. Additionally, from users' perspective, t…
▽ More
The largest collection of medical evidence in the world is PubMed. However, the significant barrier in accessing and extracting information is information organization. A factor that contributes towards this barrier is managing medical controlled vocabularies that allow us to systematically and consistently organize, index, and search biomedical literature. Additionally, from users' perspective, to ultimately improve access, visualization is likely to play a powerful role. There is a strong link between information organization and information visualization, as many powerful visualizations depend on clustering methods. To improve visualization, therefore, one has to develop concrete and scalable measures for vocabularies used in indexing and their impact on document clustering. The focus of this study is on the development and evaluation of clustering methods. The paper concludes with demonstration of downstream network visualizations and their impact on discovering potentially valuable and latent genetic and molecular associations.
△ Less
Submitted 5 September, 2018;
originally announced September 2018.
-
Quasi-Linear Soft Tissue Models Revisited
Authors:
J. S. Espinoza Ortiz,
Gilson A. Giraldi,
E. A. de Souza Neto,
Raul A. Feijóo
Abstract:
Incompressibility, nonlinear deformation under stress and viscoelasticity are the fingerprint of soft tissue mechanical behavior. In order to model soft tissues appropriately, we must pursue to complete these requirements. In this work we revisited different soft tissue quasi-linear model possibilities in trying to achieve for this commitment.
Incompressibility, nonlinear deformation under stress and viscoelasticity are the fingerprint of soft tissue mechanical behavior. In order to model soft tissues appropriately, we must pursue to complete these requirements. In this work we revisited different soft tissue quasi-linear model possibilities in trying to achieve for this commitment.
△ Less
Submitted 6 February, 2006;
originally announced February 2006.
