Syntax, Semantics, and Segfaults

Thoughts, stories and ideas.

Latest

Beyond Document Lists: Extending the Unified Query Algebra to Aggregations and Hierarchical Data

Abstract This essay extends the unified query algebra framework by incorporating two critical capabilities missing from the original formulation: general aggregation operations and hierarchical data structures. We demonstrate that while posting lists provide a powerful abstraction for many scenarios, they impose restrictions that prevent the framework from handling certain important

By J

A Rigorous Mathematical Framework for Unified Query Algebras Across Heterogeneous Data Paradigms

Abstract This research essay presents a formal algebraic framework that unifies operations across transaction processing, text retrieval, and vector search paradigms within a single mathematical structure. By establishing posting lists as a universal abstraction with well-defined algebraic properties, we develop a comprehensive theoretical foundation that preserves the expressivity of each

By J

Unified OLTP and Hybrid Search: Architectural Innovations for Next-Generation Database Systems

Introduction Modern applications increasingly demand database systems that seamlessly integrate traditional transaction processing with advanced search capabilities. This essay explores architectural innovations that enable efficient faceted search, hybrid vector-text querying with full boolean expressivity, and unified query optimization across heterogeneous paradigms. By examining both theoretical foundations and practical implementation strategies,

By J

Addressing the Conjunction Fallacy in Probabilistic Information Retrieval: From Theory to Practice

1. Introduction In our previous explorations of probabilistic frameworks for information retrieval, we examined how transformations like softmax and sigmoid convert raw similarity scores into probabilities, enabling principled fusion of heterogeneous retrieval systems. While these transformations provide elegant mathematical foundations for ranking, they introduce a critical challenge when handling conjunctive

By J

Beyond Mathematical Unity: From the XOR Problem to the Theoretical Limits of Backpropagation

Introduction Our previous exploration of "The Mathematical Unity of Sigmoid, Perceptron, Logistic Regression, and Softmax" established the foundational equivalences between these core machine learning concepts. We demonstrated how sigmoid-activated perceptrons are mathematically identical to logistic regression, and how softmax functions generalize sigmoid to multi-class scenarios. This mathematical unity

By J

Progressive and Adaptive Hyperparameter Estimation in BM25 Probability Transformation: A Unified Approach

1. Introduction The transformation of BM25 similarity scores into probability estimates represents a critical challenge in information retrieval systems. This process is essential for creating interpretable search results and enabling integration with probabilistic frameworks. While supervised learning approaches using query-document relevance pairs typically yield optimal results, practical implementations often face

By J