GitHub

Simple linear attention language models balance the recall-throughput tradeoff.

Based is an efficient architecture inspired by recovering attention-like capabilities (i.e., recall). We do so by combining 2 simple ideas: Short sliding window attention (e.g., window size 64), to ...
Opinion
American Enterprise InstituteOpinion

Red Light, Green Light: How Governing Boards Differ at the Foundation for Individual Rights and Expression’s Lowest- and Highest-Ranked Campuses for Free Speech

Shrinking governing boards, diversifying beyond alumni and business executives, and mandating free speech vetting in leadership hires could reverse the chill on free speech and equip trustees to ...
IEEE

Refining Time-Space Traffic Diagrams: A Simple Multiple Linear Regression Model

Abstract: A time-space (TS) traffic diagram, which presents traffic states in time-space cells with color, is an important traffic analysis and visualization tool. Despite its importance for ...
GitHub

Language-Based Multimodal Trajectory Prediction

Traditional vs. Our language-based trajectory prediction, LMTraj. We provide scripts to evaluate our LMTraj-ZERO model for all datasets simultaneously. Two scripts ...
IEEE

Regression Model Employing Spiking Neural Network for Bio-Signal Analysis With Hardware Integration

Abstract: Spiking neural networks, known for mimicking the brain’s functionality resulting in efficient algorithms, are gaining attention across various problems and applications. However, their ...