GitHub

haoyitedaniu/flash-attention-dao-tri

We've been very happy to see FlashAttention being widely adopted in such a short time after its release. This page contains a partial list of places where FlashAttention is being used. FlashAttention ...
Seeking Alpha

FUNC First United Corporation

First United Corporation operates as the bank holding company for First United Bank & Trust that provides various retail and commercial banking services to businesses and individuals in the United ...
IEEE

Efficient Precision-Adjustable Architecture for Softmax Function in Deep Learning

Abstract: The softmax function has been widely used in deep neural networks (DNNs), and studies on efficient hardware accelerators for DNN have also attracted tremendous attention. However, it is very ...
IEEE

Dual Balanced Class-Incremental Learning With im-Softmax and Angular Rectification

Abstract: Owing to the superior performances, exemplar-based methods with knowledge distillation (KD) are widely applied in class incremental learning (CIL). However, it suffers from two drawbacks: 1) ...
GitHub

Simple Softmax-free Attention for Vision Transformer (SimA)

@misc{https://doi.org/10.48550/arxiv.2206.08898, doi = {10.48550/ARXIV.2206.08898}, url = {https://arxiv.org/abs/2206.08898}, author = {Koohpayegani, Soroush Abbasi ...