This repository contains code and tooling for the Abacus.AI LLM Context Expansion project. Also included are evaluation scripts and benchmark tasks that evaluate a model’s information retrieval capabi...
📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥
LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs
Implementation of paper Data Engineering for Scaling Language Models to 128K Context
USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
Exploring finetuning public checkpoints on filter 8K sequences on Pile
[ACL 2024] LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding
Long Context Transfer from Language to Vision
This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?
[EMNLP 2023] Adapting Language Models to Compress Long Contexts
My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other hierarchical methods)
Representing Long-Range Context for Graph Neural Networks with Global Attention
A really long long long long long long number in C++
翻译 - C ++中的一个很长很长很长很长很长的数字
LangChain 是一个用于构建基于LLM应用（大型语言模型）的Python库。
Show code context
Trace Context
#自然语言处理#中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)
Assistive Context-Aware Toolkit (ACAT)
Context sensitive notifications for Android
翻译 - Android的上下文相关通知
Package gorilla/context is a golang registry for global request variables.
Long Shadows for android!
Longformer: The Long-Document Transformer
翻译 - Longformer：长文档转换器