multimodal · GitHub Topics | GitHub 中文社区

serve

@jina-ai

#计算机科学# Jina 是一个基于深度学习的搜索框架，支持各种类型如图片，视频，长文本，PDF等。

neural-search cloud-native deep-learning machine-learning framework grpc kubernetes multimodal mlops pipeline

Python21.13 k

10 天前

LLaVA

@haotian-liu

#大语言模型# LLaVA是一个具有 GPT-4V 级别功能的大语言和视觉模型助手

gpt-4 chatbot chatgpt llama multimodal llava foundation-models instruction-tuning multi-modality visual-language-learning

Python20.36 k

3 个月前

NeMo

NVIDIA Corporation@NVIDIA

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

翻译 - NeMo：用于对话式AI的工具包

machine-translation speaker-recognition asr tts generative-ai multimodal deeplearning neural-networks speaker-diariazation speech-translation

Python12.18 k

13 小时前

screenpipe

@mediar-ai

#大语言模型# 全天候24小时 AI 屏幕和麦克风录制。构建具有完整上下文的 AI 应用。与 Ollama 配合使用。Rewind.ai 的替代品。开放。安全。您拥有自己的数据。Rust 开发。

ai computer-vision llm machine-learning ml multimodal vision

Rust9.64 k

1 小时前

rerun

@rerun-io

Visualize streams of multimodal data. Free, fast, easy to use, and simple to integrate. Built in Rust.

visualization computer-vision python robotics rust multimodal cpp

Rust6.66 k

1 小时前

mmf

@facebookresearch • Meta

#计算机科学# A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)

翻译 - 来自Facebook AI Research（FAIR）的视觉和语言多模式研究的模块化框架

pytorch vqa pretrained-models multimodal deep-learning captioning dialog textvqa hateful-memes multi-tasking

Python5.51 k

7 天前

courses

@SkalskiP

#自然语言处理# This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)

computer-vision deep-learning deep-neural-networks machine-learning mlops multimodal transformers tutorial natural-language-processing nlp

Python5.42 k

7 个月前

ai-notes

swyx.io@swyxio

notes for software engineers getting up to speed on new AI developments. Serves as datastore for https://latent.space writing, and product brainstorming, but has cleaned up canonical references under ...

ai prompt-engineering stable-diffusion openai gpt gpt-3 multimodal

HTML5.16 k

22 天前

tree-of-thoughts

@kyegomez

#大语言模型# Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%

artificial-intelligence chatgpt gpt4 multimodal prompt-engineering deep-learning prompt prompt-learning prompt-tuning

Python4.36 k

24 天前

ms-swift

@modelscope

#大语言模型# Use PEFT or Full-parameter to finetune 400+ LLMs or 100+ MLLMs. (LLM: Qwen2.5, Llama3.2, GLM4, Internlm2.5, Yi1.5, Mistral, Baichuan2, DeepSeek, Gemma2, ...; MLLM: Qwen2-VL, Qwen2-Audio, Llama3.2-Vis...

agent llm lora llama pre-training sft deploy multimodal dpo llava

Python4.33 k

10 小时前

agents

@livekit

Build real-time multimodal AI applications 🤖🎙️📹

ai real-time voice voice-assistant video multimodal agents

Python4.04 k

1 天前

Fengshenbang-LM

@IDEA-CCNL

Fengshenbang-LM(封神榜大模型)是IDEA研究院认知计算与自然语言研究中心主导的大模型开源体系，成为中文AIGC和认知智能的基础设施。

chinese-nlp pretrained-models pytorch distributed-training transformers aigc multimodal

Python4.02 k

3 个月前🇨🇳

discoart

@jina-ai

🪩 Create Disco Diffusion artworks in one line

creative-ai disco-diffusion cross-modal dalle generative-art multimodal diffusion prompts midjourney imgen

Python3.84 k

2 年前

img2dataset

@rom1504

#计算机科学# Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.

deep-learning dataset big-data image multimodal image-dataset download-images

Python3.73 k

3 个月前

NExT-GPT

@NExT-GPT

#大语言模型# Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model

chatgpt foundation-models gpt-4 instruction-tuning large-language-models llm multi-modal-chatgpt multimodal visual-language-learning

Python3.31 k

20 天前

InternGPT

@OpenGVLab

#大语言模型# InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, ...

chatgpt foundation-model gpt gpt-4 gradio husky image-captioning langchain llm multimodal

Python3.21 k

3 个月前