Pocket-Sized Multimodal AI for content understanding and generation across multilingual texts, images, and 🔜 video, up to 5x faster than OpenAI CLIP and LLaVA 🖼️ & 🖋️

Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)

Using Segment-Anything and CLIP to generate pixel-aligned semantic features.

[Official] [IROS 2024] A goal-oriented planning to lift VLN performance for Closed-Loop Navigation: Simple, Yet Effective

Clipora is a powerful toolkit for fine-tuning OpenCLIP models using Low Rank Adapters (LoRA).

A simple open-sourced SigLIP model finetuned on Genshin Impact's image-text pairs.

Text-to-image search with OpenCLIP, Docker, Flask, Faiss, etc. and a basic front-end.

use SAM and OpenCLIP to perform zero-shot object detection using COCO 2017 val split.

CLIP based Zero Shot Instance Segmentation

VALORA AI is a Multimodal Pricing Prediction Model that uses textual and visual data to make precise predictions on product prices

This work represents my Master's Degree Thesis in Applied Computer Science (Machine Learning and Big Data)

[GENERIC] API for practical large models

Mori_Cloud is a web platform that allows users to store, manage, and share memorable moments through images and text. Powered by artificial intelligence for smart image search, Mori_Cloud delivers a personalized, secure, and modern user experience.

Group images by provided labels using OpenAI/CLIP

A quick test using Supabase to test if pgvector is the right solution for a different project. The embedding model I will be using OpenAI's Clip Model which will allow me to embed images and text in the same vector space.

Android Studio plugin for AI-driven drawable search

Using Docker compose to start up Triton with the OpenClip model, to encode text in to vectors

A CLIP model training recipe for classifying aquatic invertebrates.

🌍 Explore global health trends through data science with clustering models and statistical validation from the 2021 Global Burden of Disease Study.

Searching Images: From Clip And Beyond