Multimodal

20 Feb 2024 • 8 min read

Build Enterprise Datasets with CLIP for Multimodal Model Training Using Intel Gaudi2 HPUs

In this guide, learn how to use CLIP on Intel Gaudi2 HPUs to deduplicate datasets before training large multimodal vision models.

13 Feb 2024 • 6 min read

YOLO-World: Real-Time, Zero-Shot Object Detection

YOLO-World is a zero-shot, real-time object detection model.

8 Feb 2024 • 7 min read

First Impressions with Gemini Advanced

Read our first impressions using the Gemini Ultra multimodal model across a range of computer vision tasks.

5 Jan 2024 • 4 min read

Launch: GPT-4 Checkup

GPT-4 Checkup is a web utility that monitors the performance of GPT-4 with Vision over time. Learn how to use and contribute to GPT-4 Checkup

21 Dec 2023 • 5 min read

NeurIPS 2023 Papers Highlights

Introduction NeurIPS 2023, the conference and workshop on Neural Information Processing Systems, took place December 10th through 16th. The conference showcased the latest in machine learning and artificial intelligence. This year’s conference featured 3,584 papers that advance machine learning across many domains. NeurIPS announced the NeurIPS 2023 award-winning

20 Dec 2023 • 3 min read

How to Deploy CogVLM on AWS

Guide on deploying a CogVLM Inference Server with 4-bit quantization on Amazon Web Services, covering setup of EC2 instances, configuring hardware and software requirements, and starting the inference server with Docker.

20 Dec 2023 • 5 min read

CogVLM Use Cases in Industry

Learn how you can use CogVLM, a multimodal language model with vision capabilities, for industrial use cases.

14 Dec 2023 • 5 min read

How to Deploy CogVLM

In this guide, learn how to deploy the CogVLM multimodal model on your own infrastructure with Roboflow Inference.

13 Dec 2023 • 6 min read

First Impressions with Google’s Gemini

In this guide, we evaluate Google's Gemini LMM against several computer vision tasks, from OCR to VQA to zero-shot object detection.

12 Dec 2023 • 8 min read

What is Few-Shot Learning?

In this blog post, we discuss what few-shot learning is, architectural approaches for implementing few-shot learning, and specific implementations of few-shot learning techniques.

7 Dec 2023 • 11 min read

Google's Gemini Multimodal Model: What We Know

In this guide, we are going to discuss what Gemini is, for whom it is available, and what Gemini can do (according to the information available from Google). We will also look ahead to potential applications for Gemini in computer vision tasks.

29 Nov 2023 • 3 min read

Multimodal Maestro: Advanced LMM Prompting

Learn how to expand the range of LMMs' capabilities using Multimodal Maestro

28 Nov 2023 • 5 min read

Launch: Synthetic Image Generation with DALL-E and GPT-4 Vision

In this guide, learn how to use Roboflow to generate synthetic data with DALL-E and GPT-4 Vision for use in training vision models.

27 Nov 2023 • 5 min read

How to Load CLIP Image Embeddings into LanceDB

Learn how to calculate CLIP embeddings using Roboflow Inference and save them into LanceDB.

23 Nov 2023 • 7 min read

GPT-4 Vision Alternatives

Explore alternatives to GPT-4 Vision with Large Multimodal Models such as Qwen-VL and CogVLM, and fine-tuned detection models.

16 Nov 2023 • 5 min read

What is Retrieval Augmented Generation?

Learn what Retrieval Augmented Generation (RAG) is, how it works, and how RAG can be used in computer vision applications.

15 Nov 2023 • 4 min read

How to Use Roboflow with GPT-4 Vision

Explore ways you can use Roboflow with GPT-4 Vision to solve computer vision problems.

7 Nov 2023 • 4 min read

Distilling GPT-4 for Classification with an API

In this guide, learn how to distill GPT-4V to train an image classification model.

7 Nov 2023 • 4 min read

DINO-GPT4-V: Use GPT-4V in a Two-Stage Detection Model

In this guide, we introduce DINO-GPT4V, a model that uses Grounding DINO to detect general objects and GPT-4V to refine labels.

7 Nov 2023 • 5 min read

How CLIP and GPT-4V Compare for Classification

In this post, we analyze how CLIP and GPT-4V compare for classification.

7 Nov 2023 • 5 min read

Experiments with GPT-4V for Object Detection

See our experiments that explore GPT-4V's object detection capabilities.

16 Oct 2023 • 4 min read

GPT-4 Vision Prompt Injection

In this article, we explore what prompt injection is and the techniques people have been using to perform prompt injection attacks on GPT-4.

10 Oct 2023 • 6 min read

First Impressions with LLaVA-1.5

In this guide, we share our first impressions testing LLaVA-1.5.

27 Sep 2023 • 11 min read

GPT-4 with Vision: Complete Guide and Evaluation

In this guide, we share findings experimenting with GPT-4 with Vision, released by OpenAI in September 2023.