Roboflow Blog

17 Jul 2024 • 9 min read

Top 7 Open Source Object Tracking Tools [2026]

SUMMARY Object tracking in computer vision assigns persistent identities to detected objects across video frames, enabling applications like assembly line monitoring, warehouse inventory tracking, and pedestrian flow analysis. This post surveys seven open-source tracking algorithms, ByteTrack, Norfair, MMTracking, DeepSORT, FairMOT, BoT-SORT, and StrongSORT, covering how each handles association,

16 Jul 2024 • 8 min read

What is the Open Images Dataset? A Deep Dive.

SUMMARY Open Images V7, released by Google in 2022, contains over nine million annotated images spanning nearly 20,000 categories and supports six annotation types: image-level labels, bounding boxes, segmentation masks, visual relationships, localized narratives, and point-level labels. That breadth makes it one of the few public datasets

16 Jul 2024 • 5 min read

How to Augment Images for Image Classification

Learn how to generate augmented images for use in image classification datasets.

16 Jul 2024 • 6 min read

How to Augment Images for Object Detection

Learn how to generate augmented images for use in object detection datasets.

12 Jul 2024 • 4 min read

Document Understanding with Multimodal Models

Learn how to use the PaliGemma multimodal model to ask questions about the contents of a document.

12 Jul 2024 • 4 min read

Visual Question Answering with Multimodal Models

Learn how to use the PaliGemma multimodal model to ask questions about images.

12 Jul 2024 • 5 min read

Understand Website Screenshots with a Multimodal Vision Model

Learn how to use the Florence-2 multimodal model to generate rich descriptions of website screenshots.

12 Jul 2024 • 4 min read

How to Caption Images with a Multimodal Vision Model

Learn how to caption images using a multimodal vision model.

11 Jul 2024 • 11 min read

How to Train RT-DETR on a Custom Dataset with Transformers

SUMMARY RT-DETR (Real-Time DEtection TRansformer), developed by Peking University and Baidu, is a transformer-based object detection model that targets competitive speed and accuracy compared to YOLO-family models. This tutorial covers fine-tuning RT-DETR on a custom dataset sourced from Roboflow Universe, using the HuggingFace Transformers

10 Jul 2024 • 12 min read

Build Computer Vision Applications with Roboflow and Gradio

Learn how to build computer vision applications with Roboflow and Gradio.

10 Jul 2024 • 16 min read

What is Thresholding in Image Processing? A Guide.

Learn what image thresholding is and the thresholding strategies you can use in computer vision applications.

10 Jul 2024 • 7 min read

The Guide to AI OCR

Learn what AI OCR is and how it is used in computer vision.

10 Jul 2024 • 5 min read

How to Use Florence-2 for Optical Character Recognition

Learn how to use the Florence-2 model for Optical Character Recognition tasks.

10 Jul 2024 • 5 min read

What Is Dense Image Captioning?

Learn what dense image captioning is and how to use the MIT-licensed Florence-2 model to generate dense image captions.

10 Jul 2024 • 5 min read

What Is FPS? A Computer Vision Guide

Learn what FPS is and what FPS considerations you should keep in mind when working on computer vision projects.

9 Jul 2024 • 7 min read

What is 4M? Apple's Massively Multimodal Masked Modeling

SUMMARY Apple's 4M (Massively Multimodal Masked Modeling) framework trains a single unified Transformer encoder-decoder across text, images, 3D geometry, and semantic data by mapping all modalities to discrete tokens and applying a masked modeling objective on a random subset of them. Unlike specialized vision models constrained to

9 Jul 2024 • 5 min read

How to use Florence-2 for Instance Segmentation

SUMMARY Florence-2 is a lightweight MIT-licensed multimodal model from Microsoft that supports instance segmentation through text prompts, without requiring task-specific fine-tuning for many common use cases. This tutorial walks through loading Florence-2 in a Colab notebook, writing a segmentation function using the REFERRING_EXPRESSION_SEGMENTATION

5 Jul 2024 • 5 min read

How to Use GPT-4 To Extract Handwritten Text from Images

SUMMARY This tutorial builds a pipeline that combines a custom object detection model trained in Roboflow with GPT-4 Vision inside a Roboflow Workflow to extract and structure handwritten information from homework booklets. The object detection model localizes handwritten marks, and GPT-4 Vision reads time and name fields, with

28 Jun 2024 • 4 min read

Computer Vision Solutions for Steel Manufacturing with Roboflow

Learn how computer vision can be used in steel manufacturing facilities.

28 Jun 2024 • 19 min read

How to Monitor Productivity with Eye Tracking

SUMMARY This tutorial builds a real-time productivity tracker that uses a custom object detection model to monitor eye position, pupil movement, face presence, and phone usage via webcam, then logs distraction events over time. The model is trained in Roboflow on roughly 125 labeled images and deployed locally, where

28 Jun 2024 • 3 min read

Launch: Roboflow Project Folders

Learn how to use Roboflow's Project Folders to organize projects in your account workspaces.

27 Jun 2024 • 4 min read

How to Set Up a Basler Camera on a Jetson

Learn how to set up a Basler camera on an NVIDIA Jetson for use in running computer vision models.

27 Jun 2024 • 8 min read

What is F1 Score? A Computer Vision Guide.

Learn what F1 score is, for what it is used, and how to calculate F1 score.

25 Jun 2024 • 12 min read

How to Fine-tune Florence-2 for Object Detection Tasks

This tutorial will show you how to fine-tune Florence-2 on object detection datasets to improve model performance for your specific use case.