17 Jul 2024 • 6 min read Launch: Deploy Florence-2 with Roboflow Learn how to deploy a Florence-2 model with Roboflow.
17 Jul 2024 • 6 min read How to Augment Images for Keypoint Detection Learn how to augment images for use in keypoint detection datasets with Roboflow.
16 Jul 2024 • 8 min read What is the Open Images Dataset? A Deep Dive. SUMMARY Open Images V7, released by Google in 2022, contains over nine million annotated images spanning nearly 20,000 categories and supports six annotation types: image-level labels, bounding boxes, segmentation masks, visual relationships, localized narratives, and point-level labels. That breadth makes it one of the few public datasets
16 Jul 2024 • 5 min read How to Augment Images for Image Classification Learn how to generate augmented images for use in image classification datasets.
16 Jul 2024 • 6 min read How to Augment Images for Object Detection Learn how to generate augmented images for use in object detection datasets.
12 Jul 2024 • 4 min read Document Understanding with Multimodal Models Learn how to use the PaliGemma multimodal model to ask questions about the contents of a document.
12 Jul 2024 • 4 min read Visual Question Answering with Multimodal Models Learn how to use the PaliGemma multimodal model to ask questions about images.
12 Jul 2024 • 5 min read Understand Website Screenshots with a Multimodal Vision Model Learn how to use the Florence-2 multimodal model to generate rich descriptions of website screenshots.
12 Jul 2024 • 4 min read How to Caption Images with a Multimodal Vision Model Learn how to caption images using a multimodal vision model.
11 Jul 2024 • 11 min read How to Train RT-DETR on a Custom Dataset with Transformers SUMMARY RT-DETR (Real-Time DEtection TRansformer), developed by Peking University and Baidu, is a transformer-based object detection model that targets competitive speed and accuracy compared to YOLO-family models. This tutorial covers fine-tuning RT-DETR on a custom dataset sourced from Roboflow Universe, using the HuggingFace Transformers
10 Jul 2024 • 12 min read Build Computer Vision Applications with Roboflow and Gradio Learn how to build computer vision applications with Roboflow and Gradio.
10 Jul 2024 • 16 min read What is Thresholding in Image Processing? A Guide. Learn what image thresholding is and the thresholding strategies you can use in computer vision applications.
10 Jul 2024 • 7 min read The Guide to AI OCR Learn what AI OCR is and how it is used in computer vision.
10 Jul 2024 • 5 min read How to Use Florence-2 for Optical Character Recognition Learn how to use the Florence-2 model for Optical Character Recognition tasks.
10 Jul 2024 • 5 min read What Is Dense Image Captioning? Learn what dense image captioning is and how to use the MIT-licensed Florence-2 model to generate dense image captions.
10 Jul 2024 • 5 min read What Is FPS? A Computer Vision Guide Learn what FPS is and what FPS considerations you should keep in mind when working on computer vision projects.
9 Jul 2024 • 7 min read What is 4M? Apple's Massively Multimodal Masked Modeling SUMMARY Apple's 4M (Massively Multimodal Masked Modeling) framework trains a single unified Transformer encoder-decoder across text, images, 3D geometry, and semantic data by mapping all modalities to discrete tokens and applying a masked modeling objective on a random subset of them. Unlike specialized vision models constrained to
9 Jul 2024 • 5 min read How to use Florence-2 for Instance Segmentation SUMMARY Florence-2 is a lightweight MIT-licensed multimodal model from Microsoft that supports instance segmentation through text prompts, without requiring task-specific fine-tuning for many common use cases. This tutorial walks through loading Florence-2 in a Colab notebook, writing a segmentation function using the REFERRING_EXPRESSION_SEGMENTATION
5 Jul 2024 • 5 min read How to Use GPT-4 To Extract Handwritten Text from Images SUMMARY This tutorial builds a pipeline that combines a custom object detection model trained in Roboflow with GPT-4 Vision inside a Roboflow Workflow to extract and structure handwritten information from homework booklets. The object detection model localizes handwritten marks, and GPT-4 Vision reads time and name fields, with
28 Jun 2024 • 4 min read Computer Vision Solutions for Steel Manufacturing with Roboflow Learn how computer vision can be used in steel manufacturing facilities.
28 Jun 2024 • 19 min read How to Monitor Productivity with Eye Tracking SUMMARY This tutorial builds a real-time productivity tracker that uses a custom object detection model to monitor eye position, pupil movement, face presence, and phone usage via webcam, then logs distraction events over time. The model is trained in Roboflow on roughly 125 labeled images and deployed locally, where
28 Jun 2024 • 3 min read Launch: Roboflow Project Folders Learn how to use Roboflow's Project Folders to organize projects in your account workspaces.
27 Jun 2024 • 4 min read How to Set Up a Basler Camera on a Jetson Learn how to set up a Basler camera on an NVIDIA Jetson for use in running computer vision models.
27 Jun 2024 • 8 min read What is F1 Score? A Computer Vision Guide. Learn what F1 score is, for what it is used, and how to calculate F1 score.