Senior Computer Vision

alirezarezvani/claude-skills/engineering-team/skills/senior-computer-vision

作者 alirezarezvani19392f7a0826無授權條款27K 個星標收錄於 2026年10月8日更新於 2026年10月8日儲存庫5 週前更新

Computer vision engineering skill for object detection, image segmentation, and visual AI systems. Covers CNN and Vision Transformer architectures, YOLO/Faster R-CNN/DETR detection, Mask R-CNN/SAM segmentation, and production deployment with ONNX/TensorRT. Includes PyTorch, torchvision, Ultralytics, Detectron2, and MMDetection frameworks. Use when building detection pipelines, training custom models, optimizing inference, or deploying vision systems.

包含腳本Software DevelopmentData & Analytics
AI 產生的概覽

指導電腦視覺工程：偵測與分割模型選型、訓練設定、資料集準備以及推論最佳化。

功能
提供面向生產環境的指引，涵蓋物件偵測、實例與語意分割、分類、視訊分析與三維視覺。內容包含三套工作流程：建立偵測管線、最佳化並部署已訓練模型、準備自訂資料集。隨附三個 Python 指令碼，用於產生訓練設定、分析模型的量化與剪枝機會，以及建置資料集管線（格式轉換、清理、增強與切分）。
適用情境
適用於建立偵測或分割管線、在 CNN 與視覺 Transformer 架構之間做選擇、訓練自訂模型，或為 ONNX、TensorRT、OpenVINO、CoreML 部署匯出與量化模型時。
執行需求
需要 Python 及 PyTorch 等相關框架（torchvision、Ultralytics、Detectron2、MMDetection、segment-anything、OpenCV、albumentations），實際取決於所選路徑；匯出與量化可選用 ONNX、TensorRT、OpenVINO 或 CoreML 工具。隨附三個可執行指令碼。未說明需要憑證或網路存取。

Senior Computer Vision Engineer

Production computer vision engineering skill for object detection, image segmentation, and visual AI system deployment.

Table of Contents

Quick Start

bash
# Generate training configuration for YOLO or Faster R-CNNpython scripts/vision_model_trainer.py models/ --task detection --arch yolov8
# Analyze model for optimization opportunities (quantization, pruning)python scripts/inference_optimizer.py model.pt --target onnx --benchmark
# Build dataset pipeline with augmentationspython scripts/dataset_pipeline_builder.py images/ --format coco --augment

Core Expertise

This skill provides guidance on:

  • Object Detection: YOLO family (v5-v11), Faster R-CNN, DETR, RT-DETR
  • Instance Segmentation: Mask R-CNN, YOLACT, SOLOv2
  • Semantic Segmentation: DeepLabV3+, SegFormer, SAM (Segment Anything)
  • Image Classification: ResNet, EfficientNet, Vision Transformers (ViT, DeiT)
  • Video Analysis: Object tracking (ByteTrack, SORT), action recognition
  • 3D Vision: Depth estimation, point cloud processing, NeRF
  • Production Deployment: ONNX, TensorRT, OpenVINO, CoreML

Tech Stack

CategoryTechnologies
FrameworksPyTorch, torchvision, timm
DetectionUltralytics (YOLO), Detectron2, MMDetection
Segmentationsegment-anything, mmsegmentation
OptimizationONNX, TensorRT, OpenVINO, torch.compile
Image ProcessingOpenCV, Pillow, albumentations
AnnotationCVAT, Label Studio, Roboflow
Experiment TrackingMLflow, Weights & Biases
ServingTriton Inference Server, TorchServe

Workflow 1: Object Detection Pipeline

Use this workflow when building an object detection system from scratch.

Step 1: Define Detection Requirements

Analyze the detection task requirements:

Detection Requirements Analysis:- Target objects: [list specific classes to detect]- Real-time requirement: [yes/no, target FPS]- Accuracy priority: [speed vs accuracy trade-off]- Deployment target: [cloud GPU, edge device, mobile]- Dataset size: [number of images, annotations per class]

Step 2: Select Detection Architecture

Choose architecture based on requirements:

RequirementRecommended ArchitectureWhy
Real-time (>30 FPS)YOLOv8/v11, RT-DETRSingle-stage, optimized for speed
High accuracyFaster R-CNN, DINOTwo-stage, better localization
Small objectsYOLO + SAHI, Faster R-CNN + FPNMulti-scale detection
Edge deploymentYOLOv8n, MobileNetV3-SSDLightweight architectures
Transformer-basedDETR, DINO, RT-DETREnd-to-end, no NMS required

Step 3: Prepare Dataset

Convert annotations to required format:

bash
# COCO format (recommended)python scripts/dataset_pipeline_builder.py data/images/ \    --annotations data/labels/ \    --format coco \    --split 0.8 0.1 0.1 \    --output data/coco/
# Verify datasetpython -c "from pycocotools.coco import COCO; coco = COCO('data/coco/train.json'); print(f'Images: {len(coco.imgs)}, Categories: {len(coco.cats)}')"

Step 4: Configure Training

Generate training configuration:

bash
# For Ultralytics YOLOpython scripts/vision_model_trainer.py data/coco/ \    --task detection \    --arch yolov8m \    --epochs 100 \    --batch 16 \    --imgsz 640 \    --output configs/
# For Detectron2python scripts/vision_model_trainer.py data/coco/ \    --task detection \    --arch faster_rcnn_R_50_FPN \    --framework detectron2 \    --output configs/

Step 5: Train and Validate

bash
# Ultralytics trainingyolo detect train data=data.yaml model=yolov8m.pt epochs=100 imgsz=640
# Detectron2 trainingpython train_net.py --config-file configs/faster_rcnn.yaml --num-gpus 1
# Validate on test setyolo detect val model=runs/detect/train/weights/best.pt data=data.yaml

Step 6: Evaluate Results

Key metrics to analyze:

MetricTargetDescription
mAP@50>0.7Mean Average Precision at IoU 0.5
mAP@50:95>0.5COCO primary metric
Precision>0.8Low false positives
Recall>0.8Low missed detections
Inference time<33msFor 30 FPS real-time

Workflow 2: Model Optimization and Deployment

Use this workflow when preparing a trained model for production deployment.

Step 1: Benchmark Baseline Performance

bash
# Measure current model performancepython scripts/inference_optimizer.py model.pt \    --benchmark \    --input-size 640 640 \    --batch-sizes 1 4 8 16 \    --warmup 10 \    --iterations 100

Expected output:

Baseline Performance (PyTorch FP32):- Batch 1: 45.2ms (22.1 FPS)- Batch 4: 89.4ms (44.7 FPS)- Batch 8: 165.3ms (48.4 FPS)- Memory: 2.1 GB- Parameters: 25.9M

Step 2: Select Optimization Strategy

Deployment TargetOptimization Path
NVIDIA GPU (cloud)PyTorch → ONNX → TensorRT FP16
NVIDIA GPU (edge)PyTorch → TensorRT INT8
Intel CPUPyTorch → ONNX → OpenVINO
Apple SiliconPyTorch → CoreML
Generic CPUPyTorch → ONNX Runtime
MobilePyTorch → TFLite or ONNX Mobile

Step 3: Export to ONNX

bash
# Export with dynamic batch sizepython scripts/inference_optimizer.py model.pt \    --export onnx \    --input-size 640 640 \    --dynamic-batch \    --simplify \    --output model.onnx
# Verify ONNX modelpython -c "import onnx; model = onnx.load('model.onnx'); onnx.checker.check_model(model); print('ONNX model valid')"

Step 4: Apply Quantization (Optional)

For INT8 quantization with calibration:

bash
# Generate calibration datasetpython scripts/inference_optimizer.py model.onnx \    --quantize int8 \    --calibration-data data/calibration/ \    --calibration-samples 500 \    --output model_int8.onnx

Quantization impact analysis:

PrecisionSizeSpeedAccuracy Drop
FP32100%1x0%
FP1650%1.5-2x<0.5%
INT825%2-4x1-3%

Step 5: Convert to Target Runtime

bash
# TensorRT (NVIDIA GPU)trtexec --onnx=model.onnx --saveEngine=model.engine --fp16
# OpenVINO (Intel)mo --input_model model.onnx --output_dir openvino/
# CoreML (Apple)python -c "import coremltools as ct; model = ct.convert('model.onnx'); model.save('model.mlpackage')"

Step 6: Benchmark Optimized Model

bash
python scripts/inference_optimizer.py model.engine \    --benchmark \    --runtime tensorrt \    --compare model.pt

Expected speedup:

Optimization Results:- Original (PyTorch FP32): 45.2ms- Optimized (TensorRT FP16): 12.8ms- Speedup: 3.5x- Accuracy change: -0.3% mAP

Workflow 3: Custom Dataset Preparation

Use this workflow when preparing a computer vision dataset for training.

Step 1: Audit Raw Data

bash
# Analyze image datasetpython scripts/dataset_pipeline_builder.py data/raw/ \    --analyze \    --output analysis/

Analysis report includes:

Dataset Analysis:- Total images: 5,234- Image sizes: 640x480 to 4096x3072 (variable)- Formats: JPEG (4,891), PNG (343)- Corrupted: 12 files- Duplicates: 45 pairs
Annotation Analysis:- Format detected: Pascal VOC XML- Total annotations: 28,456- Classes: 5 (car, person, bicycle, dog, cat)- Distribution: car (12,340), person (8,234), bicycle (3,456), dog (2,890), cat (1,536)- Empty images: 234

Step 2: Clean and Validate

bash
# Remove corrupted and duplicate imagespython scripts/dataset_pipeline_builder.py data/raw/ \    --clean \    --remove-corrupted \    --remove-duplicates \    --output data/cleaned/

Step 3: Convert Annotation Format

bash
# Convert VOC to COCO formatpython scripts/dataset_pipeline_builder.py data/cleaned/ \    --annotations data/annotations/ \    --input-format voc \    --output-format coco \    --output data/coco/

Supported format conversions:

FromTo
Pascal VOC XMLCOCO JSON
YOLO TXTCOCO JSON
COCO JSONYOLO TXT
LabelMe JSONCOCO JSON
CVAT XMLCOCO JSON

Step 4: Apply Augmentations

bash
# Generate augmentation configpython scripts/dataset_pipeline_builder.py data/coco/ \    --augment \    --aug-config configs/augmentation.yaml \    --output data/augmented/

Recommended augmentations for detection:

yaml
# configs/augmentation.yamlaugmentations:  geometric:    - horizontal_flip: { p: 0.5 }    - vertical_flip: { p: 0.1 }  # Only if orientation invariant    - rotate: { limit: 15, p: 0.3 }    - scale: { scale_limit: 0.2, p: 0.5 }
  color:    - brightness_contrast: { brightness_limit: 0.2, contrast_limit: 0.2, p: 0.5 }    - hue_saturation: { hue_shift_limit: 20, sat_shift_limit: 30, p: 0.3 }    - blur: { blur_limit: 3, p: 0.1 }
  advanced:    - mosaic: { p: 0.5 }  # YOLO-style mosaic    - mixup: { p: 0.1 }   # Image mixing    - cutout: { num_holes: 8, max_h_size: 32, max_w_size: 32, p: 0.3 }

Step 5: Create Train/Val/Test Splits

bash
python scripts/dataset_pipeline_builder.py data/augmented/ \    --split 0.8 0.1 0.1 \    --stratify \    --seed 42 \    --output data/final/

Split strategy guidelines:

Dataset SizeTrainValTest
<1,000 images70%15%15%
1,000-10,00080%10%10%
>10,00090%5%5%

Step 6: Generate Dataset Configuration

bash
# For Ultralytics YOLOpython scripts/dataset_pipeline_builder.py data/final/ \    --generate-config yolo \    --output data.yaml
# For Detectron2python scripts/dataset_pipeline_builder.py data/final/ \    --generate-config detectron2 \    --output detectron2_config.py

Architecture Selection Guide

Object Detection Architectures

ArchitectureSpeedAccuracyBest For
YOLOv8n1.2ms37.3 mAPEdge, mobile, real-time
YOLOv8s2.1ms44.9 mAPBalanced speed/accuracy
YOLOv8m4.2ms50.2 mAPGeneral purpose
YOLOv8l6.8ms52.9 mAPHigh accuracy
YOLOv8x10.1ms53.9 mAPMaximum accuracy
RT-DETR-L5.3ms53.0 mAPTransformer, no NMS
Faster R-CNN R5046ms40.2 mAPTwo-stage, high quality
DINO-4scale85ms49.0 mAPSOTA transformer

Segmentation Architectures

ArchitectureTypeSpeedBest For
YOLOv8-segInstance4.5msReal-time instance seg
Mask R-CNNInstance67msHigh-quality masks
SAMPromptable50msZero-shot segmentation
DeepLabV3+Semantic25msScene parsing
SegFormerSemantic15msEfficient semantic seg

CNN vs Vision Transformer Trade-offs

AspectCNN (YOLO, R-CNN)ViT (DETR, DINO)
Training data needed1K-10K images10K-100K+ images
Training timeFastSlow (needs more epochs)
Inference speedFasterSlower
Small objectsGood with FPNNeeds multi-scale
Global contextLimitedExcellent
Positional encodingImplicitExplicit

Reference Documentation

→ See references/reference-docs-and-commands.md for details

Performance Targets

MetricReal-timeHigh AccuracyEdge
FPS>30>10>15
mAP@50>0.6>0.8>0.5
Latency P99<50ms<150ms<100ms
GPU Memory<4GB<8GB<2GB
Model Size<50MB<200MB<20MB

Resources

  • Architecture Guide: references/computer_vision_architectures.md
  • Optimization Guide: references/object_detection_optimization.md
  • Deployment Guide: references/production_vision_systems.md
  • Scripts: scripts/ directory for automation tools

來源與署名

來源：alirezarezvani/claude-skills位於engineering-team/skills/senior-computer-vision提交19392f7

授權條款： 無授權條款

內容歸原作者所有。SourceWeft 從公開儲存庫中收錄這些內容。

檢舉或申請下架

更多來自 alirezarezvani/claude-skills 的技能

Chaos Engineering

alirezarezvani

設計安全的混沌工程實驗，涵蓋假設、爆炸半徑估算、中止條件與事後檢討。

包含腳本
DevOps & Cloud27K5 週前更新

Feature Flags Architect

alirezarezvani

指導功能旗標全生命週期：分類旗標、規劃發布、稽核終止開關並掃描旗標債務。

包含腳本
Software Development27K5 週前更新

Slo Architect

alirezarezvani

定義、審查與營運 SLO、SLI 及錯誤預算，內含三個只用標準函式庫的 Python 工具與參考指南。

包含腳本
DevOps & Cloud27K5 週前更新

General Counsel Advisor

alirezarezvani

面向新創公司的總法律顧問輔助：合約風險審查、智慧財產策略、條款清單解讀與法規風險盤點。

包含腳本
Business & Finance27K5 週前更新

Run

alirezarezvani

執行一次手動自動研究實驗迭代：檢視歷史、做一處修改、提交、評估，並保留或丟棄結果。

AI & Agents27K5 週前更新

Ux Researcher Designer

alirezarezvani

UX 研究工具組，用於產生資料驅動的人物誌、旅程地圖、可用性測試計畫與研究綜整。

包含腳本
Design & Creative27K5 週前更新

更多Software Development技能

Playground

anthropics

精選

建立自成一體的互動式 HTML 遊樂場，包含控制項、即時預覽與可複製的提示詞輸出。

Software Development37K今天更新

M5 Onboard

anthropics

精選

透過 USB 偵測 M5Stack ESP32 開發板，燒錄 UIFlow 2.0 韌體並安裝 MicroPython 應用程式套件。

Software Development37K今天更新

Cardputer Buddy

anthropics

精選

指導迭代 Cardputer-Adv 的 MicroPython 應用程式套件：新增應用程式、透過 USB 序列埠推送檔案、查看日誌並執行 REPL 指令。

Software Development37K今天更新

Web Design Guidelines

vercel-labs

精選

依據從遠端來源取得的 Web Interface Guidelines 審查 UI 程式碼，並以 file:line 形式回報問題。

Software Development32K5 週前更新

Vercel React Native Skills

vercel-labs

精選

React Native 與 Expo 最佳實務規則，涵蓋清單效能、動畫、導覽、UI 模式、狀態與 monorepo 設定。

Software Development32K5 週前更新

Vercel React Best Practices

vercel-labs

精選

Vercel 的 React 與 Next.js 效能指南，以 70 條規則的形式用於撰寫、審查與重構程式碼。

Software Development32K5 週前更新