Files
hermes-skills/comfyui/references/video-generation-research.md

2.9 KiB

Video Generation Research — Qdrant Quick-Start

Canonical data store: Qdrant comfyui_decisions @ http://10.0.0.22:6333 (64+ points) Embedding: snowflake-arctic-embed2:latest (1024-dim, Cosine) Human companion: /home/n8n/workspace/comfy/research.md (search topics + URLs only, no specs)


What Lives Where

Store Content How to Query
Qdrant comfyui_decisions All specs, VRAM numbers, node names, workarounds, paper abstracts, trend analysis Vector search via Ollama embedding + POST to 10.0.0.22:6333
Qdrant comfyui_kb General knowledge (3884 points, pre-existing) Same method
research.md Human-readable search topics, URL quick-reference, comparison tables grep / raw read
This file Quick-start pointers to the above Read once, then query Qdrant

Qdrant Query Pattern

import requests, json

# 1. Get embedding
emb_resp = requests.post("http://localhost:11434/api/embed", json={
    "model": "snowflake-arctic-embed2:latest",
    "input": "YOUR SEARCH TOPIC"
})
vector = emb_resp.json()["embeddings"][0]

# 2. Search Qdrant
search_resp = requests.post(
    "http://10.0.0.22:6333/collections/comfyui_decisions/points/search",
    json={"vector": vector, "limit": 5, "with_payload": True}
)
results = search_resp.json()["result"]["points"]

Example Search Topics

Use these as input strings above (from research.md):

  • "LTX 2.3 specs, frames, VRAM, audio latent"
  • "HunyuanVideo frame limits block swapping FP8"
  • "Wan 2.2 low VRAM sound-to-video FreeLong"
  • "Google Veo 3 native audio cloud"
  • "Kling 3.0 Omni visual identity vocal tone"
  • "ID-LoRA face identity lock LTX"
  • "FreeLong spectral blending Wan motion reversal"
  • "Segment chaining last frame to first frame"
  • "LivePortrait portrait animation"
  • "MuseTalk LatentSync lip-sync"
  • "RIFE frame interpolation"
  • "MultiTalk NeurIPS multi-person conversation"
  • "StreamingT2V CVPR long video streaming"

Quick Model Comparison (from Qdrant)

Tool Native Audio Max Frames VRAM Best For
LTX 2.3 YES 361 12-24 GB Local, audio-synced
HunyuanVideo 1.5 NO 129 20-24 GB Best open-source quality
Wan 2.2 YES (S2V) 81 / 1025 5-16 GB Low VRAM, sound-driven
Veo 3 YES API Cloud Highest fidelity
Kling 3.0 Omni YES API Cloud Character + voice

Key URLs (Quick Reference)


All detailed data is in Qdrant. This file is a navigation aid only.