#Content-Aware Encoding

Content-aware encoding analyzes your source video to optimize encoding parameters for each specific piece of content. Instead of using fixed bitrate ladders, Transcodely adjusts compression based on the visual complexity of each title — simple content (talking heads, animation) gets lower bitrates without quality loss, while complex content (action, sports) gets the bitrate it needs.

Content-aware encoding is configured via the content_aware object on an Output Specification.

Content-aware encoding adds a 1.15x feature multiplier to the output cost. See Pricing for details.

#The ContentAwareConfig object

#Modes

#VMAF targeting

VMAF (Video Multimethod Assessment Fusion) is a perceptual quality metric developed by Netflix. A VMAF score of 93+ is generally considered “excellent” quality with artifacts imperceptible to most viewers.

Content-aware encoding optimizes bitrates to achieve a target VMAF score. This means:

• Simple content (interview, slideshow, animation) → lower bitrate, same perceived quality
• Complex content (action movie, sports, concert) → higher bitrate to maintain quality

#Default VMAF targets by quality tier

Override the default with vmaf_target:

{
  "content_aware": {
    "mode": "per_title",
    "vmaf_target": 95
  }
}

#Auto ABR

Auto ABR analyzes the source content and automatically builds an optimal ABR ladder. Instead of manually specifying each variant, you define constraints and let Transcodely determine the best configuration.

#AutoABRConfig attributes

The auto ABR algorithm:

1. Probes the source to extract metadata (resolution, frame rate, complexity)
2. Analyzes content complexity (motion, texture, scene changes)
3. Determines the optimal number of variants within your constraints
4. Selects resolution and bitrate for each variant to meet the VMAF target
5. Generates the ABR ladder

{
  "type": "hls",
  "video": [
    {"codec": "h264", "quality": "standard"}
  ],
  "content_aware": {
    "mode": "auto_abr",
    "vmaf_target": 93,
    "auto_abr": {
      "min_variants": 3,
      "max_variants": 6,
      "min_resolution": "480p",
      "max_resolution": "2160p"
    }
  }
}

When using auto_abr, the video array should contain a single variant that specifies the codec and quality tier. The auto ABR algorithm uses these as defaults for all generated variants.

#Content analysis

When content-aware encoding is used, the job response includes a content_analysis object with details about the source content. This is available after probing completes.

Example content analysis response:

{
  "content_analysis": {
    "complexity_score": 0.72,
    "motion_score": 0.85,
    "texture_score": 0.45,
    "content_type": "sports"
  }
}

#Typical scores by content type

#Examples

#Per-title encoding with default VMAF

Use per-title mode with your existing ABR ladder. Transcodely adjusts the bitrate for each variant based on content complexity while preserving the quality tier’s default VMAF target.

{
  "type": "hls",
  "video": [
    {"codec": "h264", "resolution": "1080p", "quality": "standard"},
    {"codec": "h264", "resolution": "720p", "quality": "standard"},
    {"codec": "h264", "resolution": "480p", "quality": "economy"}
  ],
  "content_aware": {
    "mode": "per_title"
  }
}

#Per-title with custom VMAF target

Override the quality tier default and target a specific VMAF score across all variants.

{
  "type": "dash",
  "video": [
    {"codec": "h265", "resolution": "2160p", "quality": "premium"},
    {"codec": "h265", "resolution": "1080p", "quality": "standard"},
    {"codec": "h265", "resolution": "720p", "quality": "standard"}
  ],
  "content_aware": {
    "mode": "per_title",
    "vmaf_target": 95
  }
}

#Auto ABR with constraints

Let Transcodely build the ABR ladder automatically. The algorithm determines the optimal number of variants and their resolutions within the constraints you provide.

{
  "type": "adaptive",
  "video": [
    {"codec": "h264", "quality": "standard"}
  ],
  "content_aware": {
    "mode": "auto_abr",
    "auto_abr": {
      "min_variants": 3,
      "max_variants": 8,
      "min_resolution": "480p",
      "max_resolution": "2160p"
    }
  }
}

#Auto ABR with AV1 and tight constraints

Combine AV1’s superior compression with auto ABR for maximum efficiency. Tighter variant constraints and a high VMAF target produce a compact, high-quality ladder.

{
  "type": "hls",
  "video": [
    {"codec": "av1", "quality": "premium"}
  ],
  "content_aware": {
    "mode": "auto_abr",
    "vmaf_target": 97,
    "auto_abr": {
      "min_variants": 4,
      "max_variants": 6,
      "min_resolution": "720p",
      "max_resolution": "2160p"
    }
  }
}

#Validation rules

Transcodely validates content-aware configuration at job creation time. The following constraints are enforced: