Files
silo-server/internal/audiobooks/abs/play_response.go
T
eb6024573e feat(audiobooks): make audiobook libraries first-class catalog items (#73)
* docs(audiobooks): design spec for plugin absorption

Plan to absorb silo-plugin-audiobooks into silo-server as a first-party
feature. Audiobooks land in silo's existing SPA; ABS clients connect
directly. Hard constraints: reuse existing tables (media_items,
media_files, user_watch_progress, user_playback_sessions, people,
item_people, library_collections); only two new tables (abs_sessions,
podcast_feeds) and at most one column add (media_libraries.kind);
silo's main :8080 listener handles ABS Socket.io natively. Out of
scope: audiobook requests flow, smart collections, share links,
external recommender, custom metadata providers, separate audiobook
SPA.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* docs(audiobooks): implementation plan sub-plan 1 (discovery + schema)

First of six sub-plans for the absorption. Six tasks: a discovery
audit that resolves the spec's Risk questions, four idempotent SQL
migrations (abs_sessions, podcast_feeds, media_libraries.kind,
audiobooks.enabled feature flag), and an empty-but-compiling
internal/audiobooks package scaffolded into cmd/silo. Lands as a
strict no-op for users (feature flag defaults to false).

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* docs(audiobooks): discovery findings for absorption sub-plan 1

Locks schema/code decisions for migrations 139-142 and downstream
sub-plans. Resolves open Risk questions from the absorption design spec.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(audiobooks): migration 139 add abs_sessions table

Parallel of jellycompat_sessions for Audiobookshelf-compatible clients.
Lets ABS mobile/desktop apps maintain a device-bound session that
silo's audiobooks/abs handlers will validate.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* style(audiobooks): match codebase conventions in migration 139

Lowercases type keywords in the abs_sessions CREATE TABLE body to
match neighboring migrations, fixes the client_version column
alignment, and replaces the misleading "parallel to
jellycompat_sessions" header comment with a more accurate
description of the table's role.

Cosmetic only — the running schema is unchanged.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(audiobooks): migration 140 add podcast_feeds table

Side table on media_items for RSS-subscribed podcasts. Holds feed URL,
ETag/Last-Modified for conditional fetches, last-refresh timestamp, and
the per-feed refresh interval consumed by the upcoming
podcastfeed.Refresher scheduled task.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* style(audiobooks): uppercase PRIMARY KEY in migration 140

Aligns with the codebase convention (type keywords lowercase,
constraint keywords uppercase) established in migration 139's
post-style-fix form. Cosmetic only — running schema is unchanged.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* chore(audiobooks): migration 141 no-op for media_folders.type

Sub-plan 1 originally reserved migration 141 to add a 'kind' column to
media_libraries discriminating audiobook/podcast libraries. Discovery
audit (sub-plan 1 Task 1) found that the actual table is media_folders
and it already has a type text NOT NULL column with no CHECK constraint
or enum, so 'audiobooks' and 'podcasts' can be added as future values
without DDL.

Landing this migration as a documented no-op preserves the version
numbering audit trail and pins the decision in git history. The
matching down migration is also a no-op.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(audiobooks): migration 142 add audiobooks.enabled flag

Server-settings row that gates the absorbed audiobooks feature.
Defaults to 'false' so sub-plan 1 lands as a strict no-op; subsequent
sub-plans branch on this flag and operators flip it to 'true' at
cutover.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(audiobooks): scaffold internal/audiobooks package

Empty-but-compiling Service that reads the audiobooks.enabled feature
flag from server_settings. Wired into cmd/silo so the package is
referenced from the binary; no routes mounted, no scheduled tasks
registered, no DB writes. Subsequent sub-plans hang scanner branches,
ABS handlers, Socket.io, podcast refresher, and SPA pages off this
Service.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* style(audiobooks): cosmetic cleanups in scaffolded package

Two pre-emptive cleanups flagged by code review before sub-plan 2
copies the patterns:

  1. Sort the internal/audiobooks import after internal/adminjob in
     cmd/silo/main.go (alphabetical).
  2. Drop the redundant "audiobooks: " prefix from the Enabled() error
     wrap; matches how every other top-level service package
     (watchstate, scanqueue, metadata, etc.) formats errors.

No behavior change.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* docs(audiobooks): implementation plan sub-plan 2 (scanner)

Second of six sub-plans. 10 tasks: PersonKind constants for Author and
Narrator, audio-extension recognizer, library-type helpers, a
walkLogicalTree refactor (movieLibrary bool -> typed walkMode), chapter
extraction via ffprobe, single-file and multi-file audiobook parsers,
scanner write path producing media_items.type='audiobook', and a
filesystem podcast parser (RSS deferred to sub-plan 5).

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(audiobooks): add Author and Narrator PersonKind constants

Discovery audit confirmed item_people.kind is unconstrained smallint
with values 1-6 in use. Reserve 7 = Author, 8 = Narrator for audiobook
people-links written by the upcoming scanner branches.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(audiobooks): add audio-extension recognizer for scanner

Mirrors the existing videoExtensions/SupportsVideoFile pair. Used by
upcoming audiobook and podcast scanner branches to filter directory
walks.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(audiobooks): library-type recognizers for scanner dispatch

isAudiobookLibraryType and isPodcastLibraryType match singular and
plural forms case-insensitively, mirroring isMovieLibraryType. Used by
upcoming scanner walk branches (Task 4) that filter audio files into
audiobook and podcast libraries.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* refactor(scanner): replace movieLibrary bool with typed walkMode

Lets walkLogicalTree dispatch on multiple library shapes (video, movie,
audiobook, podcast) without proliferating boolean flags. Behavior for
existing video and movie libraries is unchanged; audiobook and podcast
modes will be consumed by the upcoming audiobook.go and podcast.go
parsers in later tasks of this sub-plan.

walkModeFor() derives the mode from a media_folders.type string;
unknown types default to walkModeVideo to preserve prior behavior for
any caller still passing a raw type.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(audiobooks): expose ffprobe format tags on ProbeData

The audiobook scanner needs format-level tags (title, artist, album,
date) for media_items metadata; ffprobe already parses them in
ffprobeFormat.Tags but ProbeData previously discarded them. Add
FormatTags map[string]string to ProbeData, populate it in
convertProbeData via a new normalizeFormatTags helper that lowercases
keys and trims values.

Adds a fixture audiobook .m4b with embedded chapters (Intro/Outro) and
format tags, and a test that verifies ProbeFile() returns both
correctly.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(audiobooks): parser for single-file audiobook folders

parseAudiobookFolder reads tags + chapters via the existing ProbeFile
(now that Task 5 exposes FormatTags on ProbeData) and produces a
parsedAudiobook struct. Title falls back from "title" tag to "album";
author from "artist" -> "album_artist" -> "composer"; series from
"album" -> "series" -> "mvnm" (Movement Name, used by some MP4 tools).
Year parsed from "date" or "year" tags, tolerating ISO dates and
parenthesized forms.

Single-file case only; multi-file folders (one audio file per chapter)
return a placeholder error and arrive in Task 7.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(audiobooks): multi-file audiobook folder support

Folders containing N audio files (one per chapter/part) get one
parsedAudiobookFile per file; each file's chapter list is synthesized
as a single chapter with title = filename stem. Title/author/series/
year come from the first file's tags.

Also drops the duplicate pickFirstNonEmpty helper added in Task 6 in
favor of the existing firstNonEmpty already in probe.go.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(audiobooks): scanner write path produces audiobook media_items

ScanAudiobookFolder walks an audiobooks-typed media folder and treats
each immediate subdirectory as one audiobook. For each parsed audiobook
it upserts:
  - one media_items row with type='audiobook'
  - one media_files row per audio file (with chapters JSONB)
  - author/narrator links in item_people (kind=7, kind=8)

Adds itemRepo and personRepo to the Scanner struct, wired from
fileRepo.Pool() in NewScanner — no constructor signature change needed.

ScanFolder dispatches to this path when folder.Type='audiobooks',
bypassing the per-file movie/TV pipeline because audiobooks are
folder-scoped entities.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(audiobooks): filesystem podcast scanner

ScanPodcastFolder walks a podcasts-typed media folder, treating each
subdirectory as a podcast show and each audio file inside as an
episode. Writes media_items.type='podcast' + episodes rows + media_files
rows. RSS-subscribed feeds (podcast_feeds table) arrive in sub-plan 5;
this task covers filesystem-only ingestion.

ScanFolder dispatches to this path when folder.Type='podcasts'.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* docs(audiobooks): implementation plan sub-plan 5 (podcasts)

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(audiobooks): expose audiobooks/podcasts library types in admin UI

Adds 'Audiobooks' and 'Podcasts' options to the library-type dropdown
in the admin libraries page so operators can flag a folder as an
audiobook or podcast library. Extends contentLevelsForType() so the
admin UI's downstream filtering treats those types correctly
(audiobook -> ['audiobook'], podcasts -> ['podcast',
'podcast_episode']).

Backend scanner branches for these types were already wired in
sub-plan 2.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* chore(migrations): renumber 139_abs_sessions to 147 for origin/main merge

origin/main adds 139_media_requests at the same number our local
audiobook branch had used for abs_sessions. Renumber ours to 147 to
free up 139 for the upstream migration. The schema_versions row is
updated in lockstep on the running database so the migrator sees the
abs_sessions migration as already applied at its new version.

Migrations 140-146 (podcast feeds, media_folders kind noop, audiobook
feature flag, abs playback sessions, podcast episode guid, audiobook
series, audiobook title cleanup) stay where they are — they don't
collide with anything on origin/main.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* chore(migrations): renumber 140_podcast_feeds to 157 for origin/main merge

origin/main added 140_user_permissions at the same version this branch
had used for podcast_feeds. Renumber ours to 157 (next free above the
collections-unify migration at 156) so 140 is free for the upstream
migration. schema_versions on the running database is updated in lockstep
so the migrator sees podcast_feeds as already applied at its new version.

Same pattern as d59c1cb (renumber 139_abs_sessions to 147 for the prior
main merge). Pending migrations after this rename: 132 (downloaded
subtitles admin index, main), 140 (user_permissions, main), and 156
(unify_user_collections, this branch).

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* chore(migrations): renumber 141_media_folders_kind_noop to 159 for origin/main merge

Same shape as eb8f67d (the 140→157 renumber from the previous main
merge). origin/main added 141_episode_title_sort_index at the same
version this branch had used for media_folders_kind_noop. Renumber
ours to 159 (next free above the audiobook_series truncate at 158) so
141 is open for the upstream migration. schema_versions on the
running database is updated in lockstep so the migrator sees
media_folders_kind_noop as already applied at its new version.

Pending migrations on silo-prod after this rename: 141
(episode_title_sort_index, main) and any other newer ones from main
that the branch hasn't picked up yet.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* chore(migrations): renumber 142_audiobooks_feature_flag to 160 for origin/main merge

Companion to 3c6f062's 141 renumber — origin/main also added
142_episode_catalog_entries (alongside 141_episode_title_sort_index)
at a version this branch had used for the audiobooks feature flag.
Renumber ours to 160 so 142 is open for the upstream migration;
schema_versions on silo-prod is updated in lockstep so the migrator
sees audiobooks_feature_flag as already applied at its new version.

This was the only remaining collision (verified by checking for
duplicate version prefixes across migrations/).

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* fix(audiobooks): address foundation review comments

* fix(audiobooks): tighten scanner identity handling

* fix(audiobooks): propagate scanner cancellation

* chore(audiobooks): adopt goose migration layout

* docs(audiobooks): implementation plan sub-plan 3 (API + frontend MVP)

Third of six sub-plans. 9 tasks: three REST endpoints (list/detail/
progress), TanStack Query hooks + types, three React pages
(Library/Detail/Player), and navigation integration. Scoped to MVP —
author/series indices, smart collections, share links, and other
nice-to-haves from the spec are deferred. Streaming reuses silo's
existing /api/v1/stream/{session_id}; no new transcode code.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(audiobooks): list endpoint at GET /api/v1/audiobooks

Paginated list of media_items with type='audiobook' scoped to the
caller's accessible libraries via the existing access filter.
Mirrors silo's existing list-style handlers for movies and series.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(audiobooks): detail endpoint at GET /api/v1/audiobooks/{id}

Returns the media_items row, its media_files (with chapters JSONB),
author/narrator extracted from item_people (kinds 7/8), and the
caller's per-profile listening progress from user_watch_progress.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(audiobooks): progress endpoint at POST /api/v1/audiobooks/{id}/progress

UPSERTs user_watch_progress for the caller's (user_id, profile_id,
content_id). Body carries position_seconds; clients are expected to
post every 5-10s during playback plus on pause/seek (matching silo's
existing video progress cadence).

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(audiobooks): frontend types and TanStack Query hooks

TypeScript types match the JSON shapes from the new
/api/v1/audiobooks endpoints (list, detail, progress). Three hooks:
useAudiobookLibrary (list), useAudiobook (detail), and
useReportAudiobookProgress (mutation that invalidates the detail
query on success so progress updates reflect immediately).

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(audiobooks): library grid page at /audiobooks

Renders a paginated grid of audiobook cards using the
useAudiobookLibrary hook. Each card links to /audiobooks/book/{id}.
Cards show poster, title, and year; falls back to a "No cover"
placeholder when the audiobook has no poster_url. Empty state hints
to operators that they need to set a library's type to 'audiobooks'.

Routes themselves are wired in Task 8 (navigation integration).

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(audiobooks): detail page with chapter list

Renders cover, title, author, narrator, year, and overview alongside a
chapter list. Clicking a chapter opens an inline sticky
AudiobookPlayer at that chapter's start. A "Resume" button restarts
playback at the saved progress position if present.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(audiobooks): HTML5 audio player with chapter navigation

Single-file audiobook playback for MVP. Multi-file queuing arrives in
a follow-up. Streams via the existing /api/v1/direct-download GET
endpoint. Position is reported to /api/v1/audiobooks/{id}/progress
every 10s while playing plus on pause/seek/end. Skip-30s, playback
rate select, chapter list panel.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* feat(audiobooks): wire navigation and routes

Adds an Audiobooks entry to the sidebar and registers the two new
routes (/audiobooks for the library grid, /audiobooks/book/:id for
detail). The player renders inline inside the detail page; no
dedicated player route is required for MVP.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

* fix(audiobooks): address native API review comments

* feat(audiobooks): add ABS compatibility and polish

* fix(audiobooks): stabilize ABS playback progress reporting

* fix(audiobooks): clean up ABS branch review fixes

* chore(audiobooks): adopt goose layout for ABS migrations

* fix(audiobooks): align player seek bar props

* feat(audiobooks): make libraries first-class catalog items

* feat(admin): add server restart endpoint

* fix(audiobooks): address review comment findings

---------

Co-authored-by: RXWatcher <14085001+RXWatcher@users.noreply.github.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-06-07 15:57:05 -04:00

529 lines
16 KiB
Go

package abs
import (
"context"
"log/slog"
"net/http"
"path/filepath"
"strconv"
"strings"
"time"
"unicode"
"github.com/go-chi/chi/v5"
"github.com/oklog/ulid/v2"
"github.com/Silo-Server/silo-server/internal/models"
)
// handlePlayStart handles POST /abs/api/items/{libraryItemId}/play.
//
// Real ABS clients hit this endpoint to start a playback session and get back
// a manifest of audio tracks with signed contentUrls. The response includes
// the full playbackSession shape the mobile player reads to seed the audio
// element: currentTime (resume position), audioTracks, mediaMetadata,
// libraryItem, chapters, etc.
//
// Silo's implementation:
// - Looks up the audiobook via MediaStore.GetAudiobookByID.
// - Loads all media files via MediaStore.GetMediaFiles (sorted by ID ASC).
// - Synthesises a ULID session ID (in-memory; no play-session table yet).
// - Builds contentUrls that point at the session-scoped public track route,
// avoiding bearer tokens in URLs while preserving ABS DirectPlay behavior.
// - Returns a JSON playbackSession matching the shape real ABS emits, with
// enough fields populated that the official mobile client plays without
// entering "spinner forever" mode.
func (h *Handler) handlePlayStart(w http.ResponseWriter, r *http.Request) {
a, ok := absAuthFrom(r)
if !ok || a.UserID == "" {
http.Error(w, "unauthorized", http.StatusUnauthorized)
return
}
contentID := chi.URLParam(r, "libraryItemId")
access, err := h.accessFilterForAuth(r.Context(), a)
if err != nil {
http.Error(w, "resolve access: "+err.Error(), http.StatusForbidden)
return
}
item, err := h.deps.MediaStore.GetAudiobookByID(r.Context(), contentID, access)
if err != nil || item == nil {
http.Error(w, "item not found", http.StatusNotFound)
return
}
files, err := h.deps.MediaStore.GetMediaFiles(r.Context(), contentID, access)
if err != nil {
http.Error(w, "load files failed", http.StatusInternalServerError)
return
}
// The {ino} parameter used by handleFileStream is a 0-based file index, but
// we want iOS clients to resolve it via the stable MD5 derivation. Emit inos
// that handleFileStream can reverse without a database lookup.
baseURL := h.absBaseURL(r)
sessionID := ulid.Make().String()
// Persist the session row so subsequent PATCH /session/{sid} heartbeats
// and POST /session/{sid}/close can find it. Without this, the session
// ID is returned to the client but every sync/close lookup 404s.
if h.deps.PlaybackSessionStore != nil {
sess := ABSPlaybackSession{
ID: sessionID,
UserID: a.UserID,
ProfileID: a.ProfileID,
ContentID: contentID,
}
if len(files) > 0 {
fid := files[0].ID
sess.MediaFileID = &fid
}
if err := h.deps.PlaybackSessionStore.InsertPlaybackSession(r.Context(), sess); err != nil {
// Non-fatal: log but still return the manifest so the client
// can play. Heartbeat/close calls will fail with 404 until the
// next play_start lands cleanly.
slog.Warn("abs play: persist session failed",
"session_id", sessionID, "content_id", contentID, "err", err)
}
}
audioTracks := buildSiloAudioTracks(contentID, files, baseURL, sessionID)
totalDuration := float64(0)
for _, t := range audioTracks {
totalDuration += t.Duration
}
chapters := buildSiloChapters(files)
mediaMetadata := buildSiloPlayMediaMetadata(item)
libraryItem := buildSiloPlayLibraryItem(item, contentID, mediaMetadata, audioTracks, chapters, totalDuration, baseURL)
displayTitle := item.Title
displayAuthor := ""
if v, ok := mediaMetadata["authorName"].(string); ok {
displayAuthor = v
}
now := time.Now()
nowMs := now.UnixMilli()
dateStr := now.UTC().Format("2006-01-02")
dayOfWeek := now.UTC().Weekday().String()
// currentTime seeds the audio element's initial position so cross-device
// resume works. Lookup is best-effort: any error returns position 0,
// which is always correct for a first listen.
//
// Note: we deliberately do NOT emit a "progress" (0.0-1.0) field on the
// play session response. The canonical continuum-plugin handler omits it
// too — "progress" belongs to /me/progress responses, not playbackSession.
// The spec's Phase 0 row mentioning "currentTime AND progress fields" was
// over-specified; matching the canonical wire shape is the load-bearing
// requirement.
var currentTime float64
currentTime, err = resolveResumeTime(r.Context(), h.deps.ProgressStore, a.UserID, a.ProfileID, contentID)
if err != nil {
slog.Debug("play: progress lookup failed", "user", a.UserID, "item", contentID, "err", err)
// currentTime is already 0 on error path; safe to continue.
}
playbackSession := map[string]any{
"id": sessionID,
"userId": a.UserID,
"libraryId": VirtualLibraryID,
"libraryItemId": contentID,
"bookId": contentID,
"episodeId": nil,
"mediaType": LibraryMediaType,
"mediaMetadata": mediaMetadata,
"chapters": chapters,
"displayTitle": displayTitle,
"displayAuthor": displayAuthor,
"coverPath": baseURL + "/api/items/" + contentID + "/cover",
"duration": totalDuration,
"playMethod": 0, // DIRECTPLAY
"mediaPlayer": "exo-player",
"deviceInfo": map[string]any{
"deviceId": "unknown",
"manufacturer": "Unknown",
"model": "Unknown",
"sdkVersion": 0,
"clientVersion": "0.0.0",
},
"serverVersion": ServerVersion,
"date": dateStr,
"dayOfWeek": dayOfWeek,
"timeListening": 0,
"startTime": currentTime,
"currentTime": currentTime,
"startedAt": nowMs,
"updatedAt": nowMs,
"audioTracks": audioTracks,
"libraryItem": libraryItem,
}
writeJSON(w, http.StatusOK, playbackSession)
}
// buildSiloAudioTracks converts silo media_files into the ABS AudioTrack
// slice. Each track's contentUrl points at the short-lived session public
// track route so bearer tokens are never embedded in URLs.
func buildSiloAudioTracks(
contentID string,
files []*models.MediaFile,
baseURL string,
sessionID string,
) []AudioTrack {
tracks := make([]AudioTrack, 0, len(files))
startOffset := float64(0)
for i, f := range files {
ino := trackInoFor(contentID, i)
ext := strings.ToLower(filepath.Ext(f.FilePath))
format := strings.TrimPrefix(ext, ".")
mimeType := audioContentType(ext)
if mimeType == "" {
mimeType = "audio/mpeg"
}
filename := filepath.Base(f.FilePath)
// ABS wire index is 1-based to match the real server's convention.
// Our ino uses 0-based internally; handleFileStream resolves via ino.
wireIndex := i + 1
contentURL := baseURL + "/abs/public/session/" + sessionID + "/track/" + strconv.Itoa(wireIndex)
duration := float64(f.Duration) // f.Duration is in seconds (int)
var bitRate int
if f.Bitrate > 0 {
bitRate = f.Bitrate * 1000 // kbps → bps
} else {
bitRate = 128000
}
channels := f.AudioChannels
if channels == 0 {
channels = 2
}
codec := f.CodecAudio
channelLayout := "stereo"
if channels > 2 {
channelLayout = "surround"
}
nowMs := time.Now().UnixMilli()
track := AudioTrack{
Index: wireIndex,
Ino: ino,
Metadata: &AudioTrackMetadata{
Filename: filename,
Ext: ext,
Path: f.FilePath,
RelPath: filename,
Size: f.FileSize,
MtimeMs: 0,
CtimeMs: 0,
BirthtimeMs: 0,
},
AddedAt: nowMs,
UpdatedAt: nowMs,
TrackNumFromMeta: nil,
DiscNumFromMeta: nil,
TrackNumFromFilename: nil,
DiscNumFromFilename: nil,
ManuallyVerified: false,
Exclude: false,
Error: nil,
Format: format,
Duration: duration,
BitRate: bitRate,
Language: nil,
Codec: codec,
TimeBase: "1/14112000",
Channels: channels,
ChannelLayout: channelLayout,
Chapters: nil,
EmbeddedCoverArt: nil,
MetaTags: map[string]string{},
MimeType: mimeType,
Title: filename,
StartOffset: startOffset,
ContentURL: contentURL,
}
tracks = append(tracks, track)
startOffset += duration
}
return tracks
}
// buildSiloChapters extracts chapters from the first media file that has them.
// ABS expects chapters as a flat list spanning the whole book; for multi-file
// audiobooks we only use the first file's chapters (most single-file M4B
// audiobooks have embedded chapters; multi-MP3 sets rarely do).
func buildSiloChapters(files []*models.MediaFile) []map[string]any {
for _, f := range files {
if len(f.Chapters) == 0 {
continue
}
chapters := make([]map[string]any, 0, len(f.Chapters))
for i, c := range f.Chapters {
chapters = append(chapters, map[string]any{
"id": i,
"start": c.StartSeconds,
"end": c.EndSeconds,
"title": c.Title,
})
}
return chapters
}
return []map[string]any{}
}
// buildSiloPlayMediaMetadata builds the playbackSession.mediaMetadata object
// from a silo MediaItem. The mobile player reads this for the "Now Playing"
// widget and playback history; missing keys cause the audio loader to abort.
func buildSiloPlayMediaMetadata(item *models.MediaItem) map[string]any {
title := item.Title
authors := make([]map[string]any, 0)
authorNames := make([]string, 0)
narrators := make([]string, 0)
for _, p := range item.People {
switch p.Kind {
case models.PersonKindAuthor:
authors = append(authors, map[string]any{
"id": strconv.FormatInt(p.ID, 10),
"name": p.Name,
})
authorNames = append(authorNames, p.Name)
case models.PersonKindNarrator:
narrators = append(narrators, p.Name)
}
}
authorName := strings.Join(authorNames, ", ")
lastFirsts := make([]string, len(authorNames))
for i, n := range authorNames {
lastFirsts[i] = toLastFirst(n)
}
authorNameLF := strings.Join(lastFirsts, ", ")
publishedYear := ""
if item.Year > 0 {
publishedYear = strconv.Itoa(item.Year)
}
genres := item.Genres
if genres == nil {
genres = []string{}
}
series := make([]map[string]any, 0, len(item.AudiobookSeries))
seriesNames := make([]string, 0, len(item.AudiobookSeries))
for _, membership := range item.AudiobookSeries {
name := strings.TrimSpace(membership.Name)
if name == "" {
continue
}
obj := map[string]any{"id": name, "name": name}
if membership.Index != nil {
obj["sequence"] = strconv.FormatFloat(*membership.Index, 'f', -1, 64)
}
series = append(series, obj)
seriesNames = append(seriesNames, name)
}
var publisher any
if len(item.Studios) > 0 && strings.TrimSpace(item.Studios[0]) != "" {
publisher = strings.TrimSpace(item.Studios[0])
}
return map[string]any{
"title": title,
"titleIgnorePrefix": titleIgnorePrefix(title),
"subtitle": nil,
"authors": authors,
"authorName": authorName,
"authorNameLF": authorNameLF,
"narrators": narrators,
"narratorName": strings.Join(narrators, ", "),
"series": series,
"seriesName": strings.Join(seriesNames, ", "),
"genres": genres,
"tags": []string{},
"publishedYear": publishedYear,
"publishedDate": nil,
"publisher": publisher,
"description": nilIfEmpty(item.Overview),
"descriptionPlain": nilIfEmpty(stripHTML(item.Overview)),
"isbn": nil,
"asin": nil,
"language": "en",
"explicit": false,
"abridged": false,
}
}
// buildSiloPlayLibraryItem builds the playbackSession.libraryItem nested
// object. The mobile player reads libraryItem.media.tracks /
// libraryItem.media.metadata / libraryItem.libraryFiles for offline download
// decisions and UI rendering.
func buildSiloPlayLibraryItem(
item *models.MediaItem,
contentID string,
mediaMetadata map[string]any,
audioTracks []AudioTrack,
chapters []map[string]any,
totalDuration float64,
baseURL string,
) map[string]any {
firstIno := contentID
if len(audioTracks) > 0 {
firstIno = audioTracks[0].Ino
}
totalSize := int64(0)
libraryFiles := make([]map[string]any, 0, len(audioTracks))
for _, t := range audioTracks {
nowMs := time.Now().UnixMilli()
libraryFiles = append(libraryFiles, map[string]any{
"ino": t.Ino,
"metadata": t.Metadata,
"isSupplementary": false,
"addedAt": nowMs,
"updatedAt": nowMs,
"fileType": "audio",
})
if t.Metadata != nil {
totalSize += t.Metadata.Size
}
}
addedAtMs := int64(0)
if item.AddedAt != nil {
addedAtMs = item.AddedAt.UnixMilli()
}
updatedAtMs := item.UpdatedAt.UnixMilli()
return map[string]any{
"id": contentID,
"ino": firstIno,
"oldLibraryItemId": nil,
"libraryId": VirtualLibraryID,
"folderId": VirtualFolderID,
"path": contentID,
"relPath": contentID,
"isFile": true,
"mtimeMs": nil,
"ctimeMs": nil,
"birthtimeMs": nil,
"addedAt": addedAtMs,
"updatedAt": updatedAtMs,
"lastScan": addedAtMs,
"scanVersion": ServerVersion,
"isMissing": false,
"isInvalid": false,
"mediaType": LibraryMediaType,
"media": map[string]any{
"id": contentID,
"libraryItemId": contentID,
"metadata": mediaMetadata,
"coverPath": baseURL + "/api/items/" + contentID + "/cover",
"tags": []any{},
"audioFiles": audioTracks,
"chapters": chapters,
"ebookFile": nil,
"duration": totalDuration,
"size": totalSize,
"tracks": audioTracks,
},
"libraryFiles": libraryFiles,
// size on the outer libraryItem is a STRING in real ABS wire format —
// mobile sort comparators string-compare it.
"size": strconv.FormatInt(totalSize, 10),
}
}
// ---------------------------------------------------------------------------
// Play response helpers
// ---------------------------------------------------------------------------
// nilIfEmpty returns nil when s is blank, otherwise the string itself.
// This mirrors the plugin's pattern: ABS clients treat null and ""
// differently on some fields (publisher, description, isbn, etc.).
func nilIfEmpty(s string) any {
if strings.TrimSpace(s) == "" {
return nil
}
return s
}
// titleIgnorePrefix strips leading articles for sort-key purposes,
// matching real ABS LibraryItemController behaviour.
func titleIgnorePrefix(title string) string {
lower := strings.ToLower(title)
for _, p := range []string{"the ", "a ", "an "} {
if strings.HasPrefix(lower, p) {
return title[len(p):]
}
}
return title
}
// toLastFirst converts "First Last" → "Last, First" for the authorNameLF
// field the mobile "Now Playing" widget renders.
func toLastFirst(name string) string {
parts := strings.Fields(name)
if len(parts) < 2 {
return name
}
return parts[len(parts)-1] + ", " + strings.Join(parts[:len(parts)-1], " ")
}
// stripHTML removes HTML angle-bracket tags from a description so the mobile
// "Now Playing" body renderer doesn't have to. Cheap and good enough for
// the descriptions silo metadata sources produce.
func stripHTML(s string) string {
if s == "" {
return ""
}
var b strings.Builder
inTag := false
for _, r := range s {
switch {
case r == '<':
inTag = true
case r == '>':
inTag = false
case !inTag:
if !unicode.IsControl(r) {
b.WriteRune(r)
}
}
}
return strings.TrimSpace(b.String())
}
// resolveResumeTime returns the persisted currentTime for (userID, profileID,
// contentID) from the progress store, or 0 when no row exists / store is nil.
// Returned error is propagated so callers can log it; the caller is expected
// to fall back to 0 on error (a fresh-listen start is always correct).
func resolveResumeTime(ctx context.Context, store ProgressStore, userID, profileID, contentID string) (float64, error) {
if store == nil {
return 0, nil
}
row, err := store.GetProgress(ctx, userID, profileID, contentID)
if err != nil {
return 0, err
}
if row == nil {
return 0, nil
}
return row.CurrentSeconds, nil
}