* docs(audiobooks): design spec for plugin absorption Plan to absorb silo-plugin-audiobooks into silo-server as a first-party feature. Audiobooks land in silo's existing SPA; ABS clients connect directly. Hard constraints: reuse existing tables (media_items, media_files, user_watch_progress, user_playback_sessions, people, item_people, library_collections); only two new tables (abs_sessions, podcast_feeds) and at most one column add (media_libraries.kind); silo's main :8080 listener handles ABS Socket.io natively. Out of scope: audiobook requests flow, smart collections, share links, external recommender, custom metadata providers, separate audiobook SPA. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * docs(audiobooks): implementation plan sub-plan 1 (discovery + schema) First of six sub-plans for the absorption. Six tasks: a discovery audit that resolves the spec's Risk questions, four idempotent SQL migrations (abs_sessions, podcast_feeds, media_libraries.kind, audiobooks.enabled feature flag), and an empty-but-compiling internal/audiobooks package scaffolded into cmd/silo. Lands as a strict no-op for users (feature flag defaults to false). Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * docs(audiobooks): discovery findings for absorption sub-plan 1 Locks schema/code decisions for migrations 139-142 and downstream sub-plans. Resolves open Risk questions from the absorption design spec. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(audiobooks): migration 139 add abs_sessions table Parallel of jellycompat_sessions for Audiobookshelf-compatible clients. Lets ABS mobile/desktop apps maintain a device-bound session that silo's audiobooks/abs handlers will validate. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * style(audiobooks): match codebase conventions in migration 139 Lowercases type keywords in the abs_sessions CREATE TABLE body to match neighboring migrations, fixes the client_version column alignment, and replaces the misleading "parallel to jellycompat_sessions" header comment with a more accurate description of the table's role. Cosmetic only — the running schema is unchanged. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(audiobooks): migration 140 add podcast_feeds table Side table on media_items for RSS-subscribed podcasts. Holds feed URL, ETag/Last-Modified for conditional fetches, last-refresh timestamp, and the per-feed refresh interval consumed by the upcoming podcastfeed.Refresher scheduled task. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * style(audiobooks): uppercase PRIMARY KEY in migration 140 Aligns with the codebase convention (type keywords lowercase, constraint keywords uppercase) established in migration 139's post-style-fix form. Cosmetic only — running schema is unchanged. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * chore(audiobooks): migration 141 no-op for media_folders.type Sub-plan 1 originally reserved migration 141 to add a 'kind' column to media_libraries discriminating audiobook/podcast libraries. Discovery audit (sub-plan 1 Task 1) found that the actual table is media_folders and it already has a type text NOT NULL column with no CHECK constraint or enum, so 'audiobooks' and 'podcasts' can be added as future values without DDL. Landing this migration as a documented no-op preserves the version numbering audit trail and pins the decision in git history. The matching down migration is also a no-op. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(audiobooks): migration 142 add audiobooks.enabled flag Server-settings row that gates the absorbed audiobooks feature. Defaults to 'false' so sub-plan 1 lands as a strict no-op; subsequent sub-plans branch on this flag and operators flip it to 'true' at cutover. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(audiobooks): scaffold internal/audiobooks package Empty-but-compiling Service that reads the audiobooks.enabled feature flag from server_settings. Wired into cmd/silo so the package is referenced from the binary; no routes mounted, no scheduled tasks registered, no DB writes. Subsequent sub-plans hang scanner branches, ABS handlers, Socket.io, podcast refresher, and SPA pages off this Service. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * style(audiobooks): cosmetic cleanups in scaffolded package Two pre-emptive cleanups flagged by code review before sub-plan 2 copies the patterns: 1. Sort the internal/audiobooks import after internal/adminjob in cmd/silo/main.go (alphabetical). 2. Drop the redundant "audiobooks: " prefix from the Enabled() error wrap; matches how every other top-level service package (watchstate, scanqueue, metadata, etc.) formats errors. No behavior change. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * docs(audiobooks): implementation plan sub-plan 2 (scanner) Second of six sub-plans. 10 tasks: PersonKind constants for Author and Narrator, audio-extension recognizer, library-type helpers, a walkLogicalTree refactor (movieLibrary bool -> typed walkMode), chapter extraction via ffprobe, single-file and multi-file audiobook parsers, scanner write path producing media_items.type='audiobook', and a filesystem podcast parser (RSS deferred to sub-plan 5). Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(audiobooks): add Author and Narrator PersonKind constants Discovery audit confirmed item_people.kind is unconstrained smallint with values 1-6 in use. Reserve 7 = Author, 8 = Narrator for audiobook people-links written by the upcoming scanner branches. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(audiobooks): add audio-extension recognizer for scanner Mirrors the existing videoExtensions/SupportsVideoFile pair. Used by upcoming audiobook and podcast scanner branches to filter directory walks. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(audiobooks): library-type recognizers for scanner dispatch isAudiobookLibraryType and isPodcastLibraryType match singular and plural forms case-insensitively, mirroring isMovieLibraryType. Used by upcoming scanner walk branches (Task 4) that filter audio files into audiobook and podcast libraries. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * refactor(scanner): replace movieLibrary bool with typed walkMode Lets walkLogicalTree dispatch on multiple library shapes (video, movie, audiobook, podcast) without proliferating boolean flags. Behavior for existing video and movie libraries is unchanged; audiobook and podcast modes will be consumed by the upcoming audiobook.go and podcast.go parsers in later tasks of this sub-plan. walkModeFor() derives the mode from a media_folders.type string; unknown types default to walkModeVideo to preserve prior behavior for any caller still passing a raw type. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(audiobooks): expose ffprobe format tags on ProbeData The audiobook scanner needs format-level tags (title, artist, album, date) for media_items metadata; ffprobe already parses them in ffprobeFormat.Tags but ProbeData previously discarded them. Add FormatTags map[string]string to ProbeData, populate it in convertProbeData via a new normalizeFormatTags helper that lowercases keys and trims values. Adds a fixture audiobook .m4b with embedded chapters (Intro/Outro) and format tags, and a test that verifies ProbeFile() returns both correctly. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(audiobooks): parser for single-file audiobook folders parseAudiobookFolder reads tags + chapters via the existing ProbeFile (now that Task 5 exposes FormatTags on ProbeData) and produces a parsedAudiobook struct. Title falls back from "title" tag to "album"; author from "artist" -> "album_artist" -> "composer"; series from "album" -> "series" -> "mvnm" (Movement Name, used by some MP4 tools). Year parsed from "date" or "year" tags, tolerating ISO dates and parenthesized forms. Single-file case only; multi-file folders (one audio file per chapter) return a placeholder error and arrive in Task 7. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(audiobooks): multi-file audiobook folder support Folders containing N audio files (one per chapter/part) get one parsedAudiobookFile per file; each file's chapter list is synthesized as a single chapter with title = filename stem. Title/author/series/ year come from the first file's tags. Also drops the duplicate pickFirstNonEmpty helper added in Task 6 in favor of the existing firstNonEmpty already in probe.go. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(audiobooks): scanner write path produces audiobook media_items ScanAudiobookFolder walks an audiobooks-typed media folder and treats each immediate subdirectory as one audiobook. For each parsed audiobook it upserts: - one media_items row with type='audiobook' - one media_files row per audio file (with chapters JSONB) - author/narrator links in item_people (kind=7, kind=8) Adds itemRepo and personRepo to the Scanner struct, wired from fileRepo.Pool() in NewScanner — no constructor signature change needed. ScanFolder dispatches to this path when folder.Type='audiobooks', bypassing the per-file movie/TV pipeline because audiobooks are folder-scoped entities. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(audiobooks): filesystem podcast scanner ScanPodcastFolder walks a podcasts-typed media folder, treating each subdirectory as a podcast show and each audio file inside as an episode. Writes media_items.type='podcast' + episodes rows + media_files rows. RSS-subscribed feeds (podcast_feeds table) arrive in sub-plan 5; this task covers filesystem-only ingestion. ScanFolder dispatches to this path when folder.Type='podcasts'. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * docs(audiobooks): implementation plan sub-plan 5 (podcasts) Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(audiobooks): expose audiobooks/podcasts library types in admin UI Adds 'Audiobooks' and 'Podcasts' options to the library-type dropdown in the admin libraries page so operators can flag a folder as an audiobook or podcast library. Extends contentLevelsForType() so the admin UI's downstream filtering treats those types correctly (audiobook -> ['audiobook'], podcasts -> ['podcast', 'podcast_episode']). Backend scanner branches for these types were already wired in sub-plan 2. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * chore(migrations): renumber 139_abs_sessions to 147 for origin/main merge origin/main adds 139_media_requests at the same number our local audiobook branch had used for abs_sessions. Renumber ours to 147 to free up 139 for the upstream migration. The schema_versions row is updated in lockstep on the running database so the migrator sees the abs_sessions migration as already applied at its new version. Migrations 140-146 (podcast feeds, media_folders kind noop, audiobook feature flag, abs playback sessions, podcast episode guid, audiobook series, audiobook title cleanup) stay where they are — they don't collide with anything on origin/main. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * chore(migrations): renumber 140_podcast_feeds to 157 for origin/main merge origin/main added 140_user_permissions at the same version this branch had used for podcast_feeds. Renumber ours to 157 (next free above the collections-unify migration at 156) so 140 is free for the upstream migration. schema_versions on the running database is updated in lockstep so the migrator sees podcast_feeds as already applied at its new version. Same pattern asd59c1cb(renumber 139_abs_sessions to 147 for the prior main merge). Pending migrations after this rename: 132 (downloaded subtitles admin index, main), 140 (user_permissions, main), and 156 (unify_user_collections, this branch). Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * chore(migrations): renumber 141_media_folders_kind_noop to 159 for origin/main merge Same shape aseb8f67d(the 140→157 renumber from the previous main merge). origin/main added 141_episode_title_sort_index at the same version this branch had used for media_folders_kind_noop. Renumber ours to 159 (next free above the audiobook_series truncate at 158) so 141 is open for the upstream migration. schema_versions on the running database is updated in lockstep so the migrator sees media_folders_kind_noop as already applied at its new version. Pending migrations on silo-prod after this rename: 141 (episode_title_sort_index, main) and any other newer ones from main that the branch hasn't picked up yet. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * chore(migrations): renumber 142_audiobooks_feature_flag to 160 for origin/main merge Companion to 3c6f062's 141 renumber — origin/main also added 142_episode_catalog_entries (alongside 141_episode_title_sort_index) at a version this branch had used for the audiobooks feature flag. Renumber ours to 160 so 142 is open for the upstream migration; schema_versions on silo-prod is updated in lockstep so the migrator sees audiobooks_feature_flag as already applied at its new version. This was the only remaining collision (verified by checking for duplicate version prefixes across migrations/). Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * fix(audiobooks): address foundation review comments * fix(audiobooks): tighten scanner identity handling * fix(audiobooks): propagate scanner cancellation * chore(audiobooks): adopt goose migration layout * docs(audiobooks): implementation plan sub-plan 3 (API + frontend MVP) Third of six sub-plans. 9 tasks: three REST endpoints (list/detail/ progress), TanStack Query hooks + types, three React pages (Library/Detail/Player), and navigation integration. Scoped to MVP — author/series indices, smart collections, share links, and other nice-to-haves from the spec are deferred. Streaming reuses silo's existing /api/v1/stream/{session_id}; no new transcode code. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(audiobooks): list endpoint at GET /api/v1/audiobooks Paginated list of media_items with type='audiobook' scoped to the caller's accessible libraries via the existing access filter. Mirrors silo's existing list-style handlers for movies and series. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(audiobooks): detail endpoint at GET /api/v1/audiobooks/{id} Returns the media_items row, its media_files (with chapters JSONB), author/narrator extracted from item_people (kinds 7/8), and the caller's per-profile listening progress from user_watch_progress. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(audiobooks): progress endpoint at POST /api/v1/audiobooks/{id}/progress UPSERTs user_watch_progress for the caller's (user_id, profile_id, content_id). Body carries position_seconds; clients are expected to post every 5-10s during playback plus on pause/seek (matching silo's existing video progress cadence). Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(audiobooks): frontend types and TanStack Query hooks TypeScript types match the JSON shapes from the new /api/v1/audiobooks endpoints (list, detail, progress). Three hooks: useAudiobookLibrary (list), useAudiobook (detail), and useReportAudiobookProgress (mutation that invalidates the detail query on success so progress updates reflect immediately). Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(audiobooks): library grid page at /audiobooks Renders a paginated grid of audiobook cards using the useAudiobookLibrary hook. Each card links to /audiobooks/book/{id}. Cards show poster, title, and year; falls back to a "No cover" placeholder when the audiobook has no poster_url. Empty state hints to operators that they need to set a library's type to 'audiobooks'. Routes themselves are wired in Task 8 (navigation integration). Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(audiobooks): detail page with chapter list Renders cover, title, author, narrator, year, and overview alongside a chapter list. Clicking a chapter opens an inline sticky AudiobookPlayer at that chapter's start. A "Resume" button restarts playback at the saved progress position if present. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(audiobooks): HTML5 audio player with chapter navigation Single-file audiobook playback for MVP. Multi-file queuing arrives in a follow-up. Streams via the existing /api/v1/direct-download GET endpoint. Position is reported to /api/v1/audiobooks/{id}/progress every 10s while playing plus on pause/seek/end. Skip-30s, playback rate select, chapter list panel. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * feat(audiobooks): wire navigation and routes Adds an Audiobooks entry to the sidebar and registers the two new routes (/audiobooks for the library grid, /audiobooks/book/:id for detail). The player renders inline inside the detail page; no dedicated player route is required for MVP. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> * fix(audiobooks): address native API review comments * feat(audiobooks): add ABS compatibility and polish * fix(audiobooks): stabilize ABS playback progress reporting * fix(audiobooks): clean up ABS branch review fixes * chore(audiobooks): adopt goose layout for ABS migrations * fix(audiobooks): align player seek bar props * feat(audiobooks): make libraries first-class catalog items * feat(admin): add server restart endpoint * fix(audiobooks): address review comment findings --------- Co-authored-by: RXWatcher <14085001+RXWatcher@users.noreply.github.com> Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
467 lines
18 KiB
Go
467 lines
18 KiB
Go
package config
|
|
|
|
import (
|
|
"errors"
|
|
"fmt"
|
|
"regexp"
|
|
"sort"
|
|
"strconv"
|
|
"strings"
|
|
"time"
|
|
|
|
"github.com/google/uuid"
|
|
)
|
|
|
|
// ServerConfig holds HTTP server settings.
|
|
type ServerConfig struct {
|
|
Listen string `yaml:"listen"`
|
|
Mode string `yaml:"mode"`
|
|
LogLevel string `yaml:"log_level"`
|
|
LogFormat string `yaml:"log_format"`
|
|
LogQuiet string `yaml:"log_quiet"`
|
|
}
|
|
|
|
// DatabaseConfig holds the primary PostgreSQL connection settings.
|
|
type DatabaseConfig struct {
|
|
URL string `yaml:"url"`
|
|
MaxConnections int `yaml:"max_connections"`
|
|
}
|
|
|
|
// S3BucketSettings holds the common configuration needed to access a bucket.
|
|
type S3BucketSettings struct {
|
|
Endpoint string `yaml:"-"`
|
|
Region string `yaml:"-"`
|
|
PathStyle bool `yaml:"-"`
|
|
Bucket string `yaml:"-"`
|
|
KeyPrefix string `yaml:"-"`
|
|
AccessKey string `yaml:"-"`
|
|
SecretKey string `yaml:"-"`
|
|
}
|
|
|
|
// S3PublicAssetsSettings holds client-facing asset storage configuration.
|
|
// The bucket may still be private when URLAuth is set to presigned.
|
|
type S3PublicAssetsSettings struct {
|
|
S3BucketSettings
|
|
ReadEndpoint string `yaml:"-"` // custom domain / public read endpoint for public or tokenized reads
|
|
URLAuth string `yaml:"-"` // "presigned" (default), "public", or "cloudflare_token"
|
|
TokenSecret string `yaml:"-"` // HMAC secret for cloudflare_token auth
|
|
TokenParam string `yaml:"-"` // query param name (default: "verify")
|
|
TokenTTL int `yaml:"-"` // token lifetime in seconds (default: 10800)
|
|
}
|
|
|
|
// S3Config holds S3-compatible object storage settings.
|
|
type S3Config struct {
|
|
Public S3PublicAssetsSettings `yaml:"-"`
|
|
Private S3BucketSettings `yaml:"-"`
|
|
UserDB S3BucketSettings `yaml:"-"`
|
|
MetadataPresignExpiry time.Duration `yaml:"-"`
|
|
}
|
|
|
|
// s3ConfigRaw is the raw YAML representation with duration strings.
|
|
type s3ConfigRaw struct {
|
|
// Public assets
|
|
PublicEndpoint string `yaml:"public_endpoint"`
|
|
PublicReadEndpoint string `yaml:"public_read_endpoint"`
|
|
PublicRegion string `yaml:"public_region"`
|
|
PublicPathStyle bool `yaml:"public_path_style"`
|
|
PublicBucket string `yaml:"public_bucket"`
|
|
PublicKeyPrefix string `yaml:"public_key_prefix"`
|
|
PublicAccessKey string `yaml:"public_access_key"`
|
|
PublicSecretKey string `yaml:"public_secret_key"`
|
|
PublicURLAuth string `yaml:"public_url_auth"`
|
|
PublicTokenSecret string `yaml:"public_token_secret"`
|
|
PublicTokenParam string `yaml:"public_token_param"`
|
|
PublicTokenTTL int `yaml:"public_token_ttl"`
|
|
MetadataPresignExpiry string `yaml:"metadata_presign_expiry"`
|
|
|
|
// Private internal
|
|
PrivateEndpoint string `yaml:"private_endpoint"`
|
|
PrivateRegion string `yaml:"private_region"`
|
|
PrivatePathStyle bool `yaml:"private_path_style"`
|
|
PrivateBucket string `yaml:"private_bucket"`
|
|
PrivateKeyPrefix string `yaml:"private_key_prefix"`
|
|
PrivateAccessKey string `yaml:"private_access_key"`
|
|
PrivateSecretKey string `yaml:"private_secret_key"`
|
|
|
|
// Legacy operational aliases retained for YAML import compatibility.
|
|
OperationalEndpoint string `yaml:"operational_endpoint"`
|
|
OperationalPublicEndpoint string `yaml:"operational_public_endpoint"`
|
|
OperationalRegion string `yaml:"operational_region"`
|
|
OperationalPathStyle bool `yaml:"operational_path_style"`
|
|
OperationalBucket string `yaml:"operational_bucket"`
|
|
OperationalKeyPrefix string `yaml:"operational_key_prefix"`
|
|
OperationalAccessKey string `yaml:"operational_access_key"`
|
|
OperationalSecretKey string `yaml:"operational_secret_key"`
|
|
OperationalURLAuth string `yaml:"operational_url_auth"`
|
|
OperationalTokenSecret string `yaml:"operational_token_secret"`
|
|
OperationalTokenParam string `yaml:"operational_token_param"`
|
|
OperationalTokenTTL int `yaml:"operational_token_ttl"`
|
|
|
|
// User DB
|
|
UserDBEndpoint string `yaml:"user_db_endpoint"`
|
|
UserDBRegion string `yaml:"user_db_region"`
|
|
UserDBPathStyle bool `yaml:"user_db_path_style"`
|
|
UserDBBucket string `yaml:"user_db_bucket"`
|
|
UserDBKeyPrefix string `yaml:"user_db_key_prefix"`
|
|
UserDBAccessKey string `yaml:"user_db_access_key"`
|
|
UserDBSecretKey string `yaml:"user_db_secret_key"`
|
|
}
|
|
|
|
// UserDBConfig holds per-user database pool settings.
|
|
type UserDBConfig struct {
|
|
Backend string `yaml:"backend"` // "postgres" (default) or "sqlite"
|
|
PoolMaxOpen int `yaml:"pool_max_open"`
|
|
IdleTimeout time.Duration `yaml:"-"`
|
|
LitestreamSync time.Duration `yaml:"-"`
|
|
StaleGraceSeconds int `yaml:"stale_grace_seconds"`
|
|
}
|
|
|
|
// userDBConfigRaw is the raw YAML representation with duration strings.
|
|
type userDBConfigRaw struct {
|
|
Backend string `yaml:"backend"`
|
|
PoolMaxOpen int `yaml:"pool_max_open"`
|
|
IdleTimeout string `yaml:"idle_timeout"`
|
|
LitestreamSync string `yaml:"litestream_sync"`
|
|
StaleGraceSeconds int `yaml:"stale_grace_seconds"`
|
|
}
|
|
|
|
// ScannerConfig holds media scanner settings.
|
|
type ScannerConfig struct {
|
|
FileRemovalGrace time.Duration `yaml:"-"`
|
|
Workers int `yaml:"workers"`
|
|
MaxConcurrentLibraries int `yaml:"max_concurrent_libraries"`
|
|
MaxConcurrentScoped int `yaml:"max_concurrent_scoped"`
|
|
EmptyTrashAfterScan bool `yaml:"-"`
|
|
}
|
|
|
|
// scannerConfigRaw is the raw YAML representation with duration strings.
|
|
type scannerConfigRaw struct {
|
|
FileRemovalGrace string `yaml:"file_removal_grace"`
|
|
Workers int `yaml:"workers"`
|
|
MaxConcurrentLibraries int `yaml:"max_concurrent_libraries"`
|
|
MaxConcurrentScoped int `yaml:"max_concurrent_scoped"`
|
|
EmptyTrashAfterScan bool `yaml:"empty_trash_after_scan"`
|
|
}
|
|
|
|
// MatcherConfig holds metadata matching settings.
|
|
type MatcherConfig struct {
|
|
Workers int `yaml:"workers"`
|
|
BatchSize int `yaml:"batch_size"`
|
|
EnableTVSeriesRootQueue bool `yaml:"enable_tv_series_root_queue"`
|
|
EnableTVSeriesGroupQueueLegacy bool `yaml:"enable_tv_series_group_queue"`
|
|
}
|
|
|
|
func (c MatcherConfig) TVSeriesRootQueueEnabled() bool {
|
|
return c.EnableTVSeriesRootQueue || c.EnableTVSeriesGroupQueueLegacy
|
|
}
|
|
|
|
// PlaybackConfig holds transcoding and playback settings.
|
|
type PlaybackConfig struct {
|
|
FFmpegPath string `yaml:"ffmpeg_path"`
|
|
TranscodeDir string `yaml:"transcode_dir"`
|
|
HWAccel string `yaml:"hw_accel"`
|
|
HWDevice string `yaml:"hw_device"`
|
|
ChapterThumbnailWorkers int `yaml:"chapter_thumbnail_workers"`
|
|
ChapterThumbnailExecution string `yaml:"chapter_thumbnail_execution"`
|
|
ChapterThumbnailNodeCapacity int `yaml:"chapter_thumbnail_node_capacity"`
|
|
TranscodeEnabled bool `yaml:"transcode_enabled"`
|
|
AllowHEVCEncoding bool `yaml:"allow_hevc_encoding"`
|
|
TranscodeAheadSegments int `yaml:"transcode_ahead_segments"`
|
|
SegmentDuration int `yaml:"segment_duration"`
|
|
}
|
|
|
|
// RedisConfig holds Redis connection settings.
|
|
type RedisConfig struct {
|
|
URL string `yaml:"url"`
|
|
SentinelMaster string `yaml:"sentinel_master"`
|
|
SentinelAddresses []string `yaml:"sentinel_addresses"`
|
|
SentinelPassword string `yaml:"sentinel_password"`
|
|
}
|
|
|
|
// RateLimitConfig holds rate limiting infrastructure settings.
|
|
type RateLimitConfig struct {
|
|
Enabled bool `yaml:"enabled"`
|
|
Backend string `yaml:"backend"` // "memory" or "redis"
|
|
}
|
|
|
|
// AuthConfig holds authentication and token settings.
|
|
type AuthConfig struct {
|
|
JWTSecret string `yaml:"jwt_secret"`
|
|
AccessTokenExpiry time.Duration `yaml:"-"`
|
|
RefreshTokenExpiry time.Duration `yaml:"-"`
|
|
}
|
|
|
|
// authConfigRaw is the raw YAML representation with duration strings.
|
|
type authConfigRaw struct {
|
|
JWTSecret string `yaml:"jwt_secret"`
|
|
AccessTokenExpiry string `yaml:"access_token_expiry"`
|
|
RefreshTokenExpiry string `yaml:"refresh_token_expiry"`
|
|
}
|
|
|
|
// AudiobookshelfCompatConfig holds the dedicated ABS-compat listener setting.
|
|
// The listener binds its own port (:13378, ABS's
|
|
// conventional port) and serves the full ABS protocol — login, libraries,
|
|
// items, sessions — without colliding with silo's SPA on the main listener.
|
|
type AudiobookshelfCompatConfig struct {
|
|
Listen string `yaml:"-"`
|
|
}
|
|
|
|
// JellyfinCompatConfig holds compatibility proxy settings.
|
|
type JellyfinCompatConfig struct {
|
|
Listen string `yaml:"listen"`
|
|
PublicURL string `yaml:"public_url"`
|
|
EmulatedServerVersion string `yaml:"emulated_server_version"`
|
|
ServerID string `yaml:"server_id"`
|
|
ServerName string `yaml:"server_name"`
|
|
WebVersion string `yaml:"web_version"`
|
|
WebDir string `yaml:"web_dir"`
|
|
SessionTTL time.Duration `yaml:"-"`
|
|
PlaybackSessionTTL time.Duration `yaml:"-"`
|
|
}
|
|
|
|
// jellyfinCompatConfigRaw is the raw YAML representation with duration strings.
|
|
type jellyfinCompatConfigRaw struct {
|
|
Listen string `yaml:"listen"`
|
|
PublicURL string `yaml:"public_url"`
|
|
EmulatedServerVersion string `yaml:"emulated_server_version"`
|
|
ServerID string `yaml:"server_id"`
|
|
ServerName string `yaml:"server_name"`
|
|
WebVersion string `yaml:"web_version"`
|
|
WebDir string `yaml:"web_dir"`
|
|
SessionTTL string `yaml:"session_ttl"`
|
|
PlaybackSessionTTL string `yaml:"playback_session_ttl"`
|
|
}
|
|
|
|
// RecommendationsConfig holds AI recommendation engine settings.
|
|
type RecommendationsConfig struct {
|
|
Enabled bool `yaml:"-"`
|
|
EmbeddingBaseURL string `yaml:"-"`
|
|
EmbeddingModel string `yaml:"-"`
|
|
EmbeddingAuthToken string `yaml:"-"`
|
|
EmbeddingsCron string `yaml:"-"`
|
|
TasteProfilesCron string `yaml:"-"`
|
|
RecommendationsCron string `yaml:"-"`
|
|
TasteDecayHalfLifeDays float64 `yaml:"-"`
|
|
DiversityLambda float64 `yaml:"-"`
|
|
CowatchCron string `yaml:"-"`
|
|
}
|
|
|
|
// SubtitleAIConfig holds settings for on-demand AI subtitle translation (and,
|
|
// in a follow-up, Whisper ASR generation) via a single OpenAI-compatible
|
|
// endpoint — the operator can point it at OpenAI, Groq, a local Ollama server,
|
|
// etc. Mirrors the recommendations embedding client's configuration style.
|
|
type SubtitleAIConfig struct {
|
|
Enabled bool `yaml:"-"`
|
|
BaseURL string `yaml:"-"`
|
|
APIKey string `yaml:"-"`
|
|
ChatModel string `yaml:"-"`
|
|
MaxConcurrentJobs int `yaml:"-"`
|
|
BatchSize int `yaml:"-"`
|
|
ContextNeighbors int `yaml:"-"`
|
|
}
|
|
|
|
// DownloadConfig holds server-wide download policy settings.
|
|
type DownloadConfig struct {
|
|
Enabled bool `yaml:"-"`
|
|
ServerBandwidthBPS int64 `yaml:"-"` // server-wide bytes/sec cap (0 = unlimited)
|
|
UserBandwidthBPS int64 `yaml:"-"` // per-user bytes/sec across all their downloads (0 = unlimited)
|
|
MaxConcurrentPerUser int `yaml:"-"` // max simultaneous downloads per user (0 = unlimited)
|
|
MaxPerPeriod int `yaml:"-"` // max downloads per user per period (0 = unlimited)
|
|
PeriodDuration time.Duration `yaml:"-"` // rolling window for MaxPerPeriod
|
|
}
|
|
|
|
// MetadataConfig holds metadata pipeline settings.
|
|
type MetadataConfig struct {
|
|
CacheImages bool `yaml:"-"`
|
|
}
|
|
|
|
// Config is the top-level configuration for Silo.
|
|
type Config struct {
|
|
Server ServerConfig `yaml:"server"`
|
|
Database DatabaseConfig `yaml:"database"`
|
|
S3 S3Config `yaml:"-"`
|
|
UserDB UserDBConfig `yaml:"-"`
|
|
Scanner ScannerConfig `yaml:"-"`
|
|
Matcher MatcherConfig `yaml:"matcher"`
|
|
Metadata MetadataConfig `yaml:"-"`
|
|
Playback PlaybackConfig `yaml:"playback"`
|
|
Redis RedisConfig `yaml:"redis"`
|
|
RateLimit RateLimitConfig `yaml:"rate_limiting"`
|
|
Auth AuthConfig `yaml:"-"`
|
|
JellyfinCompat JellyfinCompatConfig `yaml:"-"`
|
|
AudiobookshelfCompat AudiobookshelfCompatConfig `yaml:"-"`
|
|
Recommendations RecommendationsConfig `yaml:"-"`
|
|
SubtitleAI SubtitleAIConfig `yaml:"-"`
|
|
Download DownloadConfig `yaml:"-"`
|
|
TMDBAPIKey string `yaml:"-"`
|
|
MDBListAPIKey string `yaml:"-"`
|
|
}
|
|
|
|
// configRaw is used for initial YAML unmarshaling with string durations.
|
|
type configRaw struct {
|
|
Server ServerConfig `yaml:"server"`
|
|
Database DatabaseConfig `yaml:"database"`
|
|
S3 s3ConfigRaw `yaml:"s3"`
|
|
UserDB userDBConfigRaw `yaml:"user_db"`
|
|
Scanner scannerConfigRaw `yaml:"scanner"`
|
|
Matcher MatcherConfig `yaml:"matcher"`
|
|
Playback PlaybackConfig `yaml:"playback"`
|
|
Redis RedisConfig `yaml:"redis"`
|
|
RateLimit RateLimitConfig `yaml:"rate_limiting"`
|
|
Auth authConfigRaw `yaml:"auth"`
|
|
JellyfinCompat jellyfinCompatConfigRaw `yaml:"jellyfin_compat"`
|
|
}
|
|
|
|
var validModes = map[string]bool{
|
|
"integrated": true,
|
|
"api": true,
|
|
"proxy": true,
|
|
"transcode": true,
|
|
"frontend": true,
|
|
}
|
|
|
|
// dayRegexp matches duration strings with "d" suffix (e.g., "30d").
|
|
var dayRegexp = regexp.MustCompile(`^(\d+)d$`)
|
|
|
|
var defaultJellyfinCompatServerID = uuid.NewSHA1(
|
|
uuid.NameSpaceURL,
|
|
[]byte("https://silo.local/jellycompat"),
|
|
).String()
|
|
|
|
const DefaultJellyfinWebVersion = "10.11.6"
|
|
const DefaultBundledJellyfinWebDir = "/srv/jellyfin-web/current"
|
|
|
|
// parseDuration parses a duration string that supports Go's time.ParseDuration
|
|
// formats plus a custom "Nd" format for days.
|
|
func parseDuration(s string) (time.Duration, error) {
|
|
if s == "" {
|
|
return 0, fmt.Errorf("empty duration string")
|
|
}
|
|
|
|
// Check for day format first (e.g., "30d")
|
|
if matches := dayRegexp.FindStringSubmatch(s); matches != nil {
|
|
days, err := strconv.Atoi(matches[1])
|
|
if err != nil {
|
|
return 0, fmt.Errorf("invalid day duration %q: %w", s, err)
|
|
}
|
|
return time.Duration(days) * 24 * time.Hour, nil
|
|
}
|
|
|
|
// Fall back to standard Go duration parsing
|
|
d, err := time.ParseDuration(s)
|
|
if err != nil {
|
|
return 0, fmt.Errorf("invalid duration %q: %w", s, err)
|
|
}
|
|
return d, nil
|
|
}
|
|
|
|
// setDefaults returns a configRaw with all default values populated.
|
|
func setDefaults() *configRaw {
|
|
return &configRaw{
|
|
Server: ServerConfig{
|
|
Listen: ":8080",
|
|
Mode: "integrated",
|
|
LogLevel: "info",
|
|
LogFormat: "text",
|
|
},
|
|
Database: DatabaseConfig{
|
|
MaxConnections: 20,
|
|
},
|
|
S3: s3ConfigRaw{
|
|
PublicPathStyle: true,
|
|
PrivatePathStyle: true,
|
|
OperationalPathStyle: true,
|
|
UserDBPathStyle: true,
|
|
MetadataPresignExpiry: "4h",
|
|
},
|
|
UserDB: userDBConfigRaw{
|
|
Backend: "postgres",
|
|
PoolMaxOpen: 500,
|
|
IdleTimeout: "12h",
|
|
LitestreamSync: "1s",
|
|
StaleGraceSeconds: 120,
|
|
},
|
|
Scanner: scannerConfigRaw{
|
|
FileRemovalGrace: "24h",
|
|
Workers: 8,
|
|
MaxConcurrentLibraries: 1,
|
|
MaxConcurrentScoped: 2,
|
|
},
|
|
Matcher: MatcherConfig{
|
|
Workers: 8,
|
|
BatchSize: 500,
|
|
EnableTVSeriesRootQueue: true,
|
|
},
|
|
Playback: PlaybackConfig{
|
|
FFmpegPath: "/usr/lib/jellyfin-ffmpeg/ffmpeg",
|
|
TranscodeDir: "/tmp/silo-transcode",
|
|
HWAccel: "auto",
|
|
ChapterThumbnailWorkers: 1,
|
|
ChapterThumbnailExecution: "local",
|
|
ChapterThumbnailNodeCapacity: 1,
|
|
TranscodeEnabled: true,
|
|
AllowHEVCEncoding: false,
|
|
TranscodeAheadSegments: 30,
|
|
SegmentDuration: 6,
|
|
},
|
|
RateLimit: RateLimitConfig{
|
|
Enabled: true,
|
|
Backend: "memory",
|
|
},
|
|
Auth: authConfigRaw{
|
|
AccessTokenExpiry: "8h",
|
|
RefreshTokenExpiry: "30d",
|
|
},
|
|
JellyfinCompat: jellyfinCompatConfigRaw{
|
|
Listen: ":8097",
|
|
PublicURL: "http://127.0.0.1:8097",
|
|
EmulatedServerVersion: "10.12.0",
|
|
ServerID: defaultJellyfinCompatServerID,
|
|
ServerName: "Silo",
|
|
WebVersion: DefaultJellyfinWebVersion,
|
|
WebDir: DefaultBundledJellyfinWebDir,
|
|
SessionTTL: "87600h",
|
|
PlaybackSessionTTL: "6h",
|
|
},
|
|
}
|
|
}
|
|
|
|
// Validate checks that all required fields are set and values are valid.
|
|
func (c *Config) Validate() error {
|
|
var errs []string
|
|
|
|
if c.Server.Mode == "" || !validModes[c.Server.Mode] {
|
|
errs = append(errs, fmt.Sprintf("server.mode %q is invalid; must be one of: %s",
|
|
c.Server.Mode, strings.Join(validModesList(), ", ")))
|
|
}
|
|
|
|
// Database required for integrated, api, proxy, and transcode modes.
|
|
needsDB := c.Server.Mode == "integrated" || c.Server.Mode == "api" ||
|
|
c.Server.Mode == "proxy" || c.Server.Mode == "transcode"
|
|
if needsDB && c.Database.URL == "" {
|
|
errs = append(errs, "database.url is required for "+c.Server.Mode+" mode")
|
|
}
|
|
|
|
// Redis required for proxy and transcode modes (URL or Sentinel).
|
|
needsRedis := c.Server.Mode == "proxy" || c.Server.Mode == "transcode"
|
|
hasRedis := c.Redis.URL != "" || (c.Redis.SentinelMaster != "" && len(c.Redis.SentinelAddresses) > 0)
|
|
if needsRedis && !hasRedis {
|
|
errs = append(errs, "redis.url or redis sentinel config is required for "+c.Server.Mode+" mode")
|
|
}
|
|
|
|
if len(errs) > 0 {
|
|
return errors.New(strings.Join(errs, "; "))
|
|
}
|
|
return nil
|
|
}
|
|
|
|
// validModesList returns the valid modes as a sorted slice for error messages.
|
|
func validModesList() []string {
|
|
modes := make([]string, 0, len(validModes))
|
|
for m := range validModes {
|
|
modes = append(modes, m)
|
|
}
|
|
sort.Strings(modes)
|
|
return modes
|
|
}
|