libsocial-core API reference
import libsocial. Most users get these through ranobelib or mangalib, which re-export
the models and exceptions — see libsocial-core.
Building blocks
libsocial.Site
dataclass
Site(id: int, origin: str)
One lib.social site, as the shared api.cdnlibs.org API tells them apart.
The core knows no site by itself: each site package defines its own (ranobelib.me is
Site(id=3, origin="https://ranobelib.me"), mangalib.me id=1) and passes it in.
Attributes:
| Name | Type | Description |
|---|---|---|
id |
int
|
The site's id — sent as the |
origin |
str
|
The site's web origin, e.g. |
libsocial.TitleClient
TitleClient(
url: str,
*,
cache_dir: str | Path | None = None,
cache_ttl: float | None = None,
verbosity: Verbosity = False,
headers: Mapping[str, str] | None = None,
)
Bases: Generic[TitleT, ChapterT, VolumeT]
One title on one lib.social site: metadata, chapters, translations, bulk download.
Not used directly: a site package subclasses it, setting the class attributes below — which site it talks to, and which models a title, a chapter (with the site's own content fields) and a volume are validated as — and adds whatever is specific to the site's content (export, size estimates, ...).
Example
class RanobeLib(TitleClient[Title, Chapter, Volume]):
site = Site(id=3, origin="https://ranobelib.me")
title_model = Title
chapter_model = Chapter
volume_model = Volume
async with RanobeLib("https://ranobelib.me/ru/book/6712--high-school-dxd-novel") as lib:
info = await lib.get_info()
Attributes:
| Name | Type | Description |
|---|---|---|
site |
Site
|
The site the title is on. Set by the subclass. |
title_model |
type[TitleT]
|
The model |
chapter_model |
type[ChapterT]
|
The model chapters are validated as — both table-of-contents entries and fetched chapters, so its content fields must be optional. Set by the subclass. |
volume_model |
type[VolumeT]
|
The model chapters are grouped into, |
default_cache_dir |
Path
|
|
info_fields |
tuple[str, ...]
|
Extra |
Initialize the client for a title.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
url
|
str
|
The title's URL on the site, or a bare |
required |
cache_dir
|
str | Path | None
|
Where to cache raw API responses (title metadata, chapter list,
chapter content) on disk, so a repeated export or downloading newly added
chapters doesn't re-fetch data already on hand. Defaults to
|
None
|
cache_ttl
|
float | None
|
Seconds after which a cached response is treated as stale and
re-fetched. |
None
|
verbosity
|
Verbosity
|
Console output level. |
False
|
headers
|
Mapping[str, str] | None
|
Extra HTTP headers merged over the SDK's defaults (browser-like
|
None
|
Source code in packages/core/src/libsocial/title.py
109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 | |
slug_url
property
slug_url: str
The title's {id}--{slug} identifier.
aclose
async
aclose() -> None
Close the underlying HTTP client.
Source code in packages/core/src/libsocial/title.py
173 174 175 | |
download_title
async
download_title(
*,
branch_id: int | None = None,
translation_index: int | None = None,
chapter_delay: float = 0.0,
on_chapter: Callable[[int, int], None] | None = None,
max_rate_limit_retries: int = DEFAULT_RATE_LIMIT_RETRIES,
) -> list[VolumeT]
Download every chapter of the title, across all its volumes.
Fetches the chapter list once, then every chapter's content, sequentially, in the
API's own order — same pacing/retry/backoff as any other chapter fetch (see
ApiClient), plus chapter_delay on top if given.
Resolving translations is checked for the whole title up front, not chapter by
chapter: if any chapters have more than one translation, this fetches nothing and
raises MultipleTitleTranslationsError listing all of them at once (unless
branch_id or translation_index resolves every one of them), rather than
failing partway through a long download on the first ambiguous chapter.
A long title's sequential download can outlast ApiClient's own retry budget for
429s (tuned for a single one-off request, not hundreds/thousands of sequential
fetches — see docs/api-notes.md). On top of that, each chapter fetch that still comes
back rate-limited is retried again here, up to max_rate_limit_retries times, with
its own (coarser) backoff. If a chapter fetch still fails after that — from rate
limiting or anything else — the chapters already downloaded are not discarded: they're
attached to a raised DownloadTitleInterruptedError instead of being lost.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
branch_id
|
int | None
|
Translation to use for every chapter that has more than one — same
meaning as |
None
|
translation_index
|
int | None
|
Alternative to |
None
|
chapter_delay
|
float
|
Extra delay, in seconds, after fetching each chapter, on top of
|
0.0
|
on_chapter
|
Callable[[int, int], None] | None
|
Called with |
None
|
max_rate_limit_retries
|
int
|
How many extra times to retry a single chapter fetch that
comes back rate-limited, on top of |
DEFAULT_RATE_LIMIT_RETRIES
|
Raises:
| Type | Description |
|---|---|
ValueError
|
If both |
MultipleTitleTranslationsError
|
If the title has one or more chapters with more
than one translation that |
DownloadTitleInterruptedError
|
If fetching a chapter fails unrecoverably partway through the download — carries every chapter already fetched. |
Source code in packages/core/src/libsocial/title.py
310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 | |
get_chapter
async
get_chapter(
volume: int,
number: str,
*,
branch_id: int | None = None,
refresh: bool = False,
) -> ChapterT
Fetch a single chapter, including its content.
When a chapter has more than one team's translation and branch_id isn't given,
this raises MultipleTranslationsError rather than guessing — see
get_translations() and docs/api-notes.md for why the API's own default (when
branch_id is omitted) isn't relied on. Doing this check costs an extra request
to fetch the chapter list, only when branch_id isn't already given.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
volume
|
int
|
The chapter's volume number. |
required |
number
|
str
|
The chapter number, as returned by the API — may contain a decimal
(e.g. |
required |
branch_id
|
int | None
|
Which translation to fetch, as returned by |
None
|
refresh
|
bool
|
Bypass the disk cache and re-fetch from the API even if a cached response is on hand. |
False
|
Raises:
| Type | Description |
|---|---|
MultipleTranslationsError
|
If the chapter has more than one translation and
|
Source code in packages/core/src/libsocial/title.py
199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 | |
get_chapters
async
get_chapters(
chapters: list[tuple[int, str]],
) -> list[ChapterT]
Fetch several chapters, including their content.
Fetches the chapter list once, shared across all requested chapters (also used to
detect chapters with more than one translation — see get_chapter), then each
chapter individually and sequentially, in the order given.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
chapters
|
list[tuple[int, str]]
|
A list of |
required |
Raises:
| Type | Description |
|---|---|
ChapterNotFoundError
|
If any requested chapter doesn't exist. |
MultipleTranslationsError
|
If any requested chapter has more than one translation. |
Source code in packages/core/src/libsocial/title.py
234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 | |
get_info
async
get_info(*, refresh: bool = False) -> TitleT
Fetch title metadata: names, cover, summary, genres, tags, authors, teams.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
refresh
|
bool
|
Bypass the disk cache and re-fetch from the API even if a cached response is on hand. |
False
|
Source code in packages/core/src/libsocial/title.py
177 178 179 180 181 182 183 184 185 | |
get_table_of_contents
async
get_table_of_contents(
*, refresh: bool = False
) -> list[VolumeT]
Fetch the title's volumes and chapter names/numbers, without chapter content.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
refresh
|
bool
|
Bypass the disk cache and re-fetch from the API even if a cached response is on hand — needed to pick up newly published chapters, since otherwise the cached chapter list would keep being reused. |
False
|
Source code in packages/core/src/libsocial/title.py
187 188 189 190 191 192 193 194 195 196 197 | |
get_translations
async
get_translations(
volume: int, number: str
) -> list[ChapterBranch]
Fetch the available translations (branches) for a chapter.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
volume
|
int
|
The chapter's volume number. |
required |
number
|
str
|
The chapter number. |
required |
Raises:
| Type | Description |
|---|---|
ChapterNotFoundError
|
If no chapter exists for this volume/number. |
Source code in packages/core/src/libsocial/title.py
257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 | |
get_volume
async
get_volume(volume: int) -> VolumeT
Fetch a whole volume: all its chapters, each including content.
The API has no bulk "volume content" endpoint (see docs/api-notes.md), so this fetches the chapter list once to find which numbers belong to the volume, then fetches each of those chapters individually and sequentially.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
volume
|
int
|
The volume number. |
required |
Raises:
| Type | Description |
|---|---|
VolumeNotFoundError
|
If the title has no chapters for this volume. |
MultipleTranslationsError
|
If any of the volume's chapters has more than one translation. |
Source code in packages/core/src/libsocial/title.py
274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 | |
get_volumes
async
get_volumes(volumes: list[int]) -> list[VolumeT]
Fetch several whole volumes, each including chapter content.
Fetches the chapter list once, shared across all requested volumes, then each
chapter individually and sequentially — same approach as get_volume, applied
to more than one volume without re-fetching the chapter list per volume.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
volumes
|
list[int]
|
The volume numbers to fetch. |
required |
Raises:
| Type | Description |
|---|---|
VolumeNotFoundError
|
If the title has no chapters for one of the volumes. |
MultipleTranslationsError
|
If any of the volumes' chapters has more than one translation. |
Source code in packages/core/src/libsocial/title.py
292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 | |
libsocial.Catalog
Catalog(
*,
cache_dir: str | Path | None = None,
cache_ttl: float | None = None,
headers: Mapping[str, str] | None = None,
)
Bases: Generic[TitleT]
Listing/searching one site's catalog.
Not used directly: a site package subclasses it, setting site and page_model
(and optionally default_cache_dir) as class attributes — so its own Catalog
keeps a plain constructor and returns its own page and Title models.
Example
class RanobeLibCatalog(Catalog[Title]):
site = Site(id=3, origin="https://ranobelib.me")
page_model = CatalogPage[Title]
async with RanobeLibCatalog() as catalog:
page = await catalog.list_titles(query="dxd", genres=[34], statuses=[1])
for title in page.items:
print(title.name)
Attributes:
| Name | Type | Description |
|---|---|---|
site |
Site
|
The site whose catalog is listed. Set by the subclass. |
page_model |
type[CatalogPage[TitleT]]
|
The model a listing page is validated as — |
default_cache_dir |
Path
|
|
Initialize the catalog client.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
cache_dir
|
str | Path | None
|
Where to cache raw API responses on disk, one entry per distinct set
of listing parameters (page/filters/sort) — same disk cache as
|
None
|
cache_ttl
|
float | None
|
Seconds after which a cached page is treated as stale and re-fetched.
|
None
|
headers
|
Mapping[str, str] | None
|
Extra HTTP headers merged over the SDK's defaults, same as
|
None
|
Source code in packages/core/src/libsocial/catalog.py
59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 | |
aclose
async
aclose() -> None
Close the underlying HTTP client.
Source code in packages/core/src/libsocial/catalog.py
103 104 105 | |
list_countries
async
list_countries(*, refresh: bool = False) -> list[Country]
Fetch the full list of catalog countries (id → name), for use as filter options
with list_titles(countries=...).
Mirrors list_genres() exactly, down to the network-wide, not-site-scoped shape
of the underlying endpoint (GET /api/constants?fields[]=types — the API's own
name for what this SDK calls "country" is "type", see docs/api-notes.md and
Country's docstring). This filters that down to entries tagged for site before
returning, same as list_genres() does for genres.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
refresh
|
bool
|
Bypass the disk cache and re-fetch from the API even if the country list was already cached. |
False
|
Returns:
| Type | Description |
|---|---|
list[Country]
|
Every |
Source code in packages/core/src/libsocial/catalog.py
254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 | |
list_genres
async
list_genres(*, refresh: bool = False) -> list[Genre]
Fetch the full list of catalog genres (id → name), for use as filter options
with list_titles(genres=[...]).
The underlying endpoint (GET /api/constants?fields[]=genres) has no site-scoping
parameter — it returns the full genre list shared across the whole lib.social
network in one shot, each tagged with the site ids it applies to (see
docs/api-notes.md). This filters that down to genres tagged for site before
returning, so callers don't get filter options that could never match any of the
site's titles (e.g. "Детское", tagged only for site 5, on ranobelib.me).
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
refresh
|
bool
|
Bypass the disk cache and re-fetch from the API even if the genre list was already cached. |
False
|
Returns:
| Type | Description |
|---|---|
list[Genre]
|
Every |
Source code in packages/core/src/libsocial/catalog.py
224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 | |
list_statuses
async
list_statuses(*, refresh: bool = False) -> list[Label]
Fetch the full list of title statuses (id → label), for use as filter options
with list_titles(statuses=...).
Mirrors list_genres()/list_countries(): the underlying endpoint
(GET /api/constants?fields[]=status) isn't site-scoped, so entries not tagged for
site are dropped before returning (see docs/api-notes.md). Returns the same
Label model as Title.status, so a title's status can be compared against
these directly.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
refresh
|
bool
|
Bypass the disk cache and re-fetch from the API even if the status list was already cached. |
False
|
Returns:
| Type | Description |
|---|---|
list[Label]
|
Every status ( |
Source code in packages/core/src/libsocial/catalog.py
281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 | |
list_titles
async
list_titles(
*,
page: int = 1,
per_page: int = 30,
query: str | None = None,
genres: list[int] | None = None,
tags: list[int] | None = None,
statuses: list[int] | None = None,
countries: list[int] | None = None,
min_chapters: int | None = None,
max_chapters: int | None = None,
sort: str = DEFAULT_SORT,
refresh: bool = False,
) -> CatalogPage[TitleT]
Fetch one page of catalog listing/search results.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
page
|
int
|
1-based page number. |
1
|
per_page
|
int
|
How many titles per page. Must be between |
30
|
query
|
str | None
|
Free-text search term, matched against name/rus_name/eng_name. |
None
|
genres
|
list[int] | None
|
Genre ids to filter by. A title must have all of them, not just one
(AND, not OR — see docs/api-notes.md). Not validated against |
None
|
tags
|
list[int] | None
|
|
None
|
statuses
|
list[int] | None
|
|
None
|
countries
|
list[int] | None
|
|
None
|
min_chapters
|
int | None
|
Only titles with at least this many chapters (inclusive). Counts
the same number as |
None
|
max_chapters
|
int | None
|
Only titles with at most this many chapters (inclusive). |
None
|
sort
|
str
|
Sort order. Despite the name, this is sent as the API's |
DEFAULT_SORT
|
refresh
|
bool
|
Bypass the disk cache and re-fetch from the API even if this exact combination of parameters was already cached. |
False
|
Returns:
| Type | Description |
|---|---|
CatalogPage[TitleT]
|
A |
Raises:
| Type | Description |
|---|---|
ValueError
|
If |
Source code in packages/core/src/libsocial/catalog.py
107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 | |
libsocial.ApiClient
ApiClient(
site: Site,
*,
base_url: str = API_BASE_URL,
timeout: float = 15.0,
transport: AsyncBaseTransport | None = None,
headers: Mapping[str, str] | None = None,
max_concurrency: int = 5,
request_delay: float | None = None,
max_retries: int = 3,
retry_base_delay: float = 1.0,
sleep: Callable[
[float], Awaitable[None]
] = asyncio.sleep,
pacer: Pacer | None = None,
)
Thin async wrapper around the undocumented api.cdnlibs.org JSON API, for one site.
The API is shared by the whole lib.social network; site scopes requests to one site
(Site-Id header, site_id[] on catalog listings — see docs/api-notes.md).
Bounds concurrency with a semaphore, paces request starts with a small fixed delay, and
retries 429/5xx responses with exponential backoff — see docs/api-notes.md for why a
manual implementation was chosen over a dependency like tenacity for this. Pacing is
shared, by default, with every other ApiClient in the process talking to the same
host (see Pacer), so clients for different sites don't add up their request rates.
Every request carries browser-like Origin/Referer/User-Agent headers on top
of the API-specific Site-Id/Accept: without a non-empty Referer, the
DDoS-Guard edge in front of the API answers every request with an HTML 403 page (see
docs/api-notes.md, section "WAF 403").
Attributes:
| Name | Type | Description |
|---|---|---|
headers_hint |
str
|
Where |
Initialize the client.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
site
|
Site
|
Which site the requests are made for — its |
required |
base_url
|
str
|
API base URL. |
API_BASE_URL
|
timeout
|
float
|
Per-request timeout, in seconds. |
15.0
|
transport
|
AsyncBaseTransport | None
|
Custom |
None
|
headers
|
Mapping[str, str] | None
|
Extra headers merged over the defaults (browser-like |
None
|
max_concurrency
|
int
|
Maximum number of requests in flight at once. |
5
|
request_delay
|
float | None
|
Minimum time, in seconds, between the start of one request and
the next, even under |
None
|
max_retries
|
int
|
How many times to retry a 429 or 5xx response before giving up and raising. |
3
|
retry_base_delay
|
float
|
Base delay, in seconds, for exponential backoff between
retries (doubled per attempt) — used unless a 429 response's
|
1.0
|
sleep
|
Callable[[float], Awaitable[None]]
|
Sleep function used for pacing and backoff. Overridable for tests. |
sleep
|
pacer
|
Pacer | None
|
Pacer to space request starts with. |
None
|
Source code in packages/core/src/libsocial/client.py
58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 | |
aclose
async
aclose() -> None
Close the underlying HTTP connection pool.
Source code in packages/core/src/libsocial/client.py
133 134 135 | |
get_chapter
async
get_chapter(
slug_url: str,
*,
number: str,
volume: str,
branch_id: int | None = None,
) -> dict[str, Any]
Fetch a single chapter's metadata and content.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
slug_url
|
str
|
The title's |
required |
number
|
str
|
The chapter number, as returned by the API (may contain a decimal). |
required |
volume
|
str
|
The volume number. |
required |
branch_id
|
int | None
|
Which translation team's branch to fetch, for chapters with more than one. Defaults to whichever branch the API picks (see docs/api-notes.md — this is not simply the first branch listed). |
None
|
Returns:
| Type | Description |
|---|---|
dict[str, Any]
|
The |
Source code in packages/core/src/libsocial/client.py
167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 | |
get_chapters
async
get_chapters(slug_url: str) -> list[dict[str, Any]]
Fetch the raw chapter list for slug_url (single request, no pagination).
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
slug_url
|
str
|
The title's |
required |
Returns:
| Type | Description |
|---|---|
list[dict[str, Any]]
|
The |
Source code in packages/core/src/libsocial/client.py
153 154 155 156 157 158 159 160 161 162 163 164 165 | |
get_title
async
get_title(
slug_url: str, *, fields: list[str] | None = None
) -> dict[str, Any]
Fetch raw title metadata for slug_url.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
slug_url
|
str
|
The title's |
required |
fields
|
list[str] | None
|
Extra |
None
|
Returns:
| Type | Description |
|---|---|
dict[str, Any]
|
The |
Source code in packages/core/src/libsocial/client.py
137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 | |
list_countries
async
list_countries() -> list[dict[str, Any]]
Fetch the raw country/type list shared across the whole lib.social network.
Same shape and caveats as list_genres: not site-scoped by any request parameter,
returns every "type" known to the network at once, each tagged with the site ids it
applies to via site_ids. Named list_countries/fields[]=types mismatch is
deliberate — see Catalog.list_countries and docs/api-notes.md for why this reuses
the API's own "type" concept rather than the unrelated fields[]=countries field.
Returns:
| Type | Description |
|---|---|
list[dict[str, Any]]
|
The raw |
Source code in packages/core/src/libsocial/client.py
293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 | |
list_genres
async
list_genres() -> list[dict[str, Any]]
Fetch the raw genre list shared across the whole lib.social network.
Unlike list_titles, this endpoint isn't site-scoped by any request parameter
(confirmed: a Site-Id header changes nothing about the response) — it returns
every genre known to the network at once, each tagged with the site ids it applies
to via a site_ids field. Callers must filter to their site themselves (see
Catalog.list_genres, which drops e.g. site-5-only genres like "Детское" when
listing for ranobelib.me).
Returns:
| Type | Description |
|---|---|
list[dict[str, Any]]
|
The raw |
Source code in packages/core/src/libsocial/client.py
275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 | |
list_statuses
async
list_statuses() -> list[dict[str, Any]]
Fetch the raw title status list shared across the whole lib.social network.
Same shape and caveats as list_genres: not site-scoped by any request parameter,
returns every status known to the network at once, each tagged with the site ids it
applies to via site_ids.
Returns:
| Type | Description |
|---|---|
list[dict[str, Any]]
|
The raw |
Source code in packages/core/src/libsocial/client.py
310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 | |
list_titles
async
list_titles(
*,
page: int,
per_page: int,
query: str | None,
genres: list[int] | None,
tags: list[int] | None,
statuses: list[int] | None,
countries: list[int] | None,
min_chapters: int | None,
max_chapters: int | None,
sort: str,
) -> dict[str, Any]
Fetch one page of the catalog listing/search results.
Unlike the other ApiClient methods, this returns the whole response body, not
just data — callers need meta.has_next_page too, and there's no total count
to derive it from otherwise (see docs/api-notes.md).
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
page
|
int
|
1-based page number. |
required |
per_page
|
int
|
Page size. The API only accepts |
required |
query
|
str | None
|
Free-text search term, matched against name/rus_name/eng_name. |
required |
genres
|
list[int] | None
|
Genre ids to filter by. A title must have all of them (AND, not OR — see docs/api-notes.md), not just any one. |
required |
tags
|
list[int] | None
|
Tag ids to filter by. Same AND semantics as |
required |
statuses
|
list[int] | None
|
|
required |
countries
|
list[int] | None
|
|
required |
min_chapters
|
int | None
|
Minimum chapter count, inclusive. Sent as |
required |
max_chapters
|
int | None
|
Maximum chapter count, inclusive. Sent as |
required |
sort
|
str
|
Forwarded as the API's |
required |
Returns:
| Type | Description |
|---|---|
dict[str, Any]
|
The full JSON response: |
Source code in packages/core/src/libsocial/client.py
198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 | |
libsocial.Pacer
Pacer(*, clock: Callable[[], float] = time.monotonic)
Spaces out request starts: each one at least its delay after the previous one.
Every ApiClient talking to the same host shares one Pacer by default (see
shared_pacer()), so two clients for different sites in one process — say ranobelib
and mangalib, both on api.cdnlibs.org — pace against each other instead of each sending
at its own full rate and doubling the load on the API between them.
Works by reservation: a caller takes the next free start slot under a plain
threading.Lock, held only for that bookkeeping and never across an await, then
sleeps until the slot outside of it. So a single Pacer is safe to share across event
loops and threads, which an asyncio.Lock (bound to the loop that first used it) is
not.
Initialize the pacer.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
clock
|
Callable[[], float]
|
Monotonic time source, in seconds. Overridable for tests. |
monotonic
|
Source code in packages/core/src/libsocial/pacing.py
25 26 27 28 29 30 31 32 33 | |
wait
async
wait(
delay: float,
*,
sleep: Callable[[float], Awaitable[None]],
) -> None
Wait for this request's start slot, and reserve delay seconds after it.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
delay
|
float
|
Minimum time, in seconds, before the next request (from any client sharing this pacer) may start after this one. Each caller passes its own, so clients with different delays can share a pacer. |
required |
sleep
|
Callable[[float], Awaitable[None]]
|
Sleep function to wait with — the calling client's, so tests that inject a fake one don't actually wait. |
required |
Source code in packages/core/src/libsocial/pacing.py
35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 | |
libsocial.shared_pacer
shared_pacer(host: str) -> Pacer
The process-wide Pacer for host, created on first use.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
host
|
str
|
The API host, e.g. |
required |
Source code in packages/core/src/libsocial/pacing.py
57 58 59 60 61 62 63 64 65 66 67 68 | |
libsocial.PlannedChapter
Bases: NamedTuple
A chapter a bulk operation will fetch, with the translation to fetch it in.
Attributes:
| Name | Type | Description |
|---|---|---|
volume |
str
|
The chapter's volume number. |
number |
str
|
The chapter number. |
branch_id |
int | None
|
The branch to request, or |
Models
libsocial.Title
Bases: BaseModel
Metadata for a single title.
chapter_count
class-attribute
instance-attribute
chapter_count: int | None = None
Number of uploaded chapters. Only TitleClient.get_info() fills it in: the catalog
listing endpoint doesn't return it (see docs/api-notes.md), so it's None on
Catalog.list_titles() items.
last_chapter_at
class-attribute
instance-attribute
last_chapter_at: datetime | None = Field(
default=None, alias="last_item_at"
)
When the most recent chapter was published — the value the catalog's
sort="last_chapter_at" orders by. Only TitleClient.get_info() fills it in: the
catalog listing endpoint doesn't return it (see docs/api-notes.md), so it's None on
Catalog.list_titles() items, and on a title with no chapters yet.
libsocial.Chapter
Bases: BaseModel
A chapter: volume, number, name and available translations — not its content.
index/item_number/branches_count/branches come from the chapter-list
endpoint (see TitleClient.get_table_of_contents()) and are None/empty when a
Chapter instead comes from fetching a single chapter, which has a different response
shape (see docs/api-notes.md). What the chapter contains is site-specific: a site
package subclasses this with its content fields and parsing.
libsocial.ChapterBranch
Bases: BaseModel
A single team's (or solo uploader's) translation of a chapter.
A chapter has more than one branch when several teams have translated it
independently; see Chapter.branches_count.
libsocial.Volume
Bases: BaseModel, Generic[ChapterT]
A volume: its number and the chapters it contains, in title order.
Generic over the chapter model — a site package uses Volume[ItsChapter] (or a
subclass of it) so its chapters keep their content fields.
libsocial.CatalogPage
Bases: BaseModel, Generic[TitleT]
One page of catalog listing/search results, as returned by Catalog.list_titles().
items reuses the title model as-is — a catalog list item has every field Title
requires, the ones it doesn't send (genres, summary, chapter_count,
last_chapter_at, ...) just come back at their defaults, same as any other
partially-populated Title (see docs/api-notes.md).
Exceptions
libsocial.LibSocialError
Bases: Exception
Base class for all errors raised by libsocial-core and the site SDKs built on it.
libsocial.TitleNotFoundError
TitleNotFoundError(slug_url: str)
Bases: LibSocialError
Raised when a title cannot be found on the site.
Attributes:
| Name | Type | Description |
|---|---|---|
slug_url |
The title's |
Source code in packages/core/src/libsocial/exceptions.py
23 24 25 | |
libsocial.ChapterNotFoundError
ChapterNotFoundError(
slug_url: str, *, volume: str, number: str
)
Bases: LibSocialError
Raised when a chapter cannot be found for a given volume/number.
Attributes:
| Name | Type | Description |
|---|---|---|
slug_url |
The title's |
|
volume |
The volume number that was requested. |
|
number |
The chapter number that was requested. |
Source code in packages/core/src/libsocial/exceptions.py
37 38 39 40 41 | |
libsocial.VolumeNotFoundError
VolumeNotFoundError(slug_url: str, *, volume: str)
Bases: LibSocialError
Raised when a title has no chapters for a given volume number.
Attributes:
| Name | Type | Description |
|---|---|---|
slug_url |
The title's |
|
volume |
The volume number that was requested. |
Source code in packages/core/src/libsocial/exceptions.py
52 53 54 55 | |
libsocial.MultipleTranslationsError
MultipleTranslationsError(
slug_url: str,
*,
volume: str,
number: str,
branches: list[ChapterBranch],
)
Bases: LibSocialError
Raised when a chapter has more than one team's translation and none was selected.
The SDK does not guess a default: the API's own default when branch_id is omitted
is not simply the first branch listed, and the actual rule it uses isn't documented
(see docs/api-notes.md) — returning it silently would be unpredictable. Call
TitleClient.get_translations() to list the available branches, then pass one's
branch_id explicitly.
Attributes:
| Name | Type | Description |
|---|---|---|
slug_url |
The title's |
|
volume |
The chapter's volume number. |
|
number |
The chapter number. |
|
branches |
The chapter's available translations, as returned by
|
Source code in packages/core/src/libsocial/exceptions.py
75 76 77 78 79 80 81 82 83 84 85 86 87 88 | |
libsocial.MultipleTitleTranslationsError
MultipleTitleTranslationsError(
slug_url: str, *, chapters: list[AmbiguousChapter]
)
Bases: LibSocialError
Raised by download_title() when one or more chapters have an unresolved translation.
Unlike MultipleTranslationsError (one chapter), this can list several: a title-wide
bulk download checks every chapter up front rather than stopping at the first ambiguous
one, so a caller doesn't have to fix one chapter, rerun, hit the next, and rerun again.
Pass branch_id or translation_index to download_title() to resolve them, or
fetch the listed chapters individually with get_chapter(..., branch_id=...).
Attributes:
| Name | Type | Description |
|---|---|---|
slug_url |
The title's |
|
chapters |
The ambiguous chapters and their available translations. |
Source code in packages/core/src/libsocial/exceptions.py
126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 | |
libsocial.AuthRequiredError
AuthRequiredError(url: str)
Bases: LibSocialError
Raised when the requested content requires authorization (paid or early access).
Attributes:
| Name | Type | Description |
|---|---|---|
url |
The request URL that returned 403. |
Source code in packages/core/src/libsocial/exceptions.py
152 153 154 | |
libsocial.AccessBlockedError
AccessBlockedError(
url: str, *, headers_hint: str = DEFAULT_HEADERS_HINT
)
Bases: LibSocialError
Raised when the site's edge protection rejects a request before it reaches the API.
Not an authorization problem, unlike AuthRequiredError: the DDoS-Guard edge in front
of api.cdnlibs.org answers with an HTML 403 page (the API's own 403 is JSON) when it
doesn't like the request — so far, a missing or empty Referer (see
docs/api-notes.md, section "WAF 403"). The SDK already sends browser-like headers, so
seeing this means either the edge changed its rules — check for an SDK update, or send
what it now expects via headers= on the title client/Catalog (or ApiClient,
if using it directly) — or the edge is blocking the network/IP itself, which no header
fixes. Not retried: resending the same request gets the same answer.
Attributes:
| Name | Type | Description |
|---|---|---|
url |
The request URL that returned 403. |
Initialize the error.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
url
|
str
|
The request URL that returned 403. |
required |
headers_hint
|
str
|
Where to pass different headers, as the message suggests it — a
site package names its own entry points (see |
DEFAULT_HEADERS_HINT
|
Source code in packages/core/src/libsocial/exceptions.py
177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 | |
libsocial.RateLimitError
RateLimitError(retry_after: float | None = None)
Bases: LibSocialError
Raised when the API responds with 429 Too Many Requests.
Attributes:
| Name | Type | Description |
|---|---|---|
retry_after |
The response's |
Source code in packages/core/src/libsocial/exceptions.py
202 203 204 205 | |
libsocial.DownloadTitleInterruptedError
DownloadTitleInterruptedError(
slug_url: str,
*,
volumes: Sequence[Volume[Any]],
completed: int,
total: int,
)
Bases: LibSocialError
Raised by download_title() when a chapter fetch fails unrecoverably partway through.
download_title() fetches hundreds-to-thousands of chapters sequentially for a long
title, which can outlast even the extra, bulk-specific rate-limit retry budget described
in download_title()'s max_rate_limit_retries — or hit some other unrecoverable
error (e.g. AuthRequiredError on a chapter that turns out to need a paywall/auth
token). Rather than letting that error propagate on its own and silently discard every
chapter already fetched, it's wrapped in this exception instead, carrying what was
already downloaded — so a caller can keep that partial result, or simply call
download_title() again: the SDK's disk cache means already-fetched chapters aren't
re-requested, so a retry resumes close to where this one stopped rather than restarting
the whole title. See docs/api-notes.md's "Rate limiting и retry" section and issue #41.
Attributes:
| Name | Type | Description |
|---|---|---|
slug_url |
The title's |
|
volumes |
list[Volume[Any]]
|
Chapters fetched before the failure, grouped into volumes the same way a
successful |
completed |
How many chapters were fetched before the failure. |
|
total |
How many chapters |
Source code in packages/core/src/libsocial/exceptions.py
230 231 232 233 234 235 236 237 238 239 240 | |
Cache maintenance
libsocial.cache_stats
cache_stats(
cache_dir: str | Path = DEFAULT_CACHE_DIR,
) -> CacheStats
Count the entries in a disk cache and their total size on disk.
Only files the cache itself writes are counted, not anything else that happens to be in the directory.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
cache_dir
|
str | Path
|
The cache directory — the same |
DEFAULT_CACHE_DIR
|
Returns:
| Type | Description |
|---|---|
CacheStats
|
The number of entries and their total size in bytes. A missing directory is an empty |
CacheStats
|
cache, |
Source code in packages/core/src/libsocial/cache.py
139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 | |
libsocial.clear_cache
clear_cache(
cache_dir: str | Path = DEFAULT_CACHE_DIR,
*,
older_than: float | None = None,
) -> CacheStats
Remove entries from a disk cache.
Only files the cache itself writes are removed — anything else in the directory, and the directory itself, is left alone. Safe to call while clients are using the same cache: an entry being read as it's removed is just a cache miss, and one written after it's removed is simply recreated.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
cache_dir
|
str | Path
|
The cache directory — see |
DEFAULT_CACHE_DIR
|
older_than
|
float | None
|
If given, only remove entries written more than this many seconds ago
(the same age check |
None
|
Returns:
| Type | Description |
|---|---|
CacheStats
|
The number of entries removed and the bytes they took. A missing directory removes |
CacheStats
|
nothing, |
Raises:
| Type | Description |
|---|---|
ValueError
|
If |
Source code in packages/core/src/libsocial/cache.py
157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 | |
libsocial.CacheStats
dataclass
CacheStats(entries: int, bytes: int)
How many cache entries there are (or were removed), and their total size on disk.