Skip to content

Serialise publishes to avoid concurrent-rsync failures#342

Open
StanFromIreland wants to merge 1 commit into
python:mainfrom
StanFromIreland:serial-publish
Open

Serialise publishes to avoid concurrent-rsync failures#342
StanFromIreland wants to merge 1 commit into
python:mainfrom
StanFromIreland:serial-publish

Conversation

@StanFromIreland

Copy link
Copy Markdown
Member

@hugovk

hugovk commented Jul 6, 2026

Copy link
Copy Markdown
Member

For reference, the error from Sentry:

Run: 'rsync -a --delete-delay --filter 'P archives/' /srv/docsbuild/cpython-only-html/Doc/build/html/ /srv/docs.python.org/3.15' KO:

Issue ID: 7209728782
Project: python-docs
Date: 29/06/2026, 09:45:00

Message

Run: 'rsync -a --delete-delay --filter 'P archives/' /srv/docsbuild/cpython-only-html/Doc/build/html/ /srv/docs.python.org/3.15' KO:
file has vanished: "/srv/docs.python.org/3.15/.genindex-Q.html.1Um04T"
rsync warning: some files vanished before they could be transferred (code 24) at main.c(1356) [sender=3.2.7]

Tags

  • environment: production
  • interface_type: contexts
  • language: en
  • level: error
  • logger: root
  • runtime: CPython 3.13.2
  • runtime.name: CPython
  • server_name: docs
  • version: 3.15

Breadcrumbs

  • subprocess subprocess [info]
    /srv/docsbuild/venv-3.15/bin/python3.13 -m ensurepip --upgrade --default-pip
    {"subprocess.cwd":"/srv/docsbuild/venv-3.15","thread.id":"135275563532416","thread.name":"MainThread"}
  • subprocess subprocess [info]
    /srv/docsbuild/venv-3.15/bin/python -m pip install --upgrade --upgrade-strategy=eager python-docs-theme -rrequirements.txt jieba PyStemmer~=2.2.0 matplotlib>=3
    {"subprocess.cwd":"PosixPath('/srv/docsbuild/cpython-only-html/Doc')","thread.id":"135275563532416","thread.name":"MainThread"}
  • subprocess subprocess [info]
    /srv/docsbuild/venv-3.15/bin/python -m pip freeze --all
    {"thread.id":"135275563532416","thread.name":"MainThread"}
  • log root [info]
    Build start.
    {"asctime":"2026-06-29 06:41:05,325"}
  • log root [info]
    Running make autobuild-dev-html
    {"asctime":"2026-06-29 06:41:05,325"}
  • subprocess subprocess [info]
    make -C /srv/docsbuild/cpython-only-html/Doc PYTHON=/srv/docsbuild/venv-3.15/bin/python SPHINXBUILD=/srv/docsbuild/venv-3.15/bin/sphinx-build BLURB=/srv/docsbuild/venv-3.15/bin/blurb VENVDIR=/srv/docsbuild/venv-3.15 SPHINXOPTS=-D latex_engine=xelatex -D latex_elements.inputenc= -D latex_elements.fontenc= -t create-social-cards -D ogp_site_url=https://docs.python.org/3.15/ SPHINXERRORHANDLING= autobuild-dev-html
    {"thread.id":"135275563532416","thread.name":"MainThread"}
  • log root [info]
    Build done (3m 51s).
    {"asctime":"2026-06-29 06:44:56,242"}
  • log root [info]
    Publishing start.
    {"asctime":"2026-06-29 06:44:56,242"}
  • log root [info]
    Copying HTML files to /srv/docs.python.org/3.15
    {"asctime":"2026-06-29 06:44:59,304"}
  • subprocess subprocess [info]
    rsync -a --delete-delay --filter P archives/ /srv/docsbuild/cpython-only-html/Doc/build/html/ /srv/docs.python.org/3.15
    {"thread.id":"135275563532416","thread.name":"MainThread"}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants