Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

404 in archives/ during new releases #68

Open
JulienPalard opened this issue Dec 12, 2018 · 7 comments
Open

404 in archives/ during new releases #68

JulienPalard opened this issue Dec 12, 2018 · 7 comments
Assignees

Comments

@JulienPalard
Copy link
Member

@JulienPalard JulienPalard commented Dec 12, 2018

On the release of 3.7.2rc1, the archives/ were not built automatically (they are built daily).

I bet (didn't checked it yet) that it should fix itself in less than 24h, while the cron passes, but it's too long and it bothers people.

I had to build locally then from the local www/ directory run:

$ rsync -vrhi --include '/*/' --include '/*/*.*/' --include '/*/*.*/archives/' --include '/*/*.*/archives/**' --exclude '*' ./ docs.iad1.psf.io:/srv/docs.python.org/

Then remotely run:

$ sudo chown docsbuild:docs /srv/docs.python.org/*/*/archives/*
$ cd /srv/docs.python.org/; for file in */*/archives/*; do  curl -XPURGE https://docs.python.org/$file; done

to temporary trash-fix this.

@JulienPalard JulienPalard self-assigned this Dec 12, 2018
@JulienPalard
Copy link
Member Author

@JulienPalard JulienPalard commented Dec 24, 2018

For the record, it happened again on the 3.7.2 release. I fixed it manually again using the previous commands (just changed the versions).

@JulienPalard
Copy link
Member Author

@JulienPalard JulienPalard commented Feb 26, 2020

Another way to do it is to start manually a build_docs right after a release:

docsbuild@docs:~$ /srv/docsbuild/venv/bin/python /srv/docsbuild/scripts/build_docs.py -b 3.8 --languages en
@Mariatta
Copy link
Member

@Mariatta Mariatta commented Feb 26, 2020

Not sure how it all work.. can we not display the new download URLs before the downloadables have finished getting built?

@JulienPalard
Copy link
Member Author

@JulienPalard JulienPalard commented Feb 26, 2020

@Mariatta that's an idea.

The issue is we're building HTML multiple time a day, but PDF only once a day, so it happen that some release get their HTML build before their PDF.

@Mariatta
Copy link
Member

@Mariatta Mariatta commented Feb 26, 2020

What is needed to ensure that both PDF and HTML get built at release time, instead of waiting for the cron to run?

@JulienPalard
Copy link
Member Author

@JulienPalard JulienPalard commented Feb 26, 2020

There's #77 that should have the side effect to solve it, by running the build only when needed it could rebuild everything. But it's a lot of work and I did not found the free time to do it.

A simple solution in the meantime would be to stop the cron building HTML only, keeping only daily full builds (html + pdf), I don't think we need the HTML doc to be updated every 3 hours, what do you think?

@Mariatta
Copy link
Member

@Mariatta Mariatta commented Feb 26, 2020

I think building them once a day sounds good and could reduce the number of 404 reports we're getting. And we are certain that by the time the HTML is done building. and rendered, the PDFs are also finished?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants
You can’t perform that action at this time.