#6447 (Sprint: Migrate laudate.ee from Sphinx to Lino)

by Luc Saffre · in Developers · assigned to Luc Saffre

Résumé

Goal of this sprint: Migrate the content of www.laudate.ee (made with Sphinx) to lino.laudate.ee (made with Lino).

Concepts sous-jacents

#6445 (Some optimizations for doing CMS with Lino ) (by Luc Saffre in Developers assigned to Sharif Mehedi)
#6455 (How to make sidebars in Lino) (by Luc Saffre in Developers assigned to Luc Saffre)
#6456 (How to make a local TOC in a page) (by Luc Saffre in Developers assigned to Luc Saffre)
#6464 (Backgrounds and publisher page layout) (by Luc Saffre in Developers assigned to Luc Saffre)
#6627 (Thumbnail version of images doesn't get updated) (by Luc Saffre in Developers assigned to Luc Saffre)

Commentaires

7 mois, 2 semaines ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : I added two database fields to Song (scores_tenor and scores_bass) and reviewed the SongDetail layout.
7 mois, 2 semaines ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : I published a series of changes in lino, xl and book.
7 mois, 3 semaines ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : The "Index" and "Copyright" sections on ets work now as required. TODO: footer.
7 mois, 3 semaines ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : Lino rendered its first sound file of a song. We need midi2audio and fluidsynth because Lilypond produces only midi files and browsers can play only ogg/wav/mp3 files.
7 mois, 3 semaines ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : TODO: show copyright owners and authors at end of songsheet, remove copyright notice from footer.
7 mois, 4 semaines ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : The :doc: role of Sphinx gets replaced by a [page] command in Lino. But what about the :ref:` role? It's needed when linking to a subtitle within a page. Right now we don't have anything like this.
7 mois, 4 semaines ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : ImageFormats.full now uses a class="lino-img-full" instead of style="...", and this class is defined in local.css, and in DocumentClasses.songbook it gets overridden (because the default has a margin of 1em, which I don't want in the printed version). And weasyprint now also loads the local.css.
7 mois, 4 semaines ago by Luc Saffre in reply to Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : This was the same as #5914 (Some unicode symbols arent rendered by Weasyprint).
8 mois ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) (1 reply) : The songsheet is almost ready, I got what I wanted for today: fit 5 songs on 2 A4 pages. TODO: the unicode "𝅘𝅥𝅮" character isn't being rendered in the pdf file.
8 mois ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : Next step: fine-tune margins and spacing of songsheet. The 5 songs should fit on two pages.
8 mois ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : I started #6632 (New choicelist printing.PageStyles) and i like it.
8 mois ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : NB the LatestSongs table is a wrong feature. We should delete it and generate a comment instead, i.e. make Song inherit from Commentable.
8 mois ago by Luc Saffre in reply to Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : I added a new template "songsheet", similar to "songbook" but without body text, register, authors sections. Works as expected. But the footer still needs tweeking. And the url of the pdf file is cache/weasypdf/publisher/Page-20.pdf which is not meant to be published...
8 mois ago by Luc Saffre in reply to Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : I tried the idea of having the songsd in AlbumItem instead of PageItem. But nope, this would be against the idea behind album. An album of the albums plugin is just a sequenced series of images. It's not meant to become printable. The Page model is the right place for printable documents.
8 mois ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) (2 replies) : Todo: Optimize layout of generated song sheets. Have the PDF files available for download from publisher when signed in. Use Album instead of Page for generating song sheets?
8 mois ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : Yes, nora now sends emails happily: this morning I had about 100 messages "Invalid HTTP_HOST header: '51.68.188.196'. You may need to add '51.68.188.196' to ALLOWED_HOSTS." in my inbox.
8 mois ago by Luc Saffre in reply to Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : (But I updated this page while following the instructions)
8 mois ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : Seems that the move went quite easily. One thing to check is the postfix config on nora.
8 mois ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : Jane is back online, now from the new server (nora). It took longer than expected because DNS system was slow to propagate today.
8 mois ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : I will now shut down Jane, run a last snapshot on the old site and restore on the new site, then disable old jane and change the DNS entry so that jane.mylino.net points to nora instead of laudate. See you later in ca 30 minutes (hopefully).
8 mois ago by Luc Saffre in reply to Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) (1 reply) : I'm not doing anything new. Instructions are on hosting.lino-framework.org/move/
8 mois ago by Luc Saffre in reply to Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : In order to minimize downtime for jane, I will now write a migrate script that rsyncs the latest snapshot from current jane (on laudate) and restores it to new jane (on nora).
8 mois ago by Luc Saffre in reply to Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : I said No when getlino asked me to run "certbot --nginx -d jane.mylino.net" because DNS is not yet changed. I'll do that manually when data is transferred.
8 mois ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) (3 replies) : The lino.laudate.ee site is currently disabled because we had performance problems, 3 Lino sites was too much for the laudate server). If I want to re-enable it, I must move either welcht1 or jane to another server.
9 mois, 3 semaines ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : Detail of a blog entry now has SourcesByOwner, and this list of sources is also printed after the blog entry's body.
10 mois, 1 semaine ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : Jane is back and I played a bit on lino.laudate.ee. The user experience for CMS functionality is not yet really convincing, but it works, and I should finish the migration so that at least the result would look well, so that the static site can be replaced by the Lino site.
10 mois, 1 semaine ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : Jane will be down for a moment soon because I will upgrade the ets site on laudate.
11 mois, 1 semaine ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : Uff! I now wrote an email to Annely and Tiina, introducing the new lino.laudate.ee site. I don't expect much feedback but now I can let this ticket rest for a while.
11 mois, 1 semaine ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : todo: The link lino.laudate.ee/p/laulud?ul=et works, but lino.laudate.ee/p/laulud causes AttributeError: 'NoneType' object has no attribute 'get_publisher_response' Seems to come because there is not translation And when I try to duplicate the page "Uued Laulud", I get __all__ : Lehekülg väljaga Page...
11 mois, 1 semaine ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : I now have a result that I would release and test on lino.laudate.ee. But before pushing my changes I must adapt the test suite.
11 mois, 1 semaine ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : Uff, the songs plugin now has a LilyFormats choicelist with two choices: "web" and "a4", and publisher.Page has a print button, and it works in noi2. There are a few more details to think about now, e.g. add copyright information at the end of the page.
11 mois, 1 semaine ago by Luc Saffre in reply to Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : todo: image files are currently specified as src="/media/.../1.png", and weasyprint of course doesn't find the file.
11 mois, 1 semaine ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) (1 reply) : todo: print a page as pdf
11 mois, 1 semaine ago by Luc Saffre in reply to Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : OTOH: one song can have multiple sources. Which means tht songs.Song should NOT become a subclass of sources.Source
11 mois, 2 semaines ago by Luc Saffre in reply to Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : But that thought can wait.
11 mois, 2 semaines ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) (2 replies) : I started to think that maybe we should make songs.Song become a type of sources.Source.
11 mois, 2 semaines ago by Luc Saffre in reply to Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : Uff, that was a subtle bug! I think it is fixed now, but the test suite is still running.
11 mois, 2 semaines ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) (1 reply) : I switched Site.languages from "en et" to "et en", which seems to reveal that TranslatableContent.get_publisher_response() has a bug.
11 mois, 2 semaines ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : Yesterday I sent a link to the new ets website to an external person for the first time. The link was lino.laudate.ee/p/20?ul=et and in my email I ask the Taizé community whether they agree with the ets site project. Without their permission this website makes no sense.
11 mois, 2 semaines ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : I modified the ets environment on laudate to use gitlab versions instead of pypi for lino, xl, noi and react.
11 mois, 2 semaines ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : I started to play with page-specific background images. Which raises questions like the general layout of a page and how flexible do we want CMS with Lino to be.
11 mois, 3 semaines ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : Todo: show status of pages in SpecialPages
11 mois, 3 semaines ago by Luc Saffre in reply to Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : Both issues are fixed now.
11 mois, 3 semaines ago by Luc Saffre in reply to Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : BTW the Publishable.is_public() method is nonsense, it is trying to reinvent the wheel, more precisely the view permissions system.
11 mois, 3 semaines ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) (2 replies) : todo: the "Root pages" is visible for everybody even when publishing state is "removed" or "draft"
11 mois, 3 semaines ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : I pushed a series of changes for this ticket. And also for #6451 (Export to vCard is broken), which I accidentally fixed at the same time.
11 mois, 3 semaines ago by Luc Saffre in reply to Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : I have a solution for this (at least it seems to be a solution): Actor.get_row_by_pk() now uses a new Actor class attribute unique_keys, which defaults to ['id'], and on Pages it is overridden to ['id', 'ref']. And a new method Publishable.get_publisher_pk(), which for Page returns self.ref or str(...
11 mois, 3 semaines ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : The workflow should be as follows: write a page in some language. At some moment (when the user decides so), they click on the "Translate" action and Lino would automatically create this page in the other languages of the site. And maybe it can auto-translate the text using github.com/uliontse/trans...
11 mois, 3 semaines ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : todo: The default value of the language field should not simply be the user's language, that's too simplistic. When I'm inserting a child to a page in another language, then the new page should inherit language from its parent, not from me.
11 mois, 3 semaines ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : todo: how to create a translation page in one click
11 mois, 4 semaines ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) (1 reply) : todo: how to implement named pages (i.e. pages with a user-given name instead of a number in their url)? My first guess was let's have Page inherit from Referrable. But will that work in a multilingual context?
11 mois, 4 semaines ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : Todo: I don't want a "Root pages" page but Lino creates it again because it is a SpecialPage.
11 mois, 4 semaines ago by Luc Saffre about #6447 (Sprint: Migrate laudate.ee from Sphinx to Lino) : Created new Ticket #6447 (Sprint A Lino for laudate.ee).