bugSavane - Bugs: bug #14447, Improve Savane data export

 
 
Show feedback again

You are not allowed to post comments on this tracker with your current authentification level.

bug #14447: Improve Savane data export

Submitted by:  Eric S. Raymond <esr>
Submitted on:  Mon 05 Oct 2009 08:45:37 PM UTC  
 
Category: Web FrontendStatus: In Progress
Severity: 4 - ImportantPriority: C - Normal
Assigned to: NoneOpen/Closed: Open
Release: trunkPlanned Release: 
Reproducibility: NonePrivacy: Public

Wed 07 Oct 2009 09:25:52 AM UTC, comment #5:

Please note that we care about freedom for both software and data here at Gna!.

We have setup at the early stages (in 2004) far more way to export or import data via realistic means (like rsync, svn dumps and such) than any other forge. It is maybe not true any more.

We have also arranged at many occasions specific tasks to import or export various datasets such as VCS repositories.

So we have arranged to have no legal bindings and the least technical barriers to let data move in and out of Gna!. The infrastructure itself has lived on different servers and with the help of different companies. The last move was precisely a consequence of a dubious legal constraint that arose.

Obviously we would be more than happy to provide and accept better interchange tools, since that would mean a more effective freedom. Right now moving your data is partly dependent on the adminsys availability and time which is quite scarce. And in some parts intimate knowledge of Savane (like XML dumps of tracker data). Most VCS repositories, files and such are simply rsync'able.

But I insist that platform 'owners' and their responsibility is key. Loic and I are left as the original founders (Mathieu, which was the real task force back in 2004, moved with another life plan), and we've showed 5 years of commitment to these goals. Loic has notoriously and more generally done so for er... 20 years.

Vincent Caron <zerodeux>
Project Member
Tue 06 Oct 2009 10:12:44 AM UTC, comment #4:

Note that improving Savane data export is not all that ia implied by my original complaint. For it to have real utility, a Savane must be capable of reinterpreting the "export" into its database so the project is effectively migrated to the new instance.

Eric S. Raymond <esr>
Project Member
Tue 06 Oct 2009 10:09:34 AM UTC, comment #3:

If you are determined to be insulted there is nothing I can do to stop you. But that was not my intention; I am merely pointing out facts.

It is objectively true that large parts of a Savane project's state are effectively not accessible to be snapshotted and backed up. You may argue with the phrase "data jail", and you may sincerely intend for things to be otherwise, but it is nevertheless descriptive of the actual situation. I regret that the term offends you, but you would serve your users better by thinking of ways to fix the problem than you do by taking offense at the messenger.

You request patches rather than "mere reports". This seems to me more like an avoidance tactic rather than a constructive response, but I am in fact willing to back up my criticisms with code. Many of them could be addressed by an email bot or XML-RPC server doing queries to the back-end database, and this might be a relatively small, self-contained subproject. I could at least evaluate the possibility.

What implementation languages does the Savane project prefer or allow? Is Python one of them?

Eric S. Raymond <esr>
Project Member
Tue 06 Oct 2009 08:46:49 AM UTC, comment #2:

Let's try to be more productive:

- Don't insult the admins saying their platform is a jail, while it's already better than the competition (the code is available to begin with)

- Send patches rather than mere reports

- Study solutions some more:
"The current stable GNU Mailman version is 2.1.12, released on 23-Feb-2009." -- list.org
Upgrading to unstable mailman is not exactly an option.
Writing a Python program that would export the pickle'd Mailman2 data and reimport it would work immediately, especially if integrated with Savane.

Sylvain Beucler <beuc>
Project Administrator
Mon 05 Oct 2009 10:59:50 PM UTC, comment #1:

FYI, I filed the bug with MailMan and was immediately informed that this issue has been directly addressed in MailMan 3.

Accordingly, I suggest the Savane project should ensure that its codebase is MM3-compatible and then encourage Savane-using sites to upgrade.

Eric S. Raymond <esr>
Project Member
Mon 05 Oct 2009 08:45:37 PM UTC, original submission:

I write as a mostly happy user of gna,org in connection with the Battle For Wesnoth project, but a recent outage at berlios.de has rubbed my nose in this issue. It should be fixed before someone using a Savane instance is burned by it.

Savane is a data jail. There are large parts of a project's database state that cannot be downloaded and backed up by project's admins. Some of this is not the Savane designers' fault - I intend to file a bug against MailMan about this issue - but much of it is. In particular, there should be a way to dump the developer permissions and the state of the bug and task trackers to a textual representation which can be uploaded to another Savane instance to migrate the project.

This has very practical bad consequences. It means that project admins cannot do effective recovery planning against the possibility of a site outage, whether from spectacular causes like natural disaster or from more mundane ones like staff burnout and underfunding.

It is also philosophically wrong for Savane, or any other open-source hosting system, to be a data jail. I am not going to lecture about this, as I suspect the arguments should be blindingly obvious now that I have raised the point.

Yes, I'm going to file this same bug against berlios.de. And probably against SourceForge and alioth and half a dozen other sites as well. I filed here first because I think Savane is the best of the breed. Please set a good example on this issue.

Eric S. Raymond <esr>
Project Member

 

No files currently attached

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by zerodeux (Posted a comment)
  • -unavailable- added by beuc (Posted a comment)
  • -unavailable- added by esr (Submitted the item)
  •  

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 0 encouragements so far.

    Only logged-in users can vote.

     

    Please enter the title of George Orwell's famous dystopian book (it's a date):

     

     

    Follow 2 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Tue 06 Oct 2009 08:46:49 AM UTCbeucStatusNone=>In Progress
      SummarySavane is a data jail=>Improve Savane data export
    Show feedback again

    Back to the top


    Powered by Savane 3.1-cleanup