helpGna! Administration - Support: sr #3277, Uploading files to the download...

 
 
Show feedback again

sr #3277: Uploading files to the download area using rsync is blocked.

Submitted by:  Edward d Auvergne <bugman>
Submitted on:  Wed Sep 30 11:54:39 2015  
Votes:  100  
 
Category: Download AreasPriority: 9 - Immediate
Severity: 5 - BlockerStatus: None
Privacy: PublicAssigned to: None
Open/Closed: OpenOperating System: Any / Non-Specific

Add a New Comment (Rich MarkupRich Markup):
   

You are not logged in

Please log in, so followups can be emailed to you.

 

Wed Oct 28 16:36:35 2015, comment #5:

Confirmed here, thanks for the workaround ;-)

José JORGE <zecas>
Mon Oct 19 18:40:05 2015, comment #4:

Well, technically we had fixed the issue a while ago so it's normal that your script wasn't using any work-around.

I expected a recent come-back admin to make progress on this but that didn't happen.

More generally let's focus on fixing this rather than documenting the work-around :)

Beuc <beuc>
Site Administrator
Mon Oct 19 14:06:12 2015, comment #3:

Thanks! Adding the --numeric-ids option works (though it looks like all files will be replaced in the process). Anyway, this allows me to remove a pile of old, no longer needed release packages and to save a lot of space on the Gna! infrastructure.

I'd forgotten where that old conversation was, and for some reason could not find it using the search box. Somehow my synchronisation script had reverted to using the -avP options. It is still the group option -g that is problematic, so the following command which expands -avP but drops -g works quite well:

$ rsync --delete -rlptoDvP --no-perms --rsh="ssh" --numeric-ids $PWD/ bugman@download.gna.org:/upload/relax/

Could recipe #119 be updated to include this info? The example there uses the -avr options which will not always work.

Cheers!

Edward

Edward d Auvergne <bugman>
Wed Sep 30 14:23:16 2015, comment #2:

Hi,

Technically you saw this error as late as 2014, if I trust
http://gna.org/forum/forum.php?forum_id=2445
;)

For some reason, it seems unscd is suddently no longer a valid work-around for this situation, and we need to implement a different way to propagate unix users (probably with libnss-extrausers).

Meanwhile, you can work-around the block at your level by using --numeric-ids.

Cheers!

Beuc <beuc>
Site Administrator
Wed Sep 30 13:02:52 2015, comment #1:

I forgot to add that there are no problems downloading with rsync.

Edward d Auvergne <bugman>
Wed Sep 30 11:54:39 2015, original submission:

I am trying to upload a new release to the relax download area. However when using rsync, this is blocked. I have never seen this problem since starting in 2005. The following command no longer works:

[edward@localhost download.gna.org]$ rsync --delete -av --progress --no-perms --partial --rsh="ssh" . bugman@download.gna.org:/upload/relax/

However scp does:

[edward@localhost download.gna.org]$ scp -rp relax-3.3.9.src.zip bugman@download.gna.org:/upload/relax/
relax-3.3.9.src.zip 2% 2704KB 1.3MB/s 01:12 ETA

I also have no problems committing or accessing any of the other Gna! infrastructure. I've attached a debugging rsync printout for more details. On the last line:

[sender] make_file(relax-3.3.8.GNU-Linux.i686.tar.bz2,*,2)
[sender] make_file(relax-3.0.2.src.tar.bz2,*,2)
send_file_list done
send_files starting
[sender] pushing local filters for /data/relax/gna/download.gna.org/manual/
[sender] make_file(manual/relax.pdf,*,2)
server_recv(2) starting pid=20172

rsync hangs indefinitely (tested for ~2 hours).

Edward d Auvergne <bugman>

 

(Note: upload size limit is set to 1024 kB, after insertion of the required escape characters.)

Attach File(s):
   
   
Comment:
   

Attached Files
file #25215:  gna_rsync_block added by bugman (5kB - application/octet-stream - Printout of: rsync --delete -avvv --progress --no-perms --partial --rsh="ssh" . bugman@download.gna.org:/upload/relax/)

 

Depends on the following items: None found

Items that depend on this one: None found

 

Carbon-Copy List
  • -unavailable- added by zecas (Voted in favor of this item)
  • -unavailable- added by zecas (Posted a comment)
  • -unavailable- added by beuc (Posted a comment)
  • -unavailable- added by bugman (Submitted the item)
  •  

    Do you think this task is very important?
    If so, you can click here to add your encouragement to it.
    This task has 100 encouragements so far.

    Only logged-in users can vote.

     

    Error: not logged in

     

     

    Follow 3 latest changes.

    Date Changed By Updated Field Previous Value => Replaced By
    Wed Oct 28 16:36:51 2015zecasCarbon-Copy-=>Added zecas
    Wed Sep 30 11:54:39 2015bugmanPriority-Automatic update due to transitions settings-=>9 - Immediate
      Attached File-=>Added gna_rsync_block, #25215
    Show feedback again

    Back to the top


    Powered by Savane 3.1-cleanup