Repository navigation
Open
Description
I'm sorry for submitting an issue here.
I tried to download these databases using zsync.
Pay attention to the SHA-1 checksum.
$ sha1sum hg38_screen_v10_clust.regions_vs_motifs.scores.feather
57b58cbc57002e2b96f4b51d6a9fec0e831abd29 hg38_screen_v10_clust.regions_vs_motifs.scores.feather
$ wget https://resources.aertslab.org/cistarget/databases/homo_sapiens/hg38/screen/mc_v10_clust/region_based/hg38_screen_v10_clust.regions_vs_motifs.scores.feather.zsync
--2024-05-09 09:16:55-- https://resources.aertslab.org/cistarget/databases/homo_sapiens/hg38/screen/mc_v10_clust/region_based/hg38_screen_v10_clust.regions_vs_motifs.scores.feather.zsync
Resolving resources.aertslab.org (resources.aertslab.org)... 198.18.0.18
Connecting to resources.aertslab.org (resources.aertslab.org)|198.18.0.18|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 61006451 (58M)
Saving to: ‘hg38_screen_v10_clust.regions_vs_motifs.scores.feather.zsync’
hg38_screen_v10_clust.reg 100%[===================================>] 58.18M 11.1MB/s in 7.2s
2024-05-09 09:17:03 (8.11 MB/s) - ‘hg38_screen_v10_clust.regions_vs_motifs.scores.feather.zsync’ saved [61006451/61006451]
$ head hg38_screen_v10_clust.regions_vs_motifs.scores.feather.zsync
Blocksize: 2048
Filename: hg38_screen_v10_clust.regions_vs_motifs.scores.feather
Hash-Lengths: 2,3,6
Length: 13882267648
MTime: Thu, 07 Jul 2022 14:31:02 +0000
SHA-1: 57b58cbc57002e2b96f4b51d6a9fec0e831abd29
URL: https://resources.aertslab.org/cistarget/databases/homo_sapiens/hg38/screen/mc_v10_clust/region_based/hg38_screen_v10_clust.regions_vs_motifs.scores.feather
zsync: 2.0.0-alpha-1
��d�� W3�����VVGO�m��
$ wget https://resources.aertslab.org/cistarget/databases/homo_sapiens/hg38/screen/mc_v10_clust/region_based/hg38_screen_v10_clust.regions_vs_motifs.scores.feather.sha1sum.txt
--2024-05-09 09:25:49-- https://resources.aertslab.org/cistarget/databases/homo_sapiens/hg38/screen/mc_v10_clust/region_based/hg38_screen_v10_clust.regions_vs_motifs.scores.feather.sha1sum.txt
Resolving resources.aertslab.org (resources.aertslab.org)... 198.18.0.18
Connecting to resources.aertslab.org (resources.aertslab.org)|198.18.0.18|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 97 [text/plain]
Saving to: ‘hg38_screen_v10_clust.regions_vs_motifs.scores.feather.sha1sum.txt’
hg38_screen_v10_clust.reg 100%[===================================>] 97 --.-KB/s in 0s
2024-05-09 09:25:50 (76.9 MB/s) - ‘hg38_screen_v10_clust.regions_vs_motifs.scores.feather.sha1sum.txt’ saved [97/97]
$ cat hg38_screen_v10_clust.regions_vs_motifs.scores.feather.sha1sum.txt
07b5e527d2ed082e081e439e68dffa77b5f6129c hg38_screen_v10_clust.regions_vs_motifs.scores.feather
As you can see, its SHA-1 value matches the one recorded in the 'zsync' file's header, but differs from the one recorded in 'sha1sum.txt'.
I hope it's not my fault, as redownloading is a bit of a hassle.
Metadata
Metadata
Assignees
Labels
No labels
Activity
NirvanaCh7 commentedon May 9, 2024
ranking database downloaded
$ cat hg38_screen_v10_clust.regions_vs_motifs.rankings.feather.sha1sum.txt 1688a925f22d312769798258d990f13866bb4924 hg38_screen_v10_clust.regions_vs_motifs.rankings.feather $ head hg38_screen_v10_clust.regions_vs_motifs.rankings.feather.zsync Blocksize: 2048 Filename: hg38_screen_v10_clust.regions_vs_motifs.rankings.feather Hash-Lengths: 2,3,6 Length: 35192956928 MTime: Thu, 07 Jul 2022 14:35:59 +0000 SHA-1: 95c823ee1e19f68ce0c82f79042cdc1007018ddb URL: https://resources.aertslab.org/cistarget/databases/homo_sapiens/hg38/screen/mc_v10_clust/region_based/hg38_screen_v10_clust.regions_vs_motifs.rankings.feather zsync: 2.0.0-alpha-1 �W�inX�H1�ƤM)�s3���␦ �.�t�4��eDb�D��>�P�_�����C�е�C�G�o�e����t=�r��?i����i���X{�^�O#�5�L��څq�Kr��D�!S9�ۢ�I}����w� �{3�U^�u��3L���������D4��.>5c)�4a�B��r�ZD�C��_����˃����a�"��2#v/��[D�Z���,� $ sha1sum hg38_screen_v10_clust.regions_vs_motifs.rankings.feather 95c823ee1e19f68ce0c82f79042cdc1007018ddb hg38_screen_v10_clust.regions_vs_motifs.rankings.feather[-]The SHA-1 checksum of a databases file might be incorrect.[/-][+]The SHA-1 checksum files of databases file might be incorrect.[/+]NirvanaCh7 commentedon May 9, 2024
An error occurred :
ctxcore/ctdb.py :
NirvanaCh7 commentedon May 9, 2024
The file size is incorrect.
So the ’zsync‘ files is incorrect.
[-]The SHA-1 checksum files of databases file might be incorrect.[/-][+]The 'zsync' files of databases file might be incorrect.[/+]NirvanaCh7 commentedon May 9, 2024
I fixed it using ‘curl -C -’
It looks like it's working now.
To summarize,
the 'zsync' files are incorrect
Best wishes
ghuls commentedon Aug 9, 2024
zsync files are removed for now as zsync was having issues with big files (larger than 2G) for a long time.
Looks like the zsync2 bug:
AppImageCommunity/zsync2#31
might finally be resolved in a fork of zsync2: NiLuJe/zsync2@a8e2d68