Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Radiquum changes to furaffinity-dl #70

Open
wants to merge 27 commits into
base: python
Choose a base branch
from
Open

Conversation

Radiquum
Copy link

@Radiquum Radiquum commented Jun 17, 2022

added:

  • multi-username download
  • recent submissions check
  • submission notifications download (if cookies are provided)
  • download filtering
  • remove not fully downloaded file when exiting with CTRL + C
  • allow download description as json list
  • add post url to metadata
  • extract FA cookies from browser with --login if logged in there
  • pre-commit (for some code pre-formatting, not in requirements.txt since not needed for actual working)

changed:

  • disable metadata saving by default
  • disable submission redownload by default
  • add colors to output
  • making of directory tree based off username, category and rating (can disable rating separation)
  • file name now submission_title - submission_filename

Radiquum and others added 3 commits June 15, 2022 23:40
(but yeah it's kludge)
Create directory tree based on author name
Filter posts like "YCH OPEN, REMINDER"
argument parser changes
@Radiquum Radiquum changed the title Radiquum Radiquum changes to furaffinity-dl Jun 17, 2022
added:
- filter
- remove not fully downloaded file when exiting with CTRL + C
- ability to download description as a list
- ability to download a specific file

changed
- color output
- remove custom output directory
- making of directory tree based off username, category and rating
- default attributes value changes
- system messages parsing changes
- arguments & help text change - move metadata var to section where metadata == True - add page URL to metadata file
- some minor changes
- extracted cookie.txt formatting fix
- add shorter arguments
 - metadata file saving will now be in same folder as an image
 (it's same as it was before)
- print output path when downloaded a specific file
changelog:
- new file naming
- added possibility to download only recent user submissions
(may be useful to update downloaded galleries)
- now you can download several users,  also you can provide a path to a file with usernames, to download them all
- readded custom output path and metadata folder
- default args state changes
- code cleaning
@Xerbo
Copy link
Owner

Xerbo commented Jul 6, 2022

These changes look very good, however this is getting large enough that you should start splitting it into multiple files

@reederda
Copy link

reederda commented Jul 6, 2022

This is a significant rewrite with many changes. I'm not sure it should be pulled in all at once?

@Radiquum
Copy link
Author

Radiquum commented Jul 8, 2022

This is a significant rewrite with many changes. I'm not sure it should be pulled in all at once?

well, I guess, I could make it into something like a separate project which is based off this, since it is possible this pull will break something for people who already using original script and I'm not excluding bugs which can happen.

still it's for author to decide, to allow or forbid such thing. anyway mostly it's just suggestions, which can be gradually re implemented in a better way, than I did them.

Radiquum and others added 9 commits July 10, 2022 03:24
ability to add comments in username list with "#"
autoremoval of "_" in usernames
speedup filter checking
add basic indexing -> speedup existing file checking for newer files
other small changes
- workaround for NTFS filesystem when username ends with dot.
- ReadMe changes
- other minor changes
Thanks for your pull request, and sorry for the waiting xd
Ovear and others added 5 commits January 9, 2023 03:23
2.Add option to detect comission's category, also introduce new dir structure
3.Check file size when download complete to prevent corrupted file
4.Add option to enable request cache
5.Add option to force check file size to detect corrupted file
6.Fix multiple edge case that will caused exception and corrupt file
7.Fix stack overflow in some cases
8.Add max tries limit when download
Some stability and functional fix
Shoud fix some bugs???
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants