Releases: AAndyProgram/SCrawler
2023.12.7.0
🏳️🌈 ❤️ If you like SCrawler, please like the program on this site. ❤️ 🏳️🌈
Join our Discord server: https://discord.gg/uFNUXvFFmg
- Added
- Saved posts: add downloaded saved posts to the feed
- YouTube (SCrawler): the ability to download YouTube user community feeds
- Main window: add
Alt+Ahotkey to show scheduler - Main window: add
Alt+Photkey to show progress form - YouTube: check of adding a URL if it has already been downloaded
- YouTube: ability to check for a new version at start
- Updater
- Fixed
- Standalone downloader: URL files are not deleted along with the file
- Minor bugs
Complete code changes: 2023.11.25.0...2023.12.7.0
2023.11.25.0
🏳️🌈 ❤️ If you like SCrawler, please like the program on this site. ❤️ 🏳️🌈
Join our Discord server: https://discord.gg/uFNUXvFFmg
For those of you who use TikTok, I recommend updating TikTok plugin to the latest version using these instructions.
- Fixed
- Reddit: missing refresh token button in the settings form
Previous update
- Added
- Automation: manual task option
- Scheduler: add scheduler name to form title
- Feeds: update when users' location and/or basic information changes
- Reddit: special notification for error 429
- TikTok: ID, username and friendly name extraction from data
- TikTok: new option
Use video date as file date - YouTube: absolute path for a single playlist
- Updated
- yt-dlp up to version 2023.11.16
- Fixed
- Scheduler: scheduler change error
- Twitter: JSON deserialization error
- xHamster, XVideos, PornHub, ThisVid: incorrect parsing of search queries
- YouTube: the file name is not changed manually
- YouTube: path not set when adding array to download
- Minor bugs
2023.11.24.0
🏳️🌈 ❤️ If you like SCrawler, please like the program on this site. ❤️ 🏳️🌈
Join our Discord server: https://discord.gg/uFNUXvFFmg
For those of you who use TikTok, I recommend updating TikTok plugin to the latest version using these instructions.
- Added
- Automation: manual task option
- Scheduler: add scheduler name to form title
- Feeds: update when users' location and/or basic information changes
- Reddit: special notification for error 429
- TikTok: ID, username and friendly name extraction from data
- TikTok: new option
Use video date as file date - YouTube: absolute path for a single playlist
- Updated
- yt-dlp up to version 2023.11.16
- Fixed
- Scheduler: scheduler change error
- Twitter: JSON deserialization error
- xHamster, XVideos, PornHub, ThisVid: incorrect parsing of search queries
- YouTube: the file name is not changed manually
- YouTube: path not set when adding array to download
- Minor bugs
Complete code changes: 2023.11.17.0...2023.11.24.0
2023.11.17.0
🏳️🌈 ❤️ If you like SCrawler, please like the program on this site. ❤️ 🏳️🌈
Join our Discord server: https://discord.gg/uFNUXvFFmg
- Added
- Multi-account
- Special feeds
- Site settings: option
Download saved posts - Standalone downloader: support for multiple account
- PornHub: add playlists downloading
- YouTube: ability to download subtitles and
CCif they both exists - Other improvements
- PluginProvider
IDownloadableMedia: addedAccountNamepropertyIPluginContentProvider: addedAccountNamepropertyISiteSettings: added properties:AccountName,Temporary,AvailableText,DefaultInstance; added functions:Clone,Update,Delete; removedLoadfunction; implementIDisposableinterfacePropertyValue: added functions:BeginInit,EndInit,CloneAttributes.DoNotUse- addValuefield
- Fixed
- Instagram: handling 401 error
- OnlyFans: handling 401 error
- xHamster: handling 503 error
- xHamster: incorrect parsing of search queries
- XVideos: incorrect parsing of search queries
- ThisVid: incorrect parsing of search queries
- PornHub: incorrect parsing of search queries
- Automation: handle automation start error (in some cases) when changing scheduler
- Minor bugs
Complete code changes: 2023.10.10.0...2023.11.17.0
2023.10.10.0
🏳️🌈 ❤️ If you like SCrawler, please like the program on this site. ❤️ 🏳️🌈
Join our Discord server: https://discord.gg/uFNUXvFFmg
- Added
- Notification if the user has disabled downloading from the site
- Standalone downloader: new setting
Create URL files - Changed the sessions naming method to be more intuitive
- Settings that allow the user to change the number of saved session (
Settings-Feed-Store session data) - YouTube: new settings
Create URL filesandCreate description files - YouTube: added the
Clear selectedbutton - YouTube: group the
Clear and removebuttons in the menu
- Fixed
- Reddit: unable to save settings without OAuth data
- JustForFans: rewritten m3u8 downloader
- JustForFans: downloading of missing posts
- JustForFans: download to the date
- JustForFans: corrupted files
- Threads: new token is not saved if it was received during download
- ThisVid: parsing stops when new videos are added
- YouTube: file name is missing when destination is changed by selecting one of the saved locations
- YouTube: missing files still appear in the list
- Collections: labels are removed when creating a new collection
- Standalone downloader: cached thumbnail is not removed when item is removed from the list
- Minor bugs
Complete code changes: 2023.10.1.0...2023.10.10.0
2023.10.1.0
🏳️🌈 ❤️ If you like SCrawler, please like the program on this site. ❤️ 🏳️🌈
Join our Discord server: https://discord.gg/uFNUXvFFmg
- Added
- Threads.net
- YouTube: add URL standardization
- Fixed
- UserEditor: disable updating labels if they haven't changed
- Collections: incorrect updating of colors and labels when adding a new user
- RedGifs: incorrect handling of error 410
- Mastodon: hide error 503
- JustForFans: some profiles won't download
- Minor bugs
2023.9.21.0
🏳️🌈 ❤️ If you like SCrawler, please like the program on this site. ❤️ 🏳️🌈
Join our Discord server: https://discord.gg/uFNUXvFFmg
- Fixed
- PornHub: videos are not downloading
2023.9.20.0
🏳️🌈 ❤️ If you like SCrawler, please like the program on this site. ❤️ 🏳️🌈
Join our Discord server: https://discord.gg/uFNUXvFFmg
- Added
- Instagram: user active (non-pinned) stories (Issue #17)
- Reddit: reduce the number of token updates (refresh the token if there are Reddit users in the download queue)
- YouTube (standalone app): priority download protocol (
Settings-Defaults-Protocol) (you can now select the default protocol you want to download media on:Any,https,m3u8)) - Automation: ability to change schedulers (
Download-Automation-Script icon) - Collections: update colors for the added user
- Fixed
- YouTube: can't detect
shortslinks - Incorrect MD5 validation initial value
- Instagram: handle error 500
- Collections: update labels only for the added user
- YouTube: can't detect
2023.8.27.0
🏳️🌈 ❤️ If you like SCrawler, please like the program on this site. ❤️ 🏳️🌈
Join our Discord server: https://discord.gg/uFNUXvFFmg
- Added
- JustForFans. Special thanks @archwaycommons
- Advanced download (
Download-Download (advanced)) - Advanced filter (
View-Advanced filter) - Auto downloader: cloning plans
- Feed: add button to go to custom page
- Special log for non-existent users
- Twitter: group 'limit' notifications
- Ability to set custom color for subscription users
- Other improvements
- Fixed
- Auto downloader: new plan date display bug (Issue #161)
- Auto downloader: downloading stuck
- Minor bugs
Contributors
Assets 4
2023.8.6.0
🏳️🌈 ❤️ If you like SCrawler, please like the program on this site. ❤️ 🏳️🌈
Please, read the following release notes carefully!
To support the new functionality, the configurations of some profiles have been changed. So once you start using this version, you might not be able to downgrade it. I highly recommend backing up user settings and user data files before start using. You can see an example CMD script here.
Reddit. Added OAuth authorization. Reddit can download timelines without cookies and without errors. To do this, Reddit's settings now have new options to enable/disable the use of cookies for download timelines. If you still want to use OAuth authorization, I've added a guide on how to do it. Please read it carefully.
TikTok is back. But in order to download TikTok profiles, you need to download a special plugin for TikTok users. I've added a guide on how to do it. Please read it carefully. TikTok also requires yt-dlp.
Added bug report. You can send an anonymous bug report for those of you who don't have a GitHub account. It also allows you to attach photo files (that illustrate the bug). This report will be sent to my personal Discord. You can also say something nice (Anon message - Nice), suggest a feature, or say whatever you want. 😊 Please, don't send too many bug reports. One bug report is enough. You can say something nice as many times as you want, without limits. 😊
Join our Discord server: https://discord.gg/uFNUXvFFmg
- Added
- The ability to remove user data and/or download history for redownload
- Subscription mode
- Settings to change the program title and information in the program information
- Settings for saving video thumbnail along with the file or in the cache (temporary cache or permanent cache)
- A bug report form to create a bug report or say something nice to the developer 😊
- Prevent adding site-specific labels when adding to a collection
- Ability to select custom user highlighting in the main window and feed.
- Add a notification to the log if the user is not found on the site
- Added visualization of users download queue
- Ability to set more than one global paths
- Improve user paths changing: now you can also simply move the user/collection to another global location
- Ability to move multiple user/collection to another location
- Download groups: added
Subscriptionoptions - Download groups: the ability to set the number of users to download
- Auto downloader: new group options
- Auto downloader: additional skip options
- Auto downloader: added force start
- Feed: press
Ctrl+Gto go to a specific page - Feed: added site icon to post
- Feed: always using
Friendly nameinstead ofUserNameif it exists - Missing posts: the ability to delete all missing posts
- Standalone downloader: add the ability to store download locations and quickly select after
- Standalone downloader: add
Ctrl+Ohotkey to select destination path - Standalone downloader: add
Alt+Ohotkey to select destination path and save it to download locations - User editor: ability to hide/show site-specific labels in collection editing mode
- Main window: filters by subscription and user
- Instagram: if the user is not found on the site, SCrawler will check for a new user name
- OnlyFans: handling of
504and429errors - OnlyFans: the
sec-ch-uaheader is now optional - OnlyFans: ability to download 'Highlights' and media from chats
- PathPlugin: incorrect detection of path existence
- PornHub: completely rewritten videos parser
- PornHub: now you choose which videos you want to download (uploaded, tagged, private, favorites)
- PornHub: subscription mode
- PornHub: ability to download search queries and search categories
- Reddit: added bearer token (optional)
- Reddit: added OAuth authorization (optional)
- Reddit: options to use the bearer token for the timeline and/or saved posts
- Reddit: option to disable the use of cookies for the timeline
- ThisVid: now you can also download user's favorite videos
- ThisVid: ability to download search queries, search categories and search tags
- ThisVid: subscription mode
- Twitter: new options:
Use the appropriate model,New endpoint: search,New endpoint: profiles,Abort on limit,Download already parsedandMedia Model: allow non-user tweets - Twitter: new user option
Force apply - xHamster: ability to download search queries, search categories and search tags
- xHamster: subscription mode
- xHamster: pornstars download
- XVideos: ability to download search queries, search categories and search tags
- XVideos: subscription mode
- YouTube: added
Output path: ask for a nameandOutput path: auto addsettings - YouTube: added the ability to store download locations and quickly select after
- YouTube: subscription mode
- Plugins.Attributes: added
DependentFieldsattribute - Plugins.Attributes: replace
DependencieswithArguments(PropertyUpdaterattribute) - Plugins.IPluginContentProvider: added
OptionsandIsSubscriptionproperties - Plugins.ISiteSettings: added
SubscriptionsAllowedproperty - Plugins.ExchangeOptions: added
Optionsfield - Plugins: added
ExitException - Other improvements
- Updated
- gallery-dl up to version 1.25.8
- yt-dlp up to version 2023.07.06
- LibVLCSharp up to 3.7.0
- VideoLAN up to 3.0.18
- Fixed
- TikTok supported again (read about the new TikTok requirements here)!
- Auto downloader: excluded labels and sites in default mode are not respected
- Download info: does not remember the last size and location
- Download info: hide unnecessary error
- Feed:
webmphotos not showing - Search users: incorrect search by name
- OnlyFans: incorrect parsing of username containing dots
- OnlyFans: incorrect error handler
- Reddit: handling error 502 (Reddit data not downloading)
- RedGifs: incorrect behavior when updating token
- Twitter: gifs are not downloading
- xHamster: some channels cannot be downloaded or are not fully downloaded
- YouTube: re-saving elements when loading a video list
- YouTube: files were not deleted when the delete button was clicked
- YouTube: a bug that caused the video to redownload